Aug 14 13:32:25 user nova-compute[73484]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 14 13:32:28 user nova-compute[73484]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73484) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 14 13:32:28 user nova-compute[73484]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73484) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 14 13:32:28 user nova-compute[73484]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73484) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 14 13:32:28 user nova-compute[73484]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 14 13:32:28 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:32:28 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:32:28 user nova-compute[73484]: INFO nova.virt.driver [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 14 13:32:29 user nova-compute[73484]: INFO nova.compute.provider_config [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] Acquiring lock "singleton_lock" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] Acquired lock "singleton_lock" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] Releasing lock "singleton_lock" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] Full set of CONF: {{(pid=73484) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ******************************************************************************** {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] Configuration options gathered from: {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ================================================================================ {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] allow_resize_to_same_host      = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] arq_binding_timeout            = 300 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] backdoor_port                  = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] backdoor_socket                = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] block_device_allocate_retries  = 300 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] block_device_allocate_retries_interval = 5 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cert                           = self.pem {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] compute_monitors               = [] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] config_dir                     = [] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] config_drive_format            = iso9660 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] config_source                  = [] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] console_host                   = user {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] control_exchange               = nova {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cpu_allocation_ratio           = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] daemon                         = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] debug                          = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] default_access_ip_network_name = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] default_availability_zone      = nova {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] default_ephemeral_format       = ext4 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] default_schedule_zone          = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] disk_allocation_ratio          = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] enable_new_services            = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] enabled_apis                   = ['osapi_compute'] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] enabled_ssl_apis               = [] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] flat_injected                  = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] force_config_drive             = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] force_raw_images               = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] graceful_shutdown_timeout      = 5 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] heal_instance_info_cache_interval = 60 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] host                           = user {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] instance_build_timeout         = 0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] instance_delete_interval       = 300 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] instance_name_template         = instance-%08x {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] instance_usage_audit           = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] instance_usage_audit_period    = month {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] internal_service_availability_zone = internal {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] key                            = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] live_migration_retry_count     = 30 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] log_config_append              = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] log_dir                        = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] log_file                       = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] log_options                    = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] log_rotate_interval            = 1 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] log_rotate_interval_type       = days {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] log_rotation_type              = none {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] long_rpc_timeout               = 1800 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] max_concurrent_builds          = 10 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] max_concurrent_live_migrations = 1 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] max_concurrent_snapshots       = 5 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] max_local_block_devices        = 3 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] max_logfile_count              = 30 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] max_logfile_size_mb            = 200 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] maximum_instance_delete_attempts = 5 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] metadata_listen                = 0.0.0.0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] metadata_listen_port           = 8775 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] metadata_workers               = 3 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] migrate_max_retries            = -1 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] mkisofs_cmd                    = genisoimage {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] my_ip                          = 10.0.0.210 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] network_allocate_retries       = 0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] osapi_compute_listen_port      = 8774 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] osapi_compute_unique_server_name_scope =  {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] osapi_compute_workers          = 3 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] password_length                = 12 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] periodic_enable                = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] periodic_fuzzy_delay           = 60 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] pointer_model                  = ps2mouse {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] preallocate_images             = none {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] publish_errors                 = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] pybasedir                      = /opt/stack/nova {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ram_allocation_ratio           = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] rate_limit_burst               = 0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] rate_limit_except_level        = CRITICAL {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] rate_limit_interval            = 0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] reboot_timeout                 = 0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] reclaim_instance_interval      = 0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] record                         = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] reimage_timeout_per_gb         = 60 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] report_interval                = 120 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] rescue_timeout                 = 0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] reserved_host_cpus             = 0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] reserved_host_disk_mb          = 0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] reserved_host_memory_mb        = 512 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] reserved_huge_pages            = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] resize_confirm_window          = 0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] resize_fs_using_block_device   = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] resume_guests_state_on_host_boot = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] rpc_response_timeout           = 60 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] run_external_periodic_tasks    = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] running_deleted_instance_action = reap {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] running_deleted_instance_poll_interval = 1800 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] running_deleted_instance_timeout = 0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] scheduler_instance_sync_interval = 120 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] service_down_time              = 720 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] servicegroup_driver            = db {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] shelved_offload_time           = 0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] shelved_poll_interval          = 3600 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] shutdown_timeout               = 0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] source_is_ipv6                 = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ssl_only                       = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] state_path                     = /opt/stack/data/nova {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] sync_power_state_interval      = 600 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] sync_power_state_pool_size     = 1000 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] syslog_log_facility            = LOG_USER {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] tempdir                        = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] timeout_nbd                    = 10 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] transport_url                  = **** {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] update_resources_interval      = 0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] use_cow_images                 = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] use_eventlog                   = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] use_journal                    = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] use_json                       = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] use_rootwrap_daemon            = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] use_stderr                     = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] use_syslog                     = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vcpu_pin_set                   = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vif_plugging_is_fatal          = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vif_plugging_timeout           = 0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] virt_mkfs                      = [] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] volume_usage_poll_interval     = 0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] watch_log_file                 = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] web                            = /usr/share/spice-html5 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_concurrency.disable_process_locking = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api.auth_strategy              = keystone {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api.compute_link_prefix        = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api.dhcp_domain                = novalocal {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api.enable_instance_password   = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api.glance_link_prefix         = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api.instance_list_per_project_cells = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api.list_records_by_skipping_down_cells = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api.local_metadata_per_cell    = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api.max_limit                  = 1000 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api.metadata_cache_expiration  = 15 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api.neutron_default_tenant_id  = default {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api.use_forwarded_for          = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api.use_neutron_default_nets   = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api.vendordata_dynamic_targets = [] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api.vendordata_jsonfile_path   = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.backend                  = dogpile.cache.memcached {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.backend_argument         = **** {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.config_prefix            = cache.oslo {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.dead_timeout             = 60.0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.debug_cache_backend      = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.enable_retry_client      = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.enable_socket_keepalive  = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.enabled                  = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.expiration_time          = 600 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.hashclient_retry_attempts = 2 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.memcache_dead_retry      = 300 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.memcache_password        =  {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.memcache_sasl_enabled    = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.memcache_username        =  {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.proxies                  = [] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.retry_attempts           = 2 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.retry_delay              = 0.0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.socket_keepalive_count   = 1 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.socket_keepalive_idle    = 1 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.socket_keepalive_interval = 1 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.tls_allowed_ciphers      = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.tls_cafile               = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.tls_certfile             = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.tls_enabled              = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cache.tls_keyfile              = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cinder.auth_section            = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cinder.auth_type               = password {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cinder.cafile                  = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cinder.certfile                = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cinder.collect_timing          = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cinder.cross_az_attach         = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cinder.debug                   = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cinder.endpoint_template       = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cinder.http_retries            = 3 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cinder.insecure                = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cinder.keyfile                 = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cinder.os_region_name          = RegionOne {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cinder.split_loggers           = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cinder.timeout                 = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] compute.cpu_dedicated_set      = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] compute.cpu_shared_set         = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] compute.image_type_exclude_list = [] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] compute.max_concurrent_disk_ops = 0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] compute.max_disk_devices_to_attach = -1 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] compute.resource_provider_association_refresh = 300 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] compute.shutdown_retry_interval = 10 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] conductor.workers              = 3 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] console.allowed_origins        = [] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] console.ssl_ciphers            = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] console.ssl_minimum_version    = default {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] consoleauth.token_ttl          = 600 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cyborg.cafile                  = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cyborg.certfile                = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cyborg.collect_timing          = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cyborg.connect_retries         = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cyborg.connect_retry_delay     = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cyborg.endpoint_override       = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cyborg.insecure                = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cyborg.keyfile                 = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cyborg.max_version             = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cyborg.min_version             = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cyborg.region_name             = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cyborg.service_name            = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cyborg.service_type            = accelerator {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cyborg.split_loggers           = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cyborg.status_code_retries     = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cyborg.status_code_retry_delay = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cyborg.timeout                 = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] cyborg.version                 = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] database.backend               = sqlalchemy {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] database.connection            = **** {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] database.connection_debug      = 0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] database.connection_parameters =  {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] database.connection_recycle_time = 3600 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] database.connection_trace      = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] database.db_inc_retry_interval = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] database.db_max_retries        = 20 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] database.db_max_retry_interval = 10 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] database.db_retry_interval     = 1 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] database.max_overflow          = 50 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] database.max_pool_size         = 5 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] database.max_retries           = 10 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] database.mysql_enable_ndb      = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] database.mysql_wsrep_sync_wait = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] database.pool_timeout          = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] database.retry_interval        = 10 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] database.slave_connection      = **** {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] database.sqlite_synchronous    = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api_database.backend           = sqlalchemy {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api_database.connection        = **** {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api_database.connection_debug  = 0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api_database.connection_parameters =  {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api_database.connection_recycle_time = 3600 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api_database.connection_trace  = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api_database.db_inc_retry_interval = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api_database.db_max_retries    = 20 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api_database.db_max_retry_interval = 10 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api_database.db_retry_interval = 1 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api_database.max_overflow      = 50 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api_database.max_pool_size     = 5 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api_database.max_retries       = 10 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api_database.mysql_enable_ndb  = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api_database.pool_timeout      = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api_database.retry_interval    = 10 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api_database.slave_connection  = **** {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] api_database.sqlite_synchronous = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] devices.enabled_mdev_types     = [] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ephemeral_storage_encryption.enabled = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] glance.api_servers             = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] glance.cafile                  = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] glance.certfile                = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] glance.collect_timing          = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] glance.connect_retries         = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] glance.connect_retry_delay     = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] glance.debug                   = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] glance.default_trusted_certificate_ids = [] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] glance.enable_certificate_validation = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] glance.enable_rbd_download     = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] glance.endpoint_override       = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] glance.insecure                = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] glance.keyfile                 = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] glance.max_version             = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] glance.min_version             = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] glance.num_retries             = 3 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] glance.rbd_ceph_conf           =  {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] glance.rbd_connect_timeout     = 5 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] glance.rbd_pool                =  {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] glance.rbd_user                =  {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] glance.region_name             = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] glance.service_name            = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] glance.service_type            = image {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] glance.split_loggers           = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] glance.status_code_retries     = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] glance.status_code_retry_delay = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] glance.timeout                 = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] glance.verify_glance_signatures = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] glance.version                 = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] guestfs.debug                  = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] hyperv.config_drive_cdrom      = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] hyperv.config_drive_inject_password = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] hyperv.enable_instance_metrics_collection = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] hyperv.enable_remotefx         = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] hyperv.instances_path_share    =  {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] hyperv.iscsi_initiator_list    = [] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] hyperv.limit_cpu_features      = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] hyperv.power_state_check_timeframe = 60 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] hyperv.use_multipath_io        = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] hyperv.volume_attach_retry_count = 10 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] hyperv.vswitch_name            = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] mks.enabled                    = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] image_cache.manager_interval   = 2400 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] image_cache.precache_concurrency = 1 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] image_cache.remove_unused_base_images = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] image_cache.subdirectory_name  = _base {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ironic.api_max_retries         = 60 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ironic.api_retry_interval      = 2 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ironic.auth_section            = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ironic.auth_type               = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ironic.cafile                  = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ironic.certfile                = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ironic.collect_timing          = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ironic.connect_retries         = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ironic.connect_retry_delay     = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ironic.endpoint_override       = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ironic.insecure                = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ironic.keyfile                 = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ironic.max_version             = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ironic.min_version             = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ironic.partition_key           = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ironic.peer_list               = [] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ironic.region_name             = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ironic.serial_console_state_timeout = 10 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ironic.service_name            = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ironic.service_type            = baremetal {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ironic.split_loggers           = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ironic.status_code_retries     = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ironic.status_code_retry_delay = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ironic.timeout                 = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ironic.version                 = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] key_manager.fixed_key          = **** {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] barbican.barbican_api_version  = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] barbican.barbican_endpoint     = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] barbican.barbican_endpoint_type = public {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] barbican.barbican_region_name  = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] barbican.cafile                = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] barbican.certfile              = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] barbican.collect_timing        = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] barbican.insecure              = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] barbican.keyfile               = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] barbican.number_of_retries     = 60 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] barbican.retry_delay           = 1 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] barbican.send_service_user_token = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] barbican.split_loggers         = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] barbican.timeout               = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] barbican.verify_ssl            = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] barbican.verify_ssl_path       = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] barbican_service_user.auth_section = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] barbican_service_user.auth_type = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] barbican_service_user.cafile   = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] barbican_service_user.certfile = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] barbican_service_user.collect_timing = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] barbican_service_user.insecure = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] barbican_service_user.keyfile  = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] barbican_service_user.split_loggers = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] barbican_service_user.timeout  = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vault.approle_role_id          = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vault.approle_secret_id        = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vault.cafile                   = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vault.certfile                 = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vault.collect_timing           = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vault.insecure                 = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vault.keyfile                  = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vault.kv_mountpoint            = secret {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vault.kv_version               = 2 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vault.namespace                = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vault.root_token_id            = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vault.split_loggers            = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vault.ssl_ca_crt_file          = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vault.timeout                  = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vault.use_ssl                  = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] keystone.cafile                = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] keystone.certfile              = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] keystone.collect_timing        = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] keystone.connect_retries       = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] keystone.connect_retry_delay   = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] keystone.endpoint_override     = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] keystone.insecure              = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] keystone.keyfile               = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] keystone.max_version           = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] keystone.min_version           = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] keystone.region_name           = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] keystone.service_name          = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] keystone.service_type          = identity {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] keystone.split_loggers         = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] keystone.status_code_retries   = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] keystone.status_code_retry_delay = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] keystone.timeout               = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] keystone.version               = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.connection_uri         =  {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.cpu_mode               = custom {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: WARNING oslo_config.cfg [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.cpu_power_governor_high = performance {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.cpu_power_governor_low = powersave {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.cpu_power_management   = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.device_detach_attempts = 8 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.device_detach_timeout  = 20 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.disk_cachemodes        = [] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.disk_prefix            = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.enabled_perf_events    = [] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.file_backed_memory     = 0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.gid_maps               = [] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.hw_disk_discard        = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.hw_machine_type        = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.images_rbd_glance_store_name =  {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.images_rbd_pool        = rbd {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.images_type            = default {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.images_volume_group    = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.inject_key             = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.inject_partition       = -2 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.inject_password        = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.iscsi_iface            = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.iser_use_multipath     = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.live_migration_bandwidth = 0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.live_migration_downtime = 500 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.live_migration_inbound_addr = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.live_migration_permit_post_copy = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.live_migration_scheme  = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.live_migration_timeout_action = abort {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.live_migration_tunnelled = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: WARNING oslo_config.cfg [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 14 13:32:29 user nova-compute[73484]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 14 13:32:29 user nova-compute[73484]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 14 13:32:29 user nova-compute[73484]: and ``live_migration_inbound_addr`` respectively.
Aug 14 13:32:29 user nova-compute[73484]: ).  Its value may be silently ignored in the future.
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.live_migration_with_native_tls = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.max_queues             = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.nfs_mount_options      = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.num_memory_encrypted_guests = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.num_pcie_ports         = 0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.pmem_namespaces        = [] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.quobyte_client_cfg     = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.rbd_secret_uuid        = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.rbd_user               = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.remote_filesystem_transport = ssh {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.rescue_image_id        = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.rescue_kernel_id       = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.rescue_ramdisk_id      = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.rx_queue_size          = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.smbfs_mount_options    =  {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.snapshot_compression   = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.snapshot_image_format  = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.sparse_logical_volumes = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.swtpm_enabled          = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.swtpm_group            = tss {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.swtpm_user             = tss {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.sysinfo_serial         = unique {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.tb_cache_size          = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.tx_queue_size          = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.uid_maps               = [] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.use_virtio_for_bridges = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.virt_type              = kvm {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.volume_clear           = zero {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.volume_clear_size      = 0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.volume_use_multipath   = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.vzstorage_cache_path   = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.vzstorage_mount_user   = stack {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] neutron.auth_section           = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] neutron.auth_type              = password {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] neutron.cafile                 = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] neutron.certfile               = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] neutron.collect_timing         = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] neutron.connect_retries        = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] neutron.connect_retry_delay    = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] neutron.default_floating_pool  = public {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] neutron.endpoint_override      = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] neutron.extension_sync_interval = 600 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] neutron.http_retries           = 3 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] neutron.insecure               = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] neutron.keyfile                = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] neutron.max_version            = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] neutron.min_version            = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] neutron.ovs_bridge             = br-int {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] neutron.physnets               = [] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] neutron.region_name            = RegionOne {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] neutron.service_metadata_proxy = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] neutron.service_name           = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] neutron.service_type           = network {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] neutron.split_loggers          = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] neutron.status_code_retries    = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] neutron.status_code_retry_delay = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] neutron.timeout                = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] neutron.version                = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] notifications.bdms_in_notifications = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] notifications.default_level    = INFO {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] notifications.notification_format = unversioned {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] notifications.notify_on_state_change = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] pci.alias                      = [] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] pci.device_spec                = [] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] pci.report_in_placement        = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.auth_section         = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.auth_type            = password {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.cafile               = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.certfile             = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.collect_timing       = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.connect_retries      = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.connect_retry_delay  = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.default_domain_id    = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.default_domain_name  = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.domain_id            = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.domain_name          = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.endpoint_override    = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.insecure             = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.keyfile              = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.max_version          = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.min_version          = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.password             = **** {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.project_domain_id    = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.project_domain_name  = Default {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.project_id           = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.project_name         = service {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.region_name          = RegionOne {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.service_name         = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.service_type         = placement {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.split_loggers        = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.status_code_retries  = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.status_code_retry_delay = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.system_scope         = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.timeout              = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.trust_id             = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.user_domain_id       = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.user_domain_name     = Default {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.user_id              = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.username             = placement {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] placement.version              = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] quota.cores                    = 20 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] quota.count_usage_from_placement = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] quota.injected_file_content_bytes = 10240 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] quota.injected_file_path_length = 255 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] quota.injected_files           = 5 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] quota.instances                = 10 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] quota.key_pairs                = 100 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] quota.metadata_items           = 128 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] quota.ram                      = 51200 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] quota.recheck_quota            = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] quota.server_group_members     = 10 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] quota.server_groups            = 10 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] rdp.enabled                    = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] scheduler.image_metadata_prefilter = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] scheduler.max_attempts         = 3 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] scheduler.max_placement_results = 1000 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] scheduler.query_placement_for_availability_zone = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] scheduler.query_placement_for_image_type_support = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] scheduler.workers              = 3 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] filter_scheduler.host_subset_size = 1 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] filter_scheduler.isolated_hosts = [] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] filter_scheduler.isolated_images = [] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] filter_scheduler.pci_in_placement = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] filter_scheduler.track_instance_changes = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] metrics.required               = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] metrics.weight_multiplier      = 1.0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] metrics.weight_setting         = [] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] serial_console.enabled         = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] serial_console.port_range      = 10000:20000 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] serial_console.serialproxy_port = 6083 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] service_user.auth_section      = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] service_user.auth_type         = password {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] service_user.cafile            = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] service_user.certfile          = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] service_user.collect_timing    = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] service_user.insecure          = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] service_user.keyfile           = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] service_user.send_service_user_token = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] service_user.split_loggers     = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] service_user.timeout           = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] spice.agent_enabled            = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] spice.enabled                  = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] spice.html5proxy_port          = 6082 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] spice.image_compression        = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] spice.jpeg_compression         = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] spice.playback_compression     = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] spice.server_listen            = 127.0.0.1 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] spice.streaming_mode           = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] spice.zlib_compression         = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] upgrade_levels.baseapi         = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] upgrade_levels.cert            = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] upgrade_levels.compute         = auto {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] upgrade_levels.conductor       = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] upgrade_levels.scheduler       = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vendordata_dynamic_auth.auth_section = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vendordata_dynamic_auth.auth_type = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vendordata_dynamic_auth.cafile = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vendordata_dynamic_auth.certfile = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vendordata_dynamic_auth.insecure = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vendordata_dynamic_auth.keyfile = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vendordata_dynamic_auth.timeout = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vmware.api_retry_count         = 10 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vmware.ca_file                 = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vmware.cache_prefix            = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vmware.cluster_name            = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vmware.connection_pool_size    = 10 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vmware.console_delay_seconds   = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vmware.datastore_regex         = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vmware.host_ip                 = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vmware.host_password           = **** {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vmware.host_port               = 443 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vmware.host_username           = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vmware.insecure                = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vmware.integration_bridge      = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vmware.maximum_objects         = 100 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vmware.pbm_default_policy      = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vmware.pbm_enabled             = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vmware.pbm_wsdl_location       = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vmware.serial_port_proxy_uri   = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vmware.serial_port_service_uri = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vmware.task_poll_interval      = 0.5 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vmware.use_linked_clone        = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vmware.vnc_keymap              = en-us {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vmware.vnc_port                = 5900 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vmware.vnc_port_total          = 10000 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vnc.auth_schemes               = ['none'] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vnc.enabled                    = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vnc.novncproxy_port            = 6080 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vnc.server_listen              = 0.0.0.0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vnc.vencrypt_ca_certs          = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vnc.vencrypt_client_cert       = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vnc.vencrypt_client_key        = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] workarounds.disable_rootwrap   = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] workarounds.enable_numa_live_migration = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] workarounds.libvirt_disable_apic = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] wsgi.client_socket_timeout     = 900 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] wsgi.default_pool_size         = 1000 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] wsgi.keep_alive                = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] wsgi.max_header_line           = 16384 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] wsgi.ssl_ca_file               = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] wsgi.ssl_cert_file             = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] wsgi.ssl_key_file              = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] wsgi.tcp_keepidle              = 600 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] zvm.ca_file                    = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] zvm.cloud_connector_url        = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] zvm.reachable_timeout          = 300 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_policy.enforce_new_defaults = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_policy.enforce_scope      = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_policy.policy_default_rule = default {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] profiler.connection_string     = messaging:// {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] profiler.enabled               = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] profiler.es_doc_type           = notification {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] profiler.es_scroll_size        = 10000 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] profiler.es_scroll_time        = 2m {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] profiler.filter_error_trace    = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] profiler.hmac_keys             = **** {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] profiler.sentinel_service_name = mymaster {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] profiler.socket_timeout        = 0.1 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] profiler.trace_requests        = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] profiler.trace_sqlalchemy      = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] profiler_jaeger.process_tags   = {} {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] profiler_jaeger.service_name_prefix = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] profiler_otlp.service_name_prefix = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] remote_debug.host              = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] remote_debug.port              = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_notifications.retry = -1 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_limit.auth_section        = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_limit.auth_type           = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_limit.cafile              = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_limit.certfile            = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_limit.collect_timing      = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_limit.connect_retries     = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_limit.connect_retry_delay = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_limit.endpoint_id         = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_limit.endpoint_override   = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_limit.insecure            = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_limit.keyfile             = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_limit.max_version         = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_limit.min_version         = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_limit.region_name         = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_limit.service_name        = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_limit.service_type        = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_limit.split_loggers       = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_limit.status_code_retries = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_limit.status_code_retry_delay = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_limit.timeout             = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_limit.valid_interfaces    = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_limit.version             = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_reports.file_event_handler = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] oslo_reports.log_dir           = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vif_plug_ovs_privileged.group  = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] vif_plug_ovs_privileged.user   = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] os_vif_linux_bridge.flat_interface = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] os_vif_ovs.isolate_vif         = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] os_vif_ovs.per_port_bridge     = False {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] os_brick.lock_path             = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] privsep_osbrick.capabilities   = [21] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] privsep_osbrick.group          = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] privsep_osbrick.helper_command = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] privsep_osbrick.user           = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] nova_sys_admin.group           = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] nova_sys_admin.helper_command  = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] nova_sys_admin.user            = None {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG oslo_service.service [None req-eac3e7e1-5b70-4ee9-aed9-b570fe5e9421 None None] ******************************************************************************** {{(pid=73484) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 14 13:32:29 user nova-compute[73484]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 14 13:32:29 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Starting native event thread {{(pid=73484) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Starting green dispatch thread {{(pid=73484) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Starting connection event dispatch thread {{(pid=73484) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Connecting to libvirt: qemu:///system {{(pid=73484) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fc489e2cdc0> {{(pid=73484) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 14 13:32:29 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fc489e2cdc0> {{(pid=73484) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 14 13:32:29 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Connection event '1' reason 'None'
Aug 14 13:32:29 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 14 13:32:29 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.mount [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Initialising _HostMountState generation 0 {{(pid=73484) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 14 13:32:36 user nova-compute[73484]: INFO nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Libvirt host capabilities <capabilities>
Aug 14 13:32:36 user nova-compute[73484]:   <host>
Aug 14 13:32:36 user nova-compute[73484]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 14 13:32:36 user nova-compute[73484]:     <cpu>
Aug 14 13:32:36 user nova-compute[73484]:       <arch>x86_64</arch>
Aug 14 13:32:36 user nova-compute[73484]:       <model>IvyBridge-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <vendor>Intel</vendor>
Aug 14 13:32:36 user nova-compute[73484]:       <microcode version='1070'/>
Aug 14 13:32:36 user nova-compute[73484]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 14 13:32:36 user nova-compute[73484]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature name='ss'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature name='vmx'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature name='pcid'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature name='osxsave'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature name='hypervisor'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature name='arat'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature name='tsc_adjust'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature name='md-clear'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature name='stibp'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature name='arch-capabilities'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature name='ssbd'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature name='invtsc'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature name='rsba'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature name='skip-l1dfl-vmentry'/>
Aug 14 13:32:36 user nova-compute[73484]:       <pages unit='KiB' size='4'/>
Aug 14 13:32:36 user nova-compute[73484]:       <pages unit='KiB' size='2048'/>
Aug 14 13:32:36 user nova-compute[73484]:     </cpu>
Aug 14 13:32:36 user nova-compute[73484]:     <power_management>
Aug 14 13:32:36 user nova-compute[73484]:       <suspend_mem/>
Aug 14 13:32:36 user nova-compute[73484]:       <suspend_disk/>
Aug 14 13:32:36 user nova-compute[73484]:       <suspend_hybrid/>
Aug 14 13:32:36 user nova-compute[73484]:     </power_management>
Aug 14 13:32:36 user nova-compute[73484]:     <iommu support='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     <migration_features>
Aug 14 13:32:36 user nova-compute[73484]:       <live/>
Aug 14 13:32:36 user nova-compute[73484]:       <uri_transports>
Aug 14 13:32:36 user nova-compute[73484]:         <uri_transport>tcp</uri_transport>
Aug 14 13:32:36 user nova-compute[73484]:         <uri_transport>rdma</uri_transport>
Aug 14 13:32:36 user nova-compute[73484]:       </uri_transports>
Aug 14 13:32:36 user nova-compute[73484]:     </migration_features>
Aug 14 13:32:36 user nova-compute[73484]:     <topology>
Aug 14 13:32:36 user nova-compute[73484]:       <cells num='2'>
Aug 14 13:32:36 user nova-compute[73484]:         <cell id='0'>
Aug 14 13:32:36 user nova-compute[73484]:           <memory unit='KiB'>8189224</memory>
Aug 14 13:32:36 user nova-compute[73484]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 14 13:32:36 user nova-compute[73484]:           <pages unit='KiB' size='2048'>0</pages>
Aug 14 13:32:36 user nova-compute[73484]:           <distances>
Aug 14 13:32:36 user nova-compute[73484]:             <sibling id='0' value='10'/>
Aug 14 13:32:36 user nova-compute[73484]:             <sibling id='1' value='20'/>
Aug 14 13:32:36 user nova-compute[73484]:           </distances>
Aug 14 13:32:36 user nova-compute[73484]:           <cpus num='6'>
Aug 14 13:32:36 user nova-compute[73484]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 14 13:32:36 user nova-compute[73484]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 14 13:32:36 user nova-compute[73484]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 14 13:32:36 user nova-compute[73484]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 14 13:32:36 user nova-compute[73484]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 14 13:32:36 user nova-compute[73484]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 14 13:32:36 user nova-compute[73484]:           </cpus>
Aug 14 13:32:36 user nova-compute[73484]:         </cell>
Aug 14 13:32:36 user nova-compute[73484]:         <cell id='1'>
Aug 14 13:32:36 user nova-compute[73484]:           <memory unit='KiB'>8206460</memory>
Aug 14 13:32:36 user nova-compute[73484]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 14 13:32:36 user nova-compute[73484]:           <pages unit='KiB' size='2048'>0</pages>
Aug 14 13:32:36 user nova-compute[73484]:           <distances>
Aug 14 13:32:36 user nova-compute[73484]:             <sibling id='0' value='20'/>
Aug 14 13:32:36 user nova-compute[73484]:             <sibling id='1' value='10'/>
Aug 14 13:32:36 user nova-compute[73484]:           </distances>
Aug 14 13:32:36 user nova-compute[73484]:           <cpus num='6'>
Aug 14 13:32:36 user nova-compute[73484]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 14 13:32:36 user nova-compute[73484]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 14 13:32:36 user nova-compute[73484]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 14 13:32:36 user nova-compute[73484]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 14 13:32:36 user nova-compute[73484]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 14 13:32:36 user nova-compute[73484]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 14 13:32:36 user nova-compute[73484]:           </cpus>
Aug 14 13:32:36 user nova-compute[73484]:         </cell>
Aug 14 13:32:36 user nova-compute[73484]:       </cells>
Aug 14 13:32:36 user nova-compute[73484]:     </topology>
Aug 14 13:32:36 user nova-compute[73484]:     <cache>
Aug 14 13:32:36 user nova-compute[73484]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 14 13:32:36 user nova-compute[73484]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 14 13:32:36 user nova-compute[73484]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 14 13:32:36 user nova-compute[73484]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 14 13:32:36 user nova-compute[73484]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 14 13:32:36 user nova-compute[73484]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 14 13:32:36 user nova-compute[73484]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 14 13:32:36 user nova-compute[73484]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 14 13:32:36 user nova-compute[73484]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 14 13:32:36 user nova-compute[73484]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 14 13:32:36 user nova-compute[73484]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 14 13:32:36 user nova-compute[73484]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 14 13:32:36 user nova-compute[73484]:     </cache>
Aug 14 13:32:36 user nova-compute[73484]:     <secmodel>
Aug 14 13:32:36 user nova-compute[73484]:       <model>apparmor</model>
Aug 14 13:32:36 user nova-compute[73484]:       <doi>0</doi>
Aug 14 13:32:36 user nova-compute[73484]:     </secmodel>
Aug 14 13:32:36 user nova-compute[73484]:     <secmodel>
Aug 14 13:32:36 user nova-compute[73484]:       <model>dac</model>
Aug 14 13:32:36 user nova-compute[73484]:       <doi>0</doi>
Aug 14 13:32:36 user nova-compute[73484]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 14 13:32:36 user nova-compute[73484]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 14 13:32:36 user nova-compute[73484]:     </secmodel>
Aug 14 13:32:36 user nova-compute[73484]:   </host>
Aug 14 13:32:36 user nova-compute[73484]:   <guest>
Aug 14 13:32:36 user nova-compute[73484]:     <os_type>hvm</os_type>
Aug 14 13:32:36 user nova-compute[73484]:     <arch name='alpha'>
Aug 14 13:32:36 user nova-compute[73484]:       <wordsize>64</wordsize>
Aug 14 13:32:36 user nova-compute[73484]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>clipper</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <domain type='qemu'/>
Aug 14 13:32:36 user nova-compute[73484]:     </arch>
Aug 14 13:32:36 user nova-compute[73484]:     <features>
Aug 14 13:32:36 user nova-compute[73484]:       <cpuselection/>
Aug 14 13:32:36 user nova-compute[73484]:       <deviceboot/>
Aug 14 13:32:36 user nova-compute[73484]:       <disksnapshot default='on' toggle='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     </features>
Aug 14 13:32:36 user nova-compute[73484]:   </guest>
Aug 14 13:32:36 user nova-compute[73484]:   <guest>
Aug 14 13:32:36 user nova-compute[73484]:     <os_type>hvm</os_type>
Aug 14 13:32:36 user nova-compute[73484]:     <arch name='armv6l'>
Aug 14 13:32:36 user nova-compute[73484]:       <wordsize>32</wordsize>
Aug 14 13:32:36 user nova-compute[73484]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>integratorcp</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>borzoi</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>spitz</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>nuri</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>musca-b1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>versatileab</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>kzm</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>musca-a</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>smdkc210</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>sx1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>z2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>tosa</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>sabrelite</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>realview-eb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>n810</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>n800</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>versatilepb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>terrier</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mainstone</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>midway</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>musicpal</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>microbit</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>cubieboard</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>verdex</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>netduino2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>raspi2b</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>cheetah</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>highbank</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>akita</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>connex</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>collie</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>raspi0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <domain type='qemu'/>
Aug 14 13:32:36 user nova-compute[73484]:     </arch>
Aug 14 13:32:36 user nova-compute[73484]:     <features>
Aug 14 13:32:36 user nova-compute[73484]:       <cpuselection/>
Aug 14 13:32:36 user nova-compute[73484]:       <deviceboot/>
Aug 14 13:32:36 user nova-compute[73484]:       <disksnapshot default='on' toggle='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     </features>
Aug 14 13:32:36 user nova-compute[73484]:   </guest>
Aug 14 13:32:36 user nova-compute[73484]:   <guest>
Aug 14 13:32:36 user nova-compute[73484]:     <os_type>hvm</os_type>
Aug 14 13:32:36 user nova-compute[73484]:     <arch name='armv7l'>
Aug 14 13:32:36 user nova-compute[73484]:       <wordsize>32</wordsize>
Aug 14 13:32:36 user nova-compute[73484]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>integratorcp</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>borzoi</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>spitz</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>nuri</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>musca-b1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>versatileab</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>kzm</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>musca-a</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>smdkc210</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>sx1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>z2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>tosa</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>sabrelite</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>realview-eb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>n810</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>n800</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>versatilepb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>terrier</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mainstone</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>midway</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>musicpal</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>microbit</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>cubieboard</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>verdex</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>netduino2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>raspi2b</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>cheetah</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>highbank</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>akita</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>connex</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>collie</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>raspi0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <domain type='qemu'/>
Aug 14 13:32:36 user nova-compute[73484]:     </arch>
Aug 14 13:32:36 user nova-compute[73484]:     <features>
Aug 14 13:32:36 user nova-compute[73484]:       <cpuselection/>
Aug 14 13:32:36 user nova-compute[73484]:       <deviceboot/>
Aug 14 13:32:36 user nova-compute[73484]:       <disksnapshot default='on' toggle='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     </features>
Aug 14 13:32:36 user nova-compute[73484]:   </guest>
Aug 14 13:32:36 user nova-compute[73484]:   <guest>
Aug 14 13:32:36 user nova-compute[73484]:     <os_type>hvm</os_type>
Aug 14 13:32:36 user nova-compute[73484]:     <arch name='aarch64'>
Aug 14 13:32:36 user nova-compute[73484]:       <wordsize>64</wordsize>
Aug 14 13:32:36 user nova-compute[73484]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>integratorcp</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>borzoi</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>spitz</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>nuri</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>musca-b1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>versatileab</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>kzm</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>musca-a</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>smdkc210</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>sx1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>z2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>tosa</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>sabrelite</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>realview-eb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>n810</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>n800</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>versatilepb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>terrier</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mainstone</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>midway</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>musicpal</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>microbit</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>cubieboard</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>verdex</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>netduino2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>raspi3b</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>raspi2b</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>cheetah</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>highbank</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>akita</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>connex</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>collie</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>raspi0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <domain type='qemu'/>
Aug 14 13:32:36 user nova-compute[73484]:     </arch>
Aug 14 13:32:36 user nova-compute[73484]:     <features>
Aug 14 13:32:36 user nova-compute[73484]:       <acpi default='on' toggle='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:       <cpuselection/>
Aug 14 13:32:36 user nova-compute[73484]:       <deviceboot/>
Aug 14 13:32:36 user nova-compute[73484]:       <disksnapshot default='on' toggle='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     </features>
Aug 14 13:32:36 user nova-compute[73484]:   </guest>
Aug 14 13:32:36 user nova-compute[73484]:   <guest>
Aug 14 13:32:36 user nova-compute[73484]:     <os_type>hvm</os_type>
Aug 14 13:32:36 user nova-compute[73484]:     <arch name='cris'>
Aug 14 13:32:36 user nova-compute[73484]:       <wordsize>32</wordsize>
Aug 14 13:32:36 user nova-compute[73484]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <domain type='qemu'/>
Aug 14 13:32:36 user nova-compute[73484]:     </arch>
Aug 14 13:32:36 user nova-compute[73484]:     <features>
Aug 14 13:32:36 user nova-compute[73484]:       <cpuselection/>
Aug 14 13:32:36 user nova-compute[73484]:       <deviceboot/>
Aug 14 13:32:36 user nova-compute[73484]:       <disksnapshot default='on' toggle='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     </features>
Aug 14 13:32:36 user nova-compute[73484]:   </guest>
Aug 14 13:32:36 user nova-compute[73484]:   <guest>
Aug 14 13:32:36 user nova-compute[73484]:     <os_type>hvm</os_type>
Aug 14 13:32:36 user nova-compute[73484]:     <arch name='i686'>
Aug 14 13:32:36 user nova-compute[73484]:       <wordsize>32</wordsize>
Aug 14 13:32:36 user nova-compute[73484]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>x-remote</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>isapc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>microvm</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <domain type='qemu'/>
Aug 14 13:32:36 user nova-compute[73484]:       <domain type='kvm'/>
Aug 14 13:32:36 user nova-compute[73484]:     </arch>
Aug 14 13:32:36 user nova-compute[73484]:     <features>
Aug 14 13:32:36 user nova-compute[73484]:       <pae/>
Aug 14 13:32:36 user nova-compute[73484]:       <nonpae/>
Aug 14 13:32:36 user nova-compute[73484]:       <acpi default='on' toggle='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:       <apic default='on' toggle='no'/>
Aug 14 13:32:36 user nova-compute[73484]:       <cpuselection/>
Aug 14 13:32:36 user nova-compute[73484]:       <deviceboot/>
Aug 14 13:32:36 user nova-compute[73484]:       <disksnapshot default='on' toggle='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     </features>
Aug 14 13:32:36 user nova-compute[73484]:   </guest>
Aug 14 13:32:36 user nova-compute[73484]:   <guest>
Aug 14 13:32:36 user nova-compute[73484]:     <os_type>hvm</os_type>
Aug 14 13:32:36 user nova-compute[73484]:     <arch name='m68k'>
Aug 14 13:32:36 user nova-compute[73484]:       <wordsize>32</wordsize>
Aug 14 13:32:36 user nova-compute[73484]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>an5206</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>q800</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>next-cube</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <domain type='qemu'/>
Aug 14 13:32:36 user nova-compute[73484]:     </arch>
Aug 14 13:32:36 user nova-compute[73484]:     <features>
Aug 14 13:32:36 user nova-compute[73484]:       <cpuselection/>
Aug 14 13:32:36 user nova-compute[73484]:       <deviceboot/>
Aug 14 13:32:36 user nova-compute[73484]:       <disksnapshot default='on' toggle='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     </features>
Aug 14 13:32:36 user nova-compute[73484]:   </guest>
Aug 14 13:32:36 user nova-compute[73484]:   <guest>
Aug 14 13:32:36 user nova-compute[73484]:     <os_type>hvm</os_type>
Aug 14 13:32:36 user nova-compute[73484]:     <arch name='microblaze'>
Aug 14 13:32:36 user nova-compute[73484]:       <wordsize>32</wordsize>
Aug 14 13:32:36 user nova-compute[73484]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <domain type='qemu'/>
Aug 14 13:32:36 user nova-compute[73484]:     </arch>
Aug 14 13:32:36 user nova-compute[73484]:     <features>
Aug 14 13:32:36 user nova-compute[73484]:       <cpuselection/>
Aug 14 13:32:36 user nova-compute[73484]:       <deviceboot/>
Aug 14 13:32:36 user nova-compute[73484]:       <disksnapshot default='on' toggle='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     </features>
Aug 14 13:32:36 user nova-compute[73484]:   </guest>
Aug 14 13:32:36 user nova-compute[73484]:   <guest>
Aug 14 13:32:36 user nova-compute[73484]:     <os_type>hvm</os_type>
Aug 14 13:32:36 user nova-compute[73484]:     <arch name='microblazeel'>
Aug 14 13:32:36 user nova-compute[73484]:       <wordsize>32</wordsize>
Aug 14 13:32:36 user nova-compute[73484]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <domain type='qemu'/>
Aug 14 13:32:36 user nova-compute[73484]:     </arch>
Aug 14 13:32:36 user nova-compute[73484]:     <features>
Aug 14 13:32:36 user nova-compute[73484]:       <cpuselection/>
Aug 14 13:32:36 user nova-compute[73484]:       <deviceboot/>
Aug 14 13:32:36 user nova-compute[73484]:       <disksnapshot default='on' toggle='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     </features>
Aug 14 13:32:36 user nova-compute[73484]:   </guest>
Aug 14 13:32:36 user nova-compute[73484]:   <guest>
Aug 14 13:32:36 user nova-compute[73484]:     <os_type>hvm</os_type>
Aug 14 13:32:36 user nova-compute[73484]:     <arch name='mips'>
Aug 14 13:32:36 user nova-compute[73484]:       <wordsize>32</wordsize>
Aug 14 13:32:36 user nova-compute[73484]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='16'>malta</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <domain type='qemu'/>
Aug 14 13:32:36 user nova-compute[73484]:     </arch>
Aug 14 13:32:36 user nova-compute[73484]:     <features>
Aug 14 13:32:36 user nova-compute[73484]:       <cpuselection/>
Aug 14 13:32:36 user nova-compute[73484]:       <deviceboot/>
Aug 14 13:32:36 user nova-compute[73484]:       <disksnapshot default='on' toggle='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     </features>
Aug 14 13:32:36 user nova-compute[73484]:   </guest>
Aug 14 13:32:36 user nova-compute[73484]:   <guest>
Aug 14 13:32:36 user nova-compute[73484]:     <os_type>hvm</os_type>
Aug 14 13:32:36 user nova-compute[73484]:     <arch name='mipsel'>
Aug 14 13:32:36 user nova-compute[73484]:       <wordsize>32</wordsize>
Aug 14 13:32:36 user nova-compute[73484]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='16'>malta</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <domain type='qemu'/>
Aug 14 13:32:36 user nova-compute[73484]:     </arch>
Aug 14 13:32:36 user nova-compute[73484]:     <features>
Aug 14 13:32:36 user nova-compute[73484]:       <cpuselection/>
Aug 14 13:32:36 user nova-compute[73484]:       <deviceboot/>
Aug 14 13:32:36 user nova-compute[73484]:       <disksnapshot default='on' toggle='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     </features>
Aug 14 13:32:36 user nova-compute[73484]:   </guest>
Aug 14 13:32:36 user nova-compute[73484]:   <guest>
Aug 14 13:32:36 user nova-compute[73484]:     <os_type>hvm</os_type>
Aug 14 13:32:36 user nova-compute[73484]:     <arch name='mips64'>
Aug 14 13:32:36 user nova-compute[73484]:       <wordsize>64</wordsize>
Aug 14 13:32:36 user nova-compute[73484]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='16'>malta</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>pica61</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>magnum</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <domain type='qemu'/>
Aug 14 13:32:36 user nova-compute[73484]:     </arch>
Aug 14 13:32:36 user nova-compute[73484]:     <features>
Aug 14 13:32:36 user nova-compute[73484]:       <cpuselection/>
Aug 14 13:32:36 user nova-compute[73484]:       <deviceboot/>
Aug 14 13:32:36 user nova-compute[73484]:       <disksnapshot default='on' toggle='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     </features>
Aug 14 13:32:36 user nova-compute[73484]:   </guest>
Aug 14 13:32:36 user nova-compute[73484]:   <guest>
Aug 14 13:32:36 user nova-compute[73484]:     <os_type>hvm</os_type>
Aug 14 13:32:36 user nova-compute[73484]:     <arch name='mips64el'>
Aug 14 13:32:36 user nova-compute[73484]:       <wordsize>64</wordsize>
Aug 14 13:32:36 user nova-compute[73484]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='16'>malta</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>pica61</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>magnum</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='16'>boston</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <domain type='qemu'/>
Aug 14 13:32:36 user nova-compute[73484]:     </arch>
Aug 14 13:32:36 user nova-compute[73484]:     <features>
Aug 14 13:32:36 user nova-compute[73484]:       <cpuselection/>
Aug 14 13:32:36 user nova-compute[73484]:       <deviceboot/>
Aug 14 13:32:36 user nova-compute[73484]:       <disksnapshot default='on' toggle='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     </features>
Aug 14 13:32:36 user nova-compute[73484]:   </guest>
Aug 14 13:32:36 user nova-compute[73484]:   <guest>
Aug 14 13:32:36 user nova-compute[73484]:     <os_type>hvm</os_type>
Aug 14 13:32:36 user nova-compute[73484]:     <arch name='ppc'>
Aug 14 13:32:36 user nova-compute[73484]:       <wordsize>32</wordsize>
Aug 14 13:32:36 user nova-compute[73484]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>g3beige</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mac99</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='32'>ppce500</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>pegasos2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>sam460ex</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>bamboo</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>40p</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>ref405ep</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>taihu</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <domain type='qemu'/>
Aug 14 13:32:36 user nova-compute[73484]:     </arch>
Aug 14 13:32:36 user nova-compute[73484]:     <features>
Aug 14 13:32:36 user nova-compute[73484]:       <cpuselection/>
Aug 14 13:32:36 user nova-compute[73484]:       <deviceboot/>
Aug 14 13:32:36 user nova-compute[73484]:       <disksnapshot default='on' toggle='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     </features>
Aug 14 13:32:36 user nova-compute[73484]:   </guest>
Aug 14 13:32:36 user nova-compute[73484]:   <guest>
Aug 14 13:32:36 user nova-compute[73484]:     <os_type>hvm</os_type>
Aug 14 13:32:36 user nova-compute[73484]:     <arch name='ppc64'>
Aug 14 13:32:36 user nova-compute[73484]:       <wordsize>64</wordsize>
Aug 14 13:32:36 user nova-compute[73484]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2048'>powernv9</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>taihu</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2048'>powernv10</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='32'>ppce500</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>40p</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>pegasos2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>bamboo</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>g3beige</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mac99</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>sam460ex</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>ref405ep</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2048'>powernv8</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <domain type='qemu'/>
Aug 14 13:32:36 user nova-compute[73484]:     </arch>
Aug 14 13:32:36 user nova-compute[73484]:     <features>
Aug 14 13:32:36 user nova-compute[73484]:       <cpuselection/>
Aug 14 13:32:36 user nova-compute[73484]:       <deviceboot/>
Aug 14 13:32:36 user nova-compute[73484]:       <disksnapshot default='on' toggle='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     </features>
Aug 14 13:32:36 user nova-compute[73484]:   </guest>
Aug 14 13:32:36 user nova-compute[73484]:   <guest>
Aug 14 13:32:36 user nova-compute[73484]:     <os_type>hvm</os_type>
Aug 14 13:32:36 user nova-compute[73484]:     <arch name='ppc64le'>
Aug 14 13:32:36 user nova-compute[73484]:       <wordsize>64</wordsize>
Aug 14 13:32:36 user nova-compute[73484]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2048'>powernv9</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>taihu</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2048'>powernv10</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='32'>ppce500</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>40p</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>pegasos2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>bamboo</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>g3beige</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>mac99</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>sam460ex</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>ref405ep</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2048'>powernv8</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <domain type='qemu'/>
Aug 14 13:32:36 user nova-compute[73484]:     </arch>
Aug 14 13:32:36 user nova-compute[73484]:     <features>
Aug 14 13:32:36 user nova-compute[73484]:       <cpuselection/>
Aug 14 13:32:36 user nova-compute[73484]:       <deviceboot/>
Aug 14 13:32:36 user nova-compute[73484]:       <disksnapshot default='on' toggle='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     </features>
Aug 14 13:32:36 user nova-compute[73484]:   </guest>
Aug 14 13:32:36 user nova-compute[73484]:   <guest>
Aug 14 13:32:36 user nova-compute[73484]:     <os_type>hvm</os_type>
Aug 14 13:32:36 user nova-compute[73484]:     <arch name='riscv32'>
Aug 14 13:32:36 user nova-compute[73484]:       <wordsize>32</wordsize>
Aug 14 13:32:36 user nova-compute[73484]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='8'>spike</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>opentitan</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='5'>sifive_u</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>sifive_e</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='8'>virt</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <domain type='qemu'/>
Aug 14 13:32:36 user nova-compute[73484]:     </arch>
Aug 14 13:32:36 user nova-compute[73484]:     <features>
Aug 14 13:32:36 user nova-compute[73484]:       <cpuselection/>
Aug 14 13:32:36 user nova-compute[73484]:       <deviceboot/>
Aug 14 13:32:36 user nova-compute[73484]:       <disksnapshot default='on' toggle='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     </features>
Aug 14 13:32:36 user nova-compute[73484]:   </guest>
Aug 14 13:32:36 user nova-compute[73484]:   <guest>
Aug 14 13:32:36 user nova-compute[73484]:     <os_type>hvm</os_type>
Aug 14 13:32:36 user nova-compute[73484]:     <arch name='riscv64'>
Aug 14 13:32:36 user nova-compute[73484]:       <wordsize>64</wordsize>
Aug 14 13:32:36 user nova-compute[73484]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='8'>spike</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='5'>sifive_u</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>shakti_c</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>sifive_e</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='8'>virt</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <domain type='qemu'/>
Aug 14 13:32:36 user nova-compute[73484]:     </arch>
Aug 14 13:32:36 user nova-compute[73484]:     <features>
Aug 14 13:32:36 user nova-compute[73484]:       <cpuselection/>
Aug 14 13:32:36 user nova-compute[73484]:       <deviceboot/>
Aug 14 13:32:36 user nova-compute[73484]:       <disksnapshot default='on' toggle='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     </features>
Aug 14 13:32:36 user nova-compute[73484]:   </guest>
Aug 14 13:32:36 user nova-compute[73484]:   <guest>
Aug 14 13:32:36 user nova-compute[73484]:     <os_type>hvm</os_type>
Aug 14 13:32:36 user nova-compute[73484]:     <arch name='s390x'>
Aug 14 13:32:36 user nova-compute[73484]:       <wordsize>64</wordsize>
Aug 14 13:32:36 user nova-compute[73484]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <domain type='qemu'/>
Aug 14 13:32:36 user nova-compute[73484]:     </arch>
Aug 14 13:32:36 user nova-compute[73484]:     <features>
Aug 14 13:32:36 user nova-compute[73484]:       <cpuselection/>
Aug 14 13:32:36 user nova-compute[73484]:       <deviceboot/>
Aug 14 13:32:36 user nova-compute[73484]:       <disksnapshot default='on' toggle='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     </features>
Aug 14 13:32:36 user nova-compute[73484]:   </guest>
Aug 14 13:32:36 user nova-compute[73484]:   <guest>
Aug 14 13:32:36 user nova-compute[73484]:     <os_type>hvm</os_type>
Aug 14 13:32:36 user nova-compute[73484]:     <arch name='sh4'>
Aug 14 13:32:36 user nova-compute[73484]:       <wordsize>32</wordsize>
Aug 14 13:32:36 user nova-compute[73484]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>shix</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>r2d</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <domain type='qemu'/>
Aug 14 13:32:36 user nova-compute[73484]:     </arch>
Aug 14 13:32:36 user nova-compute[73484]:     <features>
Aug 14 13:32:36 user nova-compute[73484]:       <cpuselection/>
Aug 14 13:32:36 user nova-compute[73484]:       <deviceboot/>
Aug 14 13:32:36 user nova-compute[73484]:       <disksnapshot default='on' toggle='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     </features>
Aug 14 13:32:36 user nova-compute[73484]:   </guest>
Aug 14 13:32:36 user nova-compute[73484]:   <guest>
Aug 14 13:32:36 user nova-compute[73484]:     <os_type>hvm</os_type>
Aug 14 13:32:36 user nova-compute[73484]:     <arch name='sh4eb'>
Aug 14 13:32:36 user nova-compute[73484]:       <wordsize>64</wordsize>
Aug 14 13:32:36 user nova-compute[73484]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>shix</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>r2d</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <domain type='qemu'/>
Aug 14 13:32:36 user nova-compute[73484]:     </arch>
Aug 14 13:32:36 user nova-compute[73484]:     <features>
Aug 14 13:32:36 user nova-compute[73484]:       <cpuselection/>
Aug 14 13:32:36 user nova-compute[73484]:       <deviceboot/>
Aug 14 13:32:36 user nova-compute[73484]:       <disksnapshot default='on' toggle='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     </features>
Aug 14 13:32:36 user nova-compute[73484]:   </guest>
Aug 14 13:32:36 user nova-compute[73484]:   <guest>
Aug 14 13:32:36 user nova-compute[73484]:     <os_type>hvm</os_type>
Aug 14 13:32:36 user nova-compute[73484]:     <arch name='sparc'>
Aug 14 13:32:36 user nova-compute[73484]:       <wordsize>32</wordsize>
Aug 14 13:32:36 user nova-compute[73484]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>SS-5</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>SS-20</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>LX</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>SS-4</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>SS-10</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>Voyager</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <domain type='qemu'/>
Aug 14 13:32:36 user nova-compute[73484]:     </arch>
Aug 14 13:32:36 user nova-compute[73484]:     <features>
Aug 14 13:32:36 user nova-compute[73484]:       <cpuselection/>
Aug 14 13:32:36 user nova-compute[73484]:       <deviceboot/>
Aug 14 13:32:36 user nova-compute[73484]:       <disksnapshot default='on' toggle='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     </features>
Aug 14 13:32:36 user nova-compute[73484]:   </guest>
Aug 14 13:32:36 user nova-compute[73484]:   <guest>
Aug 14 13:32:36 user nova-compute[73484]:     <os_type>hvm</os_type>
Aug 14 13:32:36 user nova-compute[73484]:     <arch name='sparc64'>
Aug 14 13:32:36 user nova-compute[73484]:       <wordsize>64</wordsize>
Aug 14 13:32:36 user nova-compute[73484]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>sun4u</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>niagara</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>sun4v</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <domain type='qemu'/>
Aug 14 13:32:36 user nova-compute[73484]:     </arch>
Aug 14 13:32:36 user nova-compute[73484]:     <features>
Aug 14 13:32:36 user nova-compute[73484]:       <cpuselection/>
Aug 14 13:32:36 user nova-compute[73484]:       <deviceboot/>
Aug 14 13:32:36 user nova-compute[73484]:       <disksnapshot default='on' toggle='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     </features>
Aug 14 13:32:36 user nova-compute[73484]:   </guest>
Aug 14 13:32:36 user nova-compute[73484]:   <guest>
Aug 14 13:32:36 user nova-compute[73484]:     <os_type>hvm</os_type>
Aug 14 13:32:36 user nova-compute[73484]:     <arch name='x86_64'>
Aug 14 13:32:36 user nova-compute[73484]:       <wordsize>64</wordsize>
Aug 14 13:32:36 user nova-compute[73484]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>x-remote</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='1'>isapc</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>microvm</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <domain type='qemu'/>
Aug 14 13:32:36 user nova-compute[73484]:       <domain type='kvm'/>
Aug 14 13:32:36 user nova-compute[73484]:     </arch>
Aug 14 13:32:36 user nova-compute[73484]:     <features>
Aug 14 13:32:36 user nova-compute[73484]:       <acpi default='on' toggle='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:       <apic default='on' toggle='no'/>
Aug 14 13:32:36 user nova-compute[73484]:       <cpuselection/>
Aug 14 13:32:36 user nova-compute[73484]:       <deviceboot/>
Aug 14 13:32:36 user nova-compute[73484]:       <disksnapshot default='on' toggle='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     </features>
Aug 14 13:32:36 user nova-compute[73484]:   </guest>
Aug 14 13:32:36 user nova-compute[73484]:   <guest>
Aug 14 13:32:36 user nova-compute[73484]:     <os_type>hvm</os_type>
Aug 14 13:32:36 user nova-compute[73484]:     <arch name='xtensa'>
Aug 14 13:32:36 user nova-compute[73484]:       <wordsize>32</wordsize>
Aug 14 13:32:36 user nova-compute[73484]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>sim</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='32'>kc705</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='32'>ml605</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='32'>virt</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='32'>lx200</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='32'>lx60</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <domain type='qemu'/>
Aug 14 13:32:36 user nova-compute[73484]:     </arch>
Aug 14 13:32:36 user nova-compute[73484]:     <features>
Aug 14 13:32:36 user nova-compute[73484]:       <cpuselection/>
Aug 14 13:32:36 user nova-compute[73484]:       <deviceboot/>
Aug 14 13:32:36 user nova-compute[73484]:       <disksnapshot default='on' toggle='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     </features>
Aug 14 13:32:36 user nova-compute[73484]:   </guest>
Aug 14 13:32:36 user nova-compute[73484]:   <guest>
Aug 14 13:32:36 user nova-compute[73484]:     <os_type>hvm</os_type>
Aug 14 13:32:36 user nova-compute[73484]:     <arch name='xtensaeb'>
Aug 14 13:32:36 user nova-compute[73484]:       <wordsize>32</wordsize>
Aug 14 13:32:36 user nova-compute[73484]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='4'>sim</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='32'>kc705</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='32'>ml605</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='32'>virt</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='32'>lx200</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='32'>lx60</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 14 13:32:36 user nova-compute[73484]:       <domain type='qemu'/>
Aug 14 13:32:36 user nova-compute[73484]:     </arch>
Aug 14 13:32:36 user nova-compute[73484]:     <features>
Aug 14 13:32:36 user nova-compute[73484]:       <cpuselection/>
Aug 14 13:32:36 user nova-compute[73484]:       <deviceboot/>
Aug 14 13:32:36 user nova-compute[73484]:       <disksnapshot default='on' toggle='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     </features>
Aug 14 13:32:36 user nova-compute[73484]:   </guest>
Aug 14 13:32:36 user nova-compute[73484]: </capabilities>
Aug 14 13:32:36 user nova-compute[73484]: 
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73484) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73484) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73484) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73484) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73484) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73484) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73484) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73484) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73484) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73484) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73484) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu', 'pc', 'ubuntu-q35'} {{(pid=73484) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 14 13:32:36 user nova-compute[73484]: <domainCapabilities>
Aug 14 13:32:36 user nova-compute[73484]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 13:32:36 user nova-compute[73484]:   <domain>kvm</domain>
Aug 14 13:32:36 user nova-compute[73484]:   <machine>pc-q35-6.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:   <arch>i686</arch>
Aug 14 13:32:36 user nova-compute[73484]:   <vcpu max='288'/>
Aug 14 13:32:36 user nova-compute[73484]:   <iothreads supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:   <os supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:     <enum name='firmware'/>
Aug 14 13:32:36 user nova-compute[73484]:     <loader supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='type'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>rom</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>pflash</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='readonly'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>yes</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>no</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='secure'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>no</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </loader>
Aug 14 13:32:36 user nova-compute[73484]:   </os>
Aug 14 13:32:36 user nova-compute[73484]:   <cpu>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='host-passthrough' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='hostPassthroughMigratable'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>off</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='maximum' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='maximumMigratable'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>on</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>off</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='host-model' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <vendor>Intel</vendor>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ss'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='vmx'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='pcid'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='hypervisor'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='arat'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='umip'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='md-clear'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='stibp'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ssbd'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ibpb'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ibrs'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='amd-stibp'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='disable' name='erms'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='disable' name='lm'/>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='custom' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>qemu64</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>qemu32</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>phenom</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>pentium3</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>pentium2</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>pentium</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>n270</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>kvm64</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>kvm32</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>coreduo</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>core2duo</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>athlon</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Westmere</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Snowridge</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Server</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Client</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>SandyBridge</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Penryn</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G5</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G4</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G3</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G2</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G1</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Nehalem</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>IvyBridge</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Icelake-Server</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC-Rome</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC-Milan</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Dhyana</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Cooperlake</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Conroe</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>486</model>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:   </cpu>
Aug 14 13:32:36 user nova-compute[73484]:   <memoryBacking supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:     <enum name='sourceType'>
Aug 14 13:32:36 user nova-compute[73484]:       <value>file</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>anonymous</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>memfd</value>
Aug 14 13:32:36 user nova-compute[73484]:     </enum>
Aug 14 13:32:36 user nova-compute[73484]:   </memoryBacking>
Aug 14 13:32:36 user nova-compute[73484]:   <devices>
Aug 14 13:32:36 user nova-compute[73484]:     <disk supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='diskDevice'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>disk</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>cdrom</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>floppy</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>lun</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='bus'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>fdc</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>scsi</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>usb</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>sata</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='model'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-non-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </disk>
Aug 14 13:32:36 user nova-compute[73484]:     <graphics supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='type'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>sdl</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>vnc</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>spice</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>egl-headless</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </graphics>
Aug 14 13:32:36 user nova-compute[73484]:     <video supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='modelType'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>vga</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>cirrus</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>vmvga</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>qxl</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>none</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>bochs</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>ramfb</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </video>
Aug 14 13:32:36 user nova-compute[73484]:     <hostdev supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='mode'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>subsystem</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='startupPolicy'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>default</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>mandatory</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>requisite</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>optional</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='subsysType'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>usb</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>pci</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>scsi</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='capsType'/>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='pciBackend'/>
Aug 14 13:32:36 user nova-compute[73484]:     </hostdev>
Aug 14 13:32:36 user nova-compute[73484]:     <rng supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='model'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-non-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='backendModel'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>random</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>egd</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>builtin</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </rng>
Aug 14 13:32:36 user nova-compute[73484]:     <filesystem supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='driverType'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>path</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>handle</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtiofs</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </filesystem>
Aug 14 13:32:36 user nova-compute[73484]:     <tpm supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='model'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>tpm-tis</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>tpm-crb</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='backendModel'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>passthrough</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>emulator</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </tpm>
Aug 14 13:32:36 user nova-compute[73484]:   </devices>
Aug 14 13:32:36 user nova-compute[73484]:   <features>
Aug 14 13:32:36 user nova-compute[73484]:     <gic supported='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     <vmcoreinfo supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <genid supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <backingStoreInput supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <backup supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <sev supported='no'/>
Aug 14 13:32:36 user nova-compute[73484]:   </features>
Aug 14 13:32:36 user nova-compute[73484]: </domainCapabilities>
Aug 14 13:32:36 user nova-compute[73484]:  {{(pid=73484) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 14 13:32:36 user nova-compute[73484]: <domainCapabilities>
Aug 14 13:32:36 user nova-compute[73484]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 13:32:36 user nova-compute[73484]:   <domain>kvm</domain>
Aug 14 13:32:36 user nova-compute[73484]:   <machine>pc-i440fx-jammy</machine>
Aug 14 13:32:36 user nova-compute[73484]:   <arch>i686</arch>
Aug 14 13:32:36 user nova-compute[73484]:   <vcpu max='255'/>
Aug 14 13:32:36 user nova-compute[73484]:   <iothreads supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:   <os supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:     <enum name='firmware'/>
Aug 14 13:32:36 user nova-compute[73484]:     <loader supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='type'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>rom</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>pflash</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='readonly'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>yes</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>no</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='secure'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>no</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </loader>
Aug 14 13:32:36 user nova-compute[73484]:   </os>
Aug 14 13:32:36 user nova-compute[73484]:   <cpu>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='host-passthrough' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='hostPassthroughMigratable'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>off</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='maximum' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='maximumMigratable'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>on</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>off</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='host-model' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <vendor>Intel</vendor>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ss'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='vmx'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='pcid'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='hypervisor'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='arat'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='umip'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='md-clear'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='stibp'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ssbd'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ibpb'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ibrs'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='amd-stibp'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='disable' name='erms'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='disable' name='lm'/>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='custom' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>qemu64</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>qemu32</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>phenom</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>pentium3</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>pentium2</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>pentium</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>n270</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>kvm64</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>kvm32</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>coreduo</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>core2duo</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>athlon</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Westmere</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Snowridge</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Server</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Client</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>SandyBridge</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Penryn</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G5</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G4</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G3</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G2</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G1</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Nehalem</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>IvyBridge</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Icelake-Server</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC-Rome</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC-Milan</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Dhyana</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Cooperlake</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Conroe</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>486</model>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:   </cpu>
Aug 14 13:32:36 user nova-compute[73484]:   <memoryBacking supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:     <enum name='sourceType'>
Aug 14 13:32:36 user nova-compute[73484]:       <value>file</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>anonymous</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>memfd</value>
Aug 14 13:32:36 user nova-compute[73484]:     </enum>
Aug 14 13:32:36 user nova-compute[73484]:   </memoryBacking>
Aug 14 13:32:36 user nova-compute[73484]:   <devices>
Aug 14 13:32:36 user nova-compute[73484]:     <disk supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='diskDevice'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>disk</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>cdrom</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>floppy</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>lun</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='bus'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>ide</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>fdc</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>scsi</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>usb</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>sata</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='model'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-non-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </disk>
Aug 14 13:32:36 user nova-compute[73484]:     <graphics supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='type'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>sdl</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>vnc</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>spice</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>egl-headless</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </graphics>
Aug 14 13:32:36 user nova-compute[73484]:     <video supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='modelType'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>vga</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>cirrus</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>vmvga</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>qxl</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>none</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>bochs</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>ramfb</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </video>
Aug 14 13:32:36 user nova-compute[73484]:     <hostdev supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='mode'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>subsystem</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='startupPolicy'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>default</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>mandatory</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>requisite</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>optional</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='subsysType'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>usb</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>pci</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>scsi</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='capsType'/>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='pciBackend'/>
Aug 14 13:32:36 user nova-compute[73484]:     </hostdev>
Aug 14 13:32:36 user nova-compute[73484]:     <rng supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='model'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-non-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='backendModel'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>random</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>egd</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>builtin</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </rng>
Aug 14 13:32:36 user nova-compute[73484]:     <filesystem supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='driverType'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>path</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>handle</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtiofs</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </filesystem>
Aug 14 13:32:36 user nova-compute[73484]:     <tpm supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='model'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>tpm-tis</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>tpm-crb</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='backendModel'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>passthrough</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>emulator</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </tpm>
Aug 14 13:32:36 user nova-compute[73484]:   </devices>
Aug 14 13:32:36 user nova-compute[73484]:   <features>
Aug 14 13:32:36 user nova-compute[73484]:     <gic supported='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     <vmcoreinfo supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <genid supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <backingStoreInput supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <backup supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <sev supported='no'/>
Aug 14 13:32:36 user nova-compute[73484]:   </features>
Aug 14 13:32:36 user nova-compute[73484]: </domainCapabilities>
Aug 14 13:32:36 user nova-compute[73484]:  {{(pid=73484) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 14 13:32:36 user nova-compute[73484]: <domainCapabilities>
Aug 14 13:32:36 user nova-compute[73484]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 13:32:36 user nova-compute[73484]:   <domain>kvm</domain>
Aug 14 13:32:36 user nova-compute[73484]:   <machine>pc-i440fx-6.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:   <arch>i686</arch>
Aug 14 13:32:36 user nova-compute[73484]:   <vcpu max='255'/>
Aug 14 13:32:36 user nova-compute[73484]:   <iothreads supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:   <os supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:     <enum name='firmware'/>
Aug 14 13:32:36 user nova-compute[73484]:     <loader supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='type'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>rom</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>pflash</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='readonly'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>yes</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>no</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='secure'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>no</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </loader>
Aug 14 13:32:36 user nova-compute[73484]:   </os>
Aug 14 13:32:36 user nova-compute[73484]:   <cpu>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='host-passthrough' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='hostPassthroughMigratable'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>off</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='maximum' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='maximumMigratable'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>on</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>off</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='host-model' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <vendor>Intel</vendor>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ss'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='vmx'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='pcid'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='hypervisor'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='arat'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='umip'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='md-clear'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='stibp'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ssbd'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ibpb'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ibrs'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='amd-stibp'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='disable' name='erms'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='disable' name='lm'/>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='custom' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>qemu64</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>qemu32</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>phenom</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>pentium3</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>pentium2</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>pentium</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>n270</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>kvm64</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>kvm32</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>coreduo</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>core2duo</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>athlon</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Westmere</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Snowridge</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Server</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Client</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>SandyBridge</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Penryn</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G5</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G4</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G3</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G2</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G1</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Nehalem</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>IvyBridge</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Icelake-Server</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC-Rome</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC-Milan</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Dhyana</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Cooperlake</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Conroe</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>486</model>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:   </cpu>
Aug 14 13:32:36 user nova-compute[73484]:   <memoryBacking supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:     <enum name='sourceType'>
Aug 14 13:32:36 user nova-compute[73484]:       <value>file</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>anonymous</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>memfd</value>
Aug 14 13:32:36 user nova-compute[73484]:     </enum>
Aug 14 13:32:36 user nova-compute[73484]:   </memoryBacking>
Aug 14 13:32:36 user nova-compute[73484]:   <devices>
Aug 14 13:32:36 user nova-compute[73484]:     <disk supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='diskDevice'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>disk</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>cdrom</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>floppy</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>lun</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='bus'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>ide</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>fdc</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>scsi</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>usb</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>sata</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='model'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-non-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </disk>
Aug 14 13:32:36 user nova-compute[73484]:     <graphics supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='type'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>sdl</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>vnc</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>spice</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>egl-headless</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </graphics>
Aug 14 13:32:36 user nova-compute[73484]:     <video supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='modelType'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>vga</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>cirrus</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>vmvga</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>qxl</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>none</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>bochs</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>ramfb</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </video>
Aug 14 13:32:36 user nova-compute[73484]:     <hostdev supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='mode'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>subsystem</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='startupPolicy'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>default</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>mandatory</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>requisite</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>optional</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='subsysType'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>usb</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>pci</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>scsi</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='capsType'/>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='pciBackend'/>
Aug 14 13:32:36 user nova-compute[73484]:     </hostdev>
Aug 14 13:32:36 user nova-compute[73484]:     <rng supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='model'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-non-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='backendModel'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>random</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>egd</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>builtin</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </rng>
Aug 14 13:32:36 user nova-compute[73484]:     <filesystem supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='driverType'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>path</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>handle</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtiofs</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </filesystem>
Aug 14 13:32:36 user nova-compute[73484]:     <tpm supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='model'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>tpm-tis</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>tpm-crb</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='backendModel'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>passthrough</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>emulator</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </tpm>
Aug 14 13:32:36 user nova-compute[73484]:   </devices>
Aug 14 13:32:36 user nova-compute[73484]:   <features>
Aug 14 13:32:36 user nova-compute[73484]:     <gic supported='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     <vmcoreinfo supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <genid supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <backingStoreInput supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <backup supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <sev supported='no'/>
Aug 14 13:32:36 user nova-compute[73484]:   </features>
Aug 14 13:32:36 user nova-compute[73484]: </domainCapabilities>
Aug 14 13:32:36 user nova-compute[73484]:  {{(pid=73484) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 14 13:32:36 user nova-compute[73484]: <domainCapabilities>
Aug 14 13:32:36 user nova-compute[73484]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 13:32:36 user nova-compute[73484]:   <domain>kvm</domain>
Aug 14 13:32:36 user nova-compute[73484]:   <machine>pc-q35-jammy</machine>
Aug 14 13:32:36 user nova-compute[73484]:   <arch>i686</arch>
Aug 14 13:32:36 user nova-compute[73484]:   <vcpu max='288'/>
Aug 14 13:32:36 user nova-compute[73484]:   <iothreads supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:   <os supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:     <enum name='firmware'/>
Aug 14 13:32:36 user nova-compute[73484]:     <loader supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='type'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>rom</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>pflash</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='readonly'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>yes</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>no</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='secure'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>no</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </loader>
Aug 14 13:32:36 user nova-compute[73484]:   </os>
Aug 14 13:32:36 user nova-compute[73484]:   <cpu>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='host-passthrough' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='hostPassthroughMigratable'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>off</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='maximum' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='maximumMigratable'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>on</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>off</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='host-model' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <vendor>Intel</vendor>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ss'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='vmx'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='pcid'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='hypervisor'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='arat'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='umip'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='md-clear'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='stibp'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ssbd'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ibpb'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ibrs'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='amd-stibp'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='disable' name='erms'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='disable' name='lm'/>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='custom' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>qemu64</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>qemu32</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>phenom</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>pentium3</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>pentium2</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>pentium</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>n270</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>kvm64</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>kvm32</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>coreduo</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>core2duo</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>athlon</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Westmere</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Snowridge</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Server</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Client</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>SandyBridge</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Penryn</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G5</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G4</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G3</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G2</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G1</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Nehalem</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>IvyBridge</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Icelake-Server</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC-Rome</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC-Milan</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Dhyana</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Cooperlake</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Conroe</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>486</model>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:   </cpu>
Aug 14 13:32:36 user nova-compute[73484]:   <memoryBacking supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:     <enum name='sourceType'>
Aug 14 13:32:36 user nova-compute[73484]:       <value>file</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>anonymous</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>memfd</value>
Aug 14 13:32:36 user nova-compute[73484]:     </enum>
Aug 14 13:32:36 user nova-compute[73484]:   </memoryBacking>
Aug 14 13:32:36 user nova-compute[73484]:   <devices>
Aug 14 13:32:36 user nova-compute[73484]:     <disk supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='diskDevice'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>disk</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>cdrom</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>floppy</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>lun</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='bus'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>fdc</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>scsi</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>usb</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>sata</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='model'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-non-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </disk>
Aug 14 13:32:36 user nova-compute[73484]:     <graphics supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='type'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>sdl</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>vnc</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>spice</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>egl-headless</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </graphics>
Aug 14 13:32:36 user nova-compute[73484]:     <video supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='modelType'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>vga</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>cirrus</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>vmvga</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>qxl</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>none</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>bochs</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>ramfb</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </video>
Aug 14 13:32:36 user nova-compute[73484]:     <hostdev supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='mode'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>subsystem</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='startupPolicy'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>default</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>mandatory</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>requisite</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>optional</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='subsysType'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>usb</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>pci</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>scsi</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='capsType'/>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='pciBackend'/>
Aug 14 13:32:36 user nova-compute[73484]:     </hostdev>
Aug 14 13:32:36 user nova-compute[73484]:     <rng supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='model'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-non-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='backendModel'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>random</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>egd</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>builtin</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </rng>
Aug 14 13:32:36 user nova-compute[73484]:     <filesystem supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='driverType'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>path</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>handle</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtiofs</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </filesystem>
Aug 14 13:32:36 user nova-compute[73484]:     <tpm supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='model'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>tpm-tis</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>tpm-crb</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='backendModel'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>passthrough</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>emulator</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </tpm>
Aug 14 13:32:36 user nova-compute[73484]:   </devices>
Aug 14 13:32:36 user nova-compute[73484]:   <features>
Aug 14 13:32:36 user nova-compute[73484]:     <gic supported='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     <vmcoreinfo supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <genid supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <backingStoreInput supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <backup supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <sev supported='no'/>
Aug 14 13:32:36 user nova-compute[73484]:   </features>
Aug 14 13:32:36 user nova-compute[73484]: </domainCapabilities>
Aug 14 13:32:36 user nova-compute[73484]:  {{(pid=73484) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73484) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73484) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73484) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73484) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73484) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73484) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73484) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73484) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73484) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73484) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73484) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73484) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73484) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73484) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73484) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73484) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73484) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=73484) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73484) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73484) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73484) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=73484) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73484) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73484) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73484) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73484) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73484) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73484) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73484) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73484) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73484) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73484) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73484) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73484) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73484) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73484) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73484) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73484) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu', 'pc', 'ubuntu-q35'} {{(pid=73484) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 14 13:32:36 user nova-compute[73484]: <domainCapabilities>
Aug 14 13:32:36 user nova-compute[73484]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 13:32:36 user nova-compute[73484]:   <domain>kvm</domain>
Aug 14 13:32:36 user nova-compute[73484]:   <machine>pc-q35-6.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:   <arch>x86_64</arch>
Aug 14 13:32:36 user nova-compute[73484]:   <vcpu max='288'/>
Aug 14 13:32:36 user nova-compute[73484]:   <iothreads supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:   <os supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:     <enum name='firmware'>
Aug 14 13:32:36 user nova-compute[73484]:       <value>efi</value>
Aug 14 13:32:36 user nova-compute[73484]:     </enum>
Aug 14 13:32:36 user nova-compute[73484]:     <loader supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='type'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>rom</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>pflash</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='readonly'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>yes</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>no</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='secure'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>yes</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>no</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </loader>
Aug 14 13:32:36 user nova-compute[73484]:   </os>
Aug 14 13:32:36 user nova-compute[73484]:   <cpu>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='host-passthrough' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='hostPassthroughMigratable'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>on</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>off</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='maximum' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='maximumMigratable'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>on</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>off</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='host-model' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <vendor>Intel</vendor>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ss'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='vmx'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='pcid'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='hypervisor'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='arat'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='umip'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='md-clear'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='stibp'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ssbd'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='invtsc'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ibpb'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ibrs'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='amd-stibp'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='rsba'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='disable' name='erms'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='custom' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>qemu64</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>qemu32</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>phenom</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>pentium3</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>pentium2</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>pentium</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>n270</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>kvm64</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>kvm32</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>coreduo</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>core2duo</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>athlon</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>Westmere</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Snowridge</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Server</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Client</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>SandyBridge</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>Penryn</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G5</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G4</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G3</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G2</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>Opteron_G1</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>Nehalem</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>IvyBridge</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Icelake-Server</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC-Rome</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC-Milan</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Dhyana</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Cooperlake</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>Conroe</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>486</model>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:   </cpu>
Aug 14 13:32:36 user nova-compute[73484]:   <memoryBacking supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:     <enum name='sourceType'>
Aug 14 13:32:36 user nova-compute[73484]:       <value>file</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>anonymous</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>memfd</value>
Aug 14 13:32:36 user nova-compute[73484]:     </enum>
Aug 14 13:32:36 user nova-compute[73484]:   </memoryBacking>
Aug 14 13:32:36 user nova-compute[73484]:   <devices>
Aug 14 13:32:36 user nova-compute[73484]:     <disk supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='diskDevice'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>disk</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>cdrom</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>floppy</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>lun</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='bus'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>fdc</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>scsi</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>usb</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>sata</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='model'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-non-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </disk>
Aug 14 13:32:36 user nova-compute[73484]:     <graphics supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='type'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>sdl</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>vnc</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>spice</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>egl-headless</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </graphics>
Aug 14 13:32:36 user nova-compute[73484]:     <video supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='modelType'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>vga</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>cirrus</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>vmvga</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>qxl</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>none</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>bochs</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>ramfb</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </video>
Aug 14 13:32:36 user nova-compute[73484]:     <hostdev supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='mode'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>subsystem</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='startupPolicy'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>default</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>mandatory</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>requisite</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>optional</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='subsysType'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>usb</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>pci</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>scsi</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='capsType'/>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='pciBackend'/>
Aug 14 13:32:36 user nova-compute[73484]:     </hostdev>
Aug 14 13:32:36 user nova-compute[73484]:     <rng supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='model'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-non-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='backendModel'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>random</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>egd</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>builtin</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </rng>
Aug 14 13:32:36 user nova-compute[73484]:     <filesystem supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='driverType'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>path</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>handle</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtiofs</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </filesystem>
Aug 14 13:32:36 user nova-compute[73484]:     <tpm supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='model'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>tpm-tis</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>tpm-crb</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='backendModel'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>passthrough</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>emulator</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </tpm>
Aug 14 13:32:36 user nova-compute[73484]:   </devices>
Aug 14 13:32:36 user nova-compute[73484]:   <features>
Aug 14 13:32:36 user nova-compute[73484]:     <gic supported='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     <vmcoreinfo supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <genid supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <backingStoreInput supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <backup supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <sev supported='no'/>
Aug 14 13:32:36 user nova-compute[73484]:   </features>
Aug 14 13:32:36 user nova-compute[73484]: </domainCapabilities>
Aug 14 13:32:36 user nova-compute[73484]:  {{(pid=73484) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 14 13:32:36 user nova-compute[73484]: <domainCapabilities>
Aug 14 13:32:36 user nova-compute[73484]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 13:32:36 user nova-compute[73484]:   <domain>kvm</domain>
Aug 14 13:32:36 user nova-compute[73484]:   <machine>pc-i440fx-jammy</machine>
Aug 14 13:32:36 user nova-compute[73484]:   <arch>x86_64</arch>
Aug 14 13:32:36 user nova-compute[73484]:   <vcpu max='255'/>
Aug 14 13:32:36 user nova-compute[73484]:   <iothreads supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:   <os supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:     <enum name='firmware'>
Aug 14 13:32:36 user nova-compute[73484]:       <value>efi</value>
Aug 14 13:32:36 user nova-compute[73484]:     </enum>
Aug 14 13:32:36 user nova-compute[73484]:     <loader supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='type'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>rom</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>pflash</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='readonly'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>yes</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>no</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='secure'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>no</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </loader>
Aug 14 13:32:36 user nova-compute[73484]:   </os>
Aug 14 13:32:36 user nova-compute[73484]:   <cpu>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='host-passthrough' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='hostPassthroughMigratable'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>on</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>off</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='maximum' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='maximumMigratable'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>on</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>off</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='host-model' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <vendor>Intel</vendor>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ss'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='vmx'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='pcid'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='hypervisor'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='arat'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='umip'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='md-clear'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='stibp'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ssbd'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='invtsc'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ibpb'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ibrs'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='amd-stibp'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='rsba'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='disable' name='erms'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='custom' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>qemu64</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>qemu32</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>phenom</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>pentium3</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>pentium2</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>pentium</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>n270</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>kvm64</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>kvm32</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>coreduo</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>core2duo</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>athlon</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>Westmere</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Snowridge</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Server</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Client</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>SandyBridge</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>Penryn</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G5</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G4</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G3</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G2</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>Opteron_G1</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>Nehalem</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>IvyBridge</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Icelake-Server</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC-Rome</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC-Milan</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Dhyana</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Cooperlake</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>Conroe</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>486</model>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:   </cpu>
Aug 14 13:32:36 user nova-compute[73484]:   <memoryBacking supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:     <enum name='sourceType'>
Aug 14 13:32:36 user nova-compute[73484]:       <value>file</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>anonymous</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>memfd</value>
Aug 14 13:32:36 user nova-compute[73484]:     </enum>
Aug 14 13:32:36 user nova-compute[73484]:   </memoryBacking>
Aug 14 13:32:36 user nova-compute[73484]:   <devices>
Aug 14 13:32:36 user nova-compute[73484]:     <disk supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='diskDevice'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>disk</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>cdrom</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>floppy</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>lun</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='bus'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>ide</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>fdc</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>scsi</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>usb</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>sata</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='model'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-non-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </disk>
Aug 14 13:32:36 user nova-compute[73484]:     <graphics supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='type'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>sdl</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>vnc</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>spice</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>egl-headless</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </graphics>
Aug 14 13:32:36 user nova-compute[73484]:     <video supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='modelType'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>vga</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>cirrus</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>vmvga</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>qxl</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>none</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>bochs</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>ramfb</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </video>
Aug 14 13:32:36 user nova-compute[73484]:     <hostdev supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='mode'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>subsystem</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='startupPolicy'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>default</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>mandatory</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>requisite</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>optional</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='subsysType'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>usb</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>pci</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>scsi</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='capsType'/>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='pciBackend'/>
Aug 14 13:32:36 user nova-compute[73484]:     </hostdev>
Aug 14 13:32:36 user nova-compute[73484]:     <rng supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='model'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-non-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='backendModel'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>random</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>egd</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>builtin</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </rng>
Aug 14 13:32:36 user nova-compute[73484]:     <filesystem supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='driverType'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>path</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>handle</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtiofs</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </filesystem>
Aug 14 13:32:36 user nova-compute[73484]:     <tpm supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='model'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>tpm-tis</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>tpm-crb</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='backendModel'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>passthrough</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>emulator</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </tpm>
Aug 14 13:32:36 user nova-compute[73484]:   </devices>
Aug 14 13:32:36 user nova-compute[73484]:   <features>
Aug 14 13:32:36 user nova-compute[73484]:     <gic supported='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     <vmcoreinfo supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <genid supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <backingStoreInput supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <backup supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <sev supported='no'/>
Aug 14 13:32:36 user nova-compute[73484]:   </features>
Aug 14 13:32:36 user nova-compute[73484]: </domainCapabilities>
Aug 14 13:32:36 user nova-compute[73484]:  {{(pid=73484) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 14 13:32:36 user nova-compute[73484]: <domainCapabilities>
Aug 14 13:32:36 user nova-compute[73484]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 13:32:36 user nova-compute[73484]:   <domain>kvm</domain>
Aug 14 13:32:36 user nova-compute[73484]:   <machine>pc-i440fx-6.2</machine>
Aug 14 13:32:36 user nova-compute[73484]:   <arch>x86_64</arch>
Aug 14 13:32:36 user nova-compute[73484]:   <vcpu max='255'/>
Aug 14 13:32:36 user nova-compute[73484]:   <iothreads supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:   <os supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:     <enum name='firmware'>
Aug 14 13:32:36 user nova-compute[73484]:       <value>efi</value>
Aug 14 13:32:36 user nova-compute[73484]:     </enum>
Aug 14 13:32:36 user nova-compute[73484]:     <loader supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='type'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>rom</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>pflash</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='readonly'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>yes</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>no</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='secure'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>no</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </loader>
Aug 14 13:32:36 user nova-compute[73484]:   </os>
Aug 14 13:32:36 user nova-compute[73484]:   <cpu>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='host-passthrough' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='hostPassthroughMigratable'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>on</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>off</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='maximum' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='maximumMigratable'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>on</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>off</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='host-model' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <vendor>Intel</vendor>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ss'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='vmx'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='pcid'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='hypervisor'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='arat'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='umip'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='md-clear'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='stibp'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ssbd'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='invtsc'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ibpb'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ibrs'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='amd-stibp'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='rsba'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='disable' name='erms'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='custom' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>qemu64</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>qemu32</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>phenom</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>pentium3</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>pentium2</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>pentium</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>n270</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>kvm64</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>kvm32</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>coreduo</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>core2duo</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>athlon</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>Westmere</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Snowridge</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Server</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Client</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>SandyBridge</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>Penryn</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G5</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G4</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G3</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G2</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>Opteron_G1</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>Nehalem</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>IvyBridge</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Icelake-Server</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC-Rome</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC-Milan</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Dhyana</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Cooperlake</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>Conroe</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>486</model>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:   </cpu>
Aug 14 13:32:36 user nova-compute[73484]:   <memoryBacking supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:     <enum name='sourceType'>
Aug 14 13:32:36 user nova-compute[73484]:       <value>file</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>anonymous</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>memfd</value>
Aug 14 13:32:36 user nova-compute[73484]:     </enum>
Aug 14 13:32:36 user nova-compute[73484]:   </memoryBacking>
Aug 14 13:32:36 user nova-compute[73484]:   <devices>
Aug 14 13:32:36 user nova-compute[73484]:     <disk supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='diskDevice'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>disk</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>cdrom</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>floppy</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>lun</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='bus'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>ide</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>fdc</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>scsi</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>usb</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>sata</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='model'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-non-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </disk>
Aug 14 13:32:36 user nova-compute[73484]:     <graphics supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='type'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>sdl</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>vnc</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>spice</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>egl-headless</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </graphics>
Aug 14 13:32:36 user nova-compute[73484]:     <video supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='modelType'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>vga</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>cirrus</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>vmvga</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>qxl</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>none</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>bochs</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>ramfb</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </video>
Aug 14 13:32:36 user nova-compute[73484]:     <hostdev supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='mode'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>subsystem</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='startupPolicy'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>default</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>mandatory</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>requisite</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>optional</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='subsysType'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>usb</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>pci</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>scsi</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='capsType'/>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='pciBackend'/>
Aug 14 13:32:36 user nova-compute[73484]:     </hostdev>
Aug 14 13:32:36 user nova-compute[73484]:     <rng supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='model'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-non-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='backendModel'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>random</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>egd</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>builtin</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </rng>
Aug 14 13:32:36 user nova-compute[73484]:     <filesystem supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='driverType'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>path</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>handle</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtiofs</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </filesystem>
Aug 14 13:32:36 user nova-compute[73484]:     <tpm supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='model'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>tpm-tis</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>tpm-crb</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='backendModel'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>passthrough</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>emulator</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </tpm>
Aug 14 13:32:36 user nova-compute[73484]:   </devices>
Aug 14 13:32:36 user nova-compute[73484]:   <features>
Aug 14 13:32:36 user nova-compute[73484]:     <gic supported='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     <vmcoreinfo supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <genid supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <backingStoreInput supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <backup supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <sev supported='no'/>
Aug 14 13:32:36 user nova-compute[73484]:   </features>
Aug 14 13:32:36 user nova-compute[73484]: </domainCapabilities>
Aug 14 13:32:36 user nova-compute[73484]:  {{(pid=73484) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 14 13:32:36 user nova-compute[73484]: <domainCapabilities>
Aug 14 13:32:36 user nova-compute[73484]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 13:32:36 user nova-compute[73484]:   <domain>kvm</domain>
Aug 14 13:32:36 user nova-compute[73484]:   <machine>pc-q35-jammy</machine>
Aug 14 13:32:36 user nova-compute[73484]:   <arch>x86_64</arch>
Aug 14 13:32:36 user nova-compute[73484]:   <vcpu max='288'/>
Aug 14 13:32:36 user nova-compute[73484]:   <iothreads supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:   <os supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:     <enum name='firmware'>
Aug 14 13:32:36 user nova-compute[73484]:       <value>efi</value>
Aug 14 13:32:36 user nova-compute[73484]:     </enum>
Aug 14 13:32:36 user nova-compute[73484]:     <loader supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='type'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>rom</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>pflash</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='readonly'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>yes</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>no</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='secure'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>yes</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>no</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </loader>
Aug 14 13:32:36 user nova-compute[73484]:   </os>
Aug 14 13:32:36 user nova-compute[73484]:   <cpu>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='host-passthrough' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='hostPassthroughMigratable'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>on</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>off</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='maximum' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='maximumMigratable'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>on</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>off</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='host-model' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <vendor>Intel</vendor>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ss'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='vmx'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='pcid'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='hypervisor'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='arat'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='umip'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='md-clear'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='stibp'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ssbd'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='invtsc'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ibpb'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='ibrs'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='amd-stibp'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='rsba'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='disable' name='erms'/>
Aug 14 13:32:36 user nova-compute[73484]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:     <mode name='custom' supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>qemu64</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>qemu32</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>phenom</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>pentium3</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>pentium2</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>pentium</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>n270</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>kvm64</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>kvm32</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>coreduo</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>core2duo</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>athlon</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>Westmere</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Snowridge</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Server</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Skylake-Client</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>SandyBridge</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>Penryn</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G5</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G4</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G3</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Opteron_G2</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>Opteron_G1</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>Nehalem</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>IvyBridge</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Icelake-Server</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Haswell</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC-Rome</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC-Milan</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>EPYC</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Dhyana</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Cooperlake</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>Conroe</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='no'>Broadwell</model>
Aug 14 13:32:36 user nova-compute[73484]:       <model usable='yes'>486</model>
Aug 14 13:32:36 user nova-compute[73484]:     </mode>
Aug 14 13:32:36 user nova-compute[73484]:   </cpu>
Aug 14 13:32:36 user nova-compute[73484]:   <memoryBacking supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:     <enum name='sourceType'>
Aug 14 13:32:36 user nova-compute[73484]:       <value>file</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>anonymous</value>
Aug 14 13:32:36 user nova-compute[73484]:       <value>memfd</value>
Aug 14 13:32:36 user nova-compute[73484]:     </enum>
Aug 14 13:32:36 user nova-compute[73484]:   </memoryBacking>
Aug 14 13:32:36 user nova-compute[73484]:   <devices>
Aug 14 13:32:36 user nova-compute[73484]:     <disk supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='diskDevice'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>disk</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>cdrom</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>floppy</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>lun</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='bus'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>fdc</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>scsi</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>usb</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>sata</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='model'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-non-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </disk>
Aug 14 13:32:36 user nova-compute[73484]:     <graphics supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='type'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>sdl</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>vnc</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>spice</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>egl-headless</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </graphics>
Aug 14 13:32:36 user nova-compute[73484]:     <video supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='modelType'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>vga</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>cirrus</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>vmvga</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>qxl</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>none</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>bochs</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>ramfb</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </video>
Aug 14 13:32:36 user nova-compute[73484]:     <hostdev supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='mode'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>subsystem</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='startupPolicy'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>default</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>mandatory</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>requisite</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>optional</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='subsysType'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>usb</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>pci</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>scsi</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='capsType'/>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='pciBackend'/>
Aug 14 13:32:36 user nova-compute[73484]:     </hostdev>
Aug 14 13:32:36 user nova-compute[73484]:     <rng supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='model'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtio-non-transitional</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='backendModel'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>random</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>egd</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>builtin</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </rng>
Aug 14 13:32:36 user nova-compute[73484]:     <filesystem supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='driverType'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>path</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>handle</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>virtiofs</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </filesystem>
Aug 14 13:32:36 user nova-compute[73484]:     <tpm supported='yes'>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='model'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>tpm-tis</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>tpm-crb</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:       <enum name='backendModel'>
Aug 14 13:32:36 user nova-compute[73484]:         <value>passthrough</value>
Aug 14 13:32:36 user nova-compute[73484]:         <value>emulator</value>
Aug 14 13:32:36 user nova-compute[73484]:       </enum>
Aug 14 13:32:36 user nova-compute[73484]:     </tpm>
Aug 14 13:32:36 user nova-compute[73484]:   </devices>
Aug 14 13:32:36 user nova-compute[73484]:   <features>
Aug 14 13:32:36 user nova-compute[73484]:     <gic supported='no'/>
Aug 14 13:32:36 user nova-compute[73484]:     <vmcoreinfo supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <genid supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <backingStoreInput supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <backup supported='yes'/>
Aug 14 13:32:36 user nova-compute[73484]:     <sev supported='no'/>
Aug 14 13:32:36 user nova-compute[73484]:   </features>
Aug 14 13:32:36 user nova-compute[73484]: </domainCapabilities>
Aug 14 13:32:36 user nova-compute[73484]:  {{(pid=73484) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73484) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73484) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73484) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73484) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Checking secure boot support for host arch (x86_64) {{(pid=73484) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 14 13:32:36 user nova-compute[73484]: INFO nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Secure Boot support detected
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] cpu compare xml: <cpu match="exact">
Aug 14 13:32:36 user nova-compute[73484]:   <model>Nehalem</model>
Aug 14 13:32:36 user nova-compute[73484]: </cpu>
Aug 14 13:32:36 user nova-compute[73484]:  {{(pid=73484) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 14 13:32:36 user nova-compute[73484]: INFO nova.virt.node [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Generated node identity 165d4635-93b4-49a6-879a-21c1324822ab
Aug 14 13:32:36 user nova-compute[73484]: INFO nova.virt.node [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Wrote node identity 165d4635-93b4-49a6-879a-21c1324822ab to /opt/stack/data/nova/compute_id
Aug 14 13:32:36 user nova-compute[73484]: WARNING nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Compute nodes ['165d4635-93b4-49a6-879a-21c1324822ab'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 14 13:32:36 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 14 13:32:36 user nova-compute[73484]: WARNING nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 14 13:32:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:32:36 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 13:32:37 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:32:37 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:32:37 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Hypervisor/Node resource view: name=user free_ram=10878MB free_disk=26.358963012695312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 13:32:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:32:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:32:37 user nova-compute[73484]: WARNING nova.compute.resource_tracker [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] No compute node record for user:165d4635-93b4-49a6-879a-21c1324822ab: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 165d4635-93b4-49a6-879a-21c1324822ab could not be found.
Aug 14 13:32:37 user nova-compute[73484]: INFO nova.compute.resource_tracker [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Compute node record created for user:user with uuid: 165d4635-93b4-49a6-879a-21c1324822ab
Aug 14 13:32:37 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 13:32:37 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 13:32:37 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [req-69343ddb-07e6-4ef3-ad0e-cabfb920ce7b] Created resource provider record via placement API for resource provider with UUID 165d4635-93b4-49a6-879a-21c1324822ab and name user.
Aug 14 13:32:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73484) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 14 13:32:37 user nova-compute[73484]: INFO nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] kernel doesn't support AMD SEV
Aug 14 13:32:37 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Updating inventory in ProviderTree for provider 165d4635-93b4-49a6-879a-21c1324822ab with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 13:32:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:32:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Libvirt baseline CPU <cpu>
Aug 14 13:32:37 user nova-compute[73484]:   <arch>x86_64</arch>
Aug 14 13:32:37 user nova-compute[73484]:   <model>Nehalem</model>
Aug 14 13:32:37 user nova-compute[73484]:   <vendor>Intel</vendor>
Aug 14 13:32:37 user nova-compute[73484]:   <topology sockets="6" cores="1" threads="1"/>
Aug 14 13:32:37 user nova-compute[73484]: </cpu>
Aug 14 13:32:37 user nova-compute[73484]:  {{(pid=73484) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 14 13:32:37 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Updated inventory for provider 165d4635-93b4-49a6-879a-21c1324822ab with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 14 13:32:37 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Updating resource provider 165d4635-93b4-49a6-879a-21c1324822ab generation from 0 to 1 during operation: update_inventory {{(pid=73484) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 14 13:32:37 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Updating inventory in ProviderTree for provider 165d4635-93b4-49a6-879a-21c1324822ab with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 13:32:37 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Updating resource provider 165d4635-93b4-49a6-879a-21c1324822ab generation from 1 to 2 during operation: update_traits {{(pid=73484) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 14 13:32:37 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 13:32:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.703s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:32:37 user nova-compute[73484]: DEBUG nova.service [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Creating RPC server for service compute {{(pid=73484) start /opt/stack/nova/nova/service.py:182}}
Aug 14 13:32:38 user nova-compute[73484]: DEBUG nova.service [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Join ServiceGroup membership for this service compute {{(pid=73484) start /opt/stack/nova/nova/service.py:199}}
Aug 14 13:32:38 user nova-compute[73484]: DEBUG nova.servicegroup.drivers.db [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73484) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 14 13:33:28 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:33:28 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:33:28 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:33:28 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:33:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 13:33:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Rebuilding the list of instances to heal {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 13:33:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Didn't find any instances for network info cache update. {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 13:33:28 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:33:28 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:33:28 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:33:28 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:33:28 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:33:28 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:33:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 13:33:28 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:33:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:33:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:33:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:33:28 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 13:33:29 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:33:29 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:33:29 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=10304MB free_disk=26.262821197509766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 13:33:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:33:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:33:29 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 13:33:29 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 13:33:29 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:33:29 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:33:29 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 13:33:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:34:29 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:34:29 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:34:29 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 13:34:29 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Rebuilding the list of instances to heal {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 13:34:29 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Didn't find any instances for network info cache update. {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 13:34:29 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:34:29 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:34:29 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:34:29 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:34:29 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:34:29 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 13:34:29 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:34:29 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:34:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:34:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:34:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:34:29 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 13:34:30 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:34:30 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:34:30 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=10244MB free_disk=26.313602447509766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 13:34:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:34:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:34:30 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 13:34:30 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 13:34:30 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:34:30 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:34:30 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 13:34:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:34:31 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:35:28 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:35:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 13:35:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Rebuilding the list of instances to heal {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 13:35:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Didn't find any instances for network info cache update. {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 13:35:28 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:35:29 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:35:29 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:35:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:35:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:35:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:35:29 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 13:35:30 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:35:30 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:35:30 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=10206MB free_disk=26.09524154663086GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 13:35:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:35:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:35:30 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 13:35:30 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 13:35:30 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:35:30 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:35:30 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 13:35:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.115s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:35:31 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:35:31 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:35:31 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:35:31 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:35:31 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 13:35:31 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:36:28 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:36:29 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:36:30 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:36:30 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:36:30 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 13:36:30 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Rebuilding the list of instances to heal {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 13:36:30 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Didn't find any instances for network info cache update. {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 13:36:30 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:36:30 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 13:36:30 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:36:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:36:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:36:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:36:30 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 13:36:31 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:36:31 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:36:31 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=9483MB free_disk=26.12482452392578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 13:36:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:36:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:36:31 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 13:36:31 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 13:36:31 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:36:31 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:36:31 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 13:36:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.114s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:36:32 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:36:32 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:36:32 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:36:33 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:36:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "f4f7788c-fcca-47c1-b5b8-72892253982d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:36:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "f4f7788c-fcca-47c1-b5b8-72892253982d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:36:46 user nova-compute[73484]: DEBUG nova.compute.manager [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:36:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:36:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:36:46 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:36:46 user nova-compute[73484]: INFO nova.compute.claims [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Claim successful on node user
Aug 14 13:36:47 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:36:47 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:36:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.307s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:36:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:36:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:36:47 user nova-compute[73484]: DEBUG nova.network.neutron [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:36:47 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:36:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:36:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:36:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:36:47 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Creating image(s)
Aug 14 13:36:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:36:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "/opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:36:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "/opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:36:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:36:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:36:48 user nova-compute[73484]: DEBUG nova.policy [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a0f55ad018d4c0ca587d8bdd40df4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c7f2c51c0f84bf1aedcf493a9ff860f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:36:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03.part --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:36:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03.part --force-share --output=json" returned: 0 in 0.183s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:36:49 user nova-compute[73484]: DEBUG nova.virt.images [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] 35547d66-318f-468f-9286-e10554f69bf8 was qcow2, converting to raw {{(pid=73484) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 13:36:49 user nova-compute[73484]: DEBUG nova.privsep.utils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73484) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 13:36:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03.part /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03.converted {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:36:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03.part /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03.converted" returned: 0 in 0.282s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:36:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03.converted --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:36:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03.converted --force-share --output=json" returned: 0 in 0.192s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:36:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.720s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:36:49 user nova-compute[73484]: INFO oslo.privsep.daemon [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp_fwumcbf/privsep.sock']
Aug 14 13:36:49 user sudo[82761]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp_fwumcbf/privsep.sock
Aug 14 13:36:49 user sudo[82761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 14 13:36:51 user sudo[82761]: pam_unix(sudo:session): session closed for user root
Aug 14 13:36:51 user nova-compute[73484]: INFO oslo.privsep.daemon [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Spawned new privsep daemon via rootwrap
Aug 14 13:36:51 user nova-compute[73484]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 14 13:36:51 user nova-compute[73484]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 14 13:36:51 user nova-compute[73484]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 14 13:36:51 user nova-compute[73484]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82764
Aug 14 13:36:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:36:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.162s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:36:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:36:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:36:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:36:51 user nova-compute[73484]: DEBUG nova.network.neutron [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Successfully created port: 5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:36:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.152s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:36:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:36:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk 1073741824" returned: 0 in 0.047s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:36:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:36:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:36:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.186s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:36:52 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:36:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:36:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:36:52 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Cannot resize image /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:36:52 user nova-compute[73484]: DEBUG nova.objects.instance [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lazy-loading 'migration_context' on Instance uuid f4f7788c-fcca-47c1-b5b8-72892253982d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:36:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:36:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Ensure instance console log exists: /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:36:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:36:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:36:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:36:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:36:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:36:55 user nova-compute[73484]: DEBUG nova.compute.manager [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:36:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:36:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:36:55 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:36:55 user nova-compute[73484]: INFO nova.compute.claims [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Claim successful on node user
Aug 14 13:36:55 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:36:55 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:36:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:36:55 user nova-compute[73484]: DEBUG nova.compute.manager [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG nova.compute.manager [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG nova.network.neutron [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:36:56 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:36:56 user nova-compute[73484]: DEBUG nova.compute.manager [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG nova.compute.manager [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:36:56 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Creating image(s)
Aug 14 13:36:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "/opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "/opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "07bac569-8b2c-4555-b4d5-a74f7384630b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "07bac569-8b2c-4555-b4d5-a74f7384630b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG nova.compute.manager [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG nova.network.neutron [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Successfully updated port: 5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Acquiring lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "refresh_cache-f4f7788c-fcca-47c1-b5b8-72892253982d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquired lock "refresh_cache-f4f7788c-fcca-47c1-b5b8-72892253982d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG nova.network.neutron [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG nova.compute.manager [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG nova.policy [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fac94bacad00447d9743d8a44118ea47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2114819cda450ca1827ddd5557da23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.225s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:36:56 user nova-compute[73484]: INFO nova.compute.claims [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Claim successful on node user
Aug 14 13:36:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.173s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk 1073741824" returned: 0 in 0.050s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG nova.network.neutron [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG nova.compute.manager [req-e9164e0f-a44e-4dbd-a0aa-322c535f3911 req-be1c7e2b-1675-426d-aaaa-fc95041fa561 service nova] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Received event network-changed-5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG nova.compute.manager [req-e9164e0f-a44e-4dbd-a0aa-322c535f3911 req-be1c7e2b-1675-426d-aaaa-fc95041fa561 service nova] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Refreshing instance network info cache due to event network-changed-5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:36:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e9164e0f-a44e-4dbd-a0aa-322c535f3911 req-be1c7e2b-1675-426d-aaaa-fc95041fa561 service nova] Acquiring lock "refresh_cache-f4f7788c-fcca-47c1-b5b8-72892253982d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.210s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.417s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:36:57 user nova-compute[73484]: INFO nova.compute.claims [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Claim successful on node user
Aug 14 13:36:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Cannot resize image /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG nova.objects.instance [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'migration_context' on Instance uuid 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG nova.network.neutron [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Ensure instance console log exists: /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:36:57 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:36:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:36:57 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Creating image(s)
Aug 14 13:36:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "/opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "/opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "/opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.349s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG nova.policy [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b22dfe5647e149a5b3a19d843f0efd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9e3bd3df8a408e96e9054775c3cb83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG nova.network.neutron [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:36:57 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:36:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.174s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:36:57 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Creating image(s)
Aug 14 13:36:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Acquiring lock "/opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "/opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "/opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.194s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:36:57 user nova-compute[73484]: DEBUG nova.policy [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c0b51afa7a147ce9a3047642651c6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1ea5214248845418e322d18d298c449', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk 1073741824" returned: 0 in 0.085s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.181s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.169s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.network.neutron [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Updating instance_info_cache with network_info: [{"id": "5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b", "address": "fa:16:3e:8b:e0:96", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc7ee1a-4f", "ovs_interfaceid": "5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.269s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Checking if we can resize image /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk 1073741824" returned: 0 in 0.084s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Releasing lock "refresh_cache-f4f7788c-fcca-47c1-b5b8-72892253982d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.compute.manager [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Instance network_info: |[{"id": "5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b", "address": "fa:16:3e:8b:e0:96", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc7ee1a-4f", "ovs_interfaceid": "5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e9164e0f-a44e-4dbd-a0aa-322c535f3911 req-be1c7e2b-1675-426d-aaaa-fc95041fa561 service nova] Acquired lock "refresh_cache-f4f7788c-fcca-47c1-b5b8-72892253982d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.network.neutron [req-e9164e0f-a44e-4dbd-a0aa-322c535f3911 req-be1c7e2b-1675-426d-aaaa-fc95041fa561 service nova] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Refreshing network info cache for port 5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Start _get_guest_xml network_info=[{"id": "5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b", "address": "fa:16:3e:8b:e0:96", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc7ee1a-4f", "ovs_interfaceid": "5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:36:58 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:36:58 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.privsep.utils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73484) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:36:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1818814659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1818814659',id=1,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c7f2c51c0f84bf1aedcf493a9ff860f',ramdisk_id='',reservation_id='r-ldchyjq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-830908511',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:36:48Z,user_data=None,user_id='5a0f55ad018d4c0ca587d8bdd40df4c8',uuid=f4f7788c-fcca-47c1-b5b8-72892253982d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b", "address": "fa:16:3e:8b:e0:96", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc7ee1a-4f", "ovs_interfaceid": "5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Converting VIF {"id": "5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b", "address": "fa:16:3e:8b:e0:96", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc7ee1a-4f", "ovs_interfaceid": "5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e0:96,bridge_name='br-int',has_traffic_filtering=True,id=5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b,network=Network(4ec437fc-4371-48d6-8026-b64423fbc0ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc7ee1a-4f') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.objects.instance [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lazy-loading 'pci_devices' on Instance uuid f4f7788c-fcca-47c1-b5b8-72892253982d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:36:58 user nova-compute[73484]:   <uuid>f4f7788c-fcca-47c1-b5b8-72892253982d</uuid>
Aug 14 13:36:58 user nova-compute[73484]:   <name>instance-00000001</name>
Aug 14 13:36:58 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:36:58 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:36:58 user nova-compute[73484]:   <metadata>
Aug 14 13:36:58 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:36:58 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:36:58 user nova-compute[73484]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1818814659</nova:name>
Aug 14 13:36:58 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:36:58</nova:creationTime>
Aug 14 13:36:58 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:36:58 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:36:58 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:36:58 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:36:58 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:36:58 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:36:58 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:36:58 user nova-compute[73484]:       <nova:owner>
Aug 14 13:36:58 user nova-compute[73484]:         <nova:user uuid="5a0f55ad018d4c0ca587d8bdd40df4c8">tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member</nova:user>
Aug 14 13:36:58 user nova-compute[73484]:         <nova:project uuid="2c7f2c51c0f84bf1aedcf493a9ff860f">tempest-ServerBootFromVolumeStableRescueTest-830908511</nova:project>
Aug 14 13:36:58 user nova-compute[73484]:       </nova:owner>
Aug 14 13:36:58 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:36:58 user nova-compute[73484]:       <nova:ports>
Aug 14 13:36:58 user nova-compute[73484]:         <nova:port uuid="5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b">
Aug 14 13:36:58 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 13:36:58 user nova-compute[73484]:         </nova:port>
Aug 14 13:36:58 user nova-compute[73484]:       </nova:ports>
Aug 14 13:36:58 user nova-compute[73484]:     </nova:instance>
Aug 14 13:36:58 user nova-compute[73484]:   </metadata>
Aug 14 13:36:58 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:36:58 user nova-compute[73484]:     <system>
Aug 14 13:36:58 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:36:58 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:36:58 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:36:58 user nova-compute[73484]:       <entry name="serial">f4f7788c-fcca-47c1-b5b8-72892253982d</entry>
Aug 14 13:36:58 user nova-compute[73484]:       <entry name="uuid">f4f7788c-fcca-47c1-b5b8-72892253982d</entry>
Aug 14 13:36:58 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:36:58 user nova-compute[73484]:     </system>
Aug 14 13:36:58 user nova-compute[73484]:   </sysinfo>
Aug 14 13:36:58 user nova-compute[73484]:   <os>
Aug 14 13:36:58 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:36:58 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:36:58 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:36:58 user nova-compute[73484]:   </os>
Aug 14 13:36:58 user nova-compute[73484]:   <features>
Aug 14 13:36:58 user nova-compute[73484]:     <acpi/>
Aug 14 13:36:58 user nova-compute[73484]:     <apic/>
Aug 14 13:36:58 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:36:58 user nova-compute[73484]:   </features>
Aug 14 13:36:58 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:36:58 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:36:58 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:36:58 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:36:58 user nova-compute[73484]:   </clock>
Aug 14 13:36:58 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:36:58 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:36:58 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:36:58 user nova-compute[73484]:   </cpu>
Aug 14 13:36:58 user nova-compute[73484]:   <devices>
Aug 14 13:36:58 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:36:58 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:36:58 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk"/>
Aug 14 13:36:58 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:36:58 user nova-compute[73484]:     </disk>
Aug 14 13:36:58 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:36:58 user nova-compute[73484]:       <mac address="fa:16:3e:8b:e0:96"/>
Aug 14 13:36:58 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:36:58 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:36:58 user nova-compute[73484]:       <target dev="tap5cc7ee1a-4f"/>
Aug 14 13:36:58 user nova-compute[73484]:     </interface>
Aug 14 13:36:58 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:36:58 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/console.log" append="off"/>
Aug 14 13:36:58 user nova-compute[73484]:     </serial>
Aug 14 13:36:58 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:36:58 user nova-compute[73484]:     <video>
Aug 14 13:36:58 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:36:58 user nova-compute[73484]:     </video>
Aug 14 13:36:58 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:36:58 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:36:58 user nova-compute[73484]:     </rng>
Aug 14 13:36:58 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:36:58 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:36:58 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:36:58 user nova-compute[73484]:     </memballoon>
Aug 14 13:36:58 user nova-compute[73484]:   </devices>
Aug 14 13:36:58 user nova-compute[73484]: </domain>
Aug 14 13:36:58 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:36:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1818814659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1818814659',id=1,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c7f2c51c0f84bf1aedcf493a9ff860f',ramdisk_id='',reservation_id='r-ldchyjq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-830908511',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:36:48Z,user_data=None,user_id='5a0f55ad018d4c0ca587d8bdd40df4c8',uuid=f4f7788c-fcca-47c1-b5b8-72892253982d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b", "address": "fa:16:3e:8b:e0:96", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc7ee1a-4f", "ovs_interfaceid": "5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Converting VIF {"id": "5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b", "address": "fa:16:3e:8b:e0:96", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc7ee1a-4f", "ovs_interfaceid": "5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e0:96,bridge_name='br-int',has_traffic_filtering=True,id=5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b,network=Network(4ec437fc-4371-48d6-8026-b64423fbc0ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc7ee1a-4f') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG os_vif [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e0:96,bridge_name='br-int',has_traffic_filtering=True,id=5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b,network=Network(4ec437fc-4371-48d6-8026-b64423fbc0ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc7ee1a-4f') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Created schema index Interface.name {{(pid=73484) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Created schema index Port.name {{(pid=73484) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Created schema index Bridge.name {{(pid=73484) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.251s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Checking if we can resize image /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Cannot resize image /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.objects.instance [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lazy-loading 'migration_context' on Instance uuid 07bac569-8b2c-4555-b4d5-a74f7384630b {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [POLLOUT] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Ensure instance console log exists: /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:36:58 user nova-compute[73484]: INFO oslo.privsep.daemon [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp78om2k47/privsep.sock']
Aug 14 13:36:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:36:58 user sudo[82873]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp78om2k47/privsep.sock
Aug 14 13:36:58 user sudo[82873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 14 13:36:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Cannot resize image /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.objects.instance [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lazy-loading 'migration_context' on Instance uuid 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Ensure instance console log exists: /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:36:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:00 user nova-compute[73484]: DEBUG nova.network.neutron [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Successfully created port: 511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:37:00 user sudo[82873]: pam_unix(sudo:session): session closed for user root
Aug 14 13:37:00 user nova-compute[73484]: INFO oslo.privsep.daemon [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Spawned new privsep daemon via rootwrap
Aug 14 13:37:00 user nova-compute[73484]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 14 13:37:00 user nova-compute[73484]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 14 13:37:00 user nova-compute[73484]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 14 13:37:00 user nova-compute[73484]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82881
Aug 14 13:37:00 user nova-compute[73484]: DEBUG nova.network.neutron [req-e9164e0f-a44e-4dbd-a0aa-322c535f3911 req-be1c7e2b-1675-426d-aaaa-fc95041fa561 service nova] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Updated VIF entry in instance network info cache for port 5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:37:00 user nova-compute[73484]: DEBUG nova.network.neutron [req-e9164e0f-a44e-4dbd-a0aa-322c535f3911 req-be1c7e2b-1675-426d-aaaa-fc95041fa561 service nova] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Updating instance_info_cache with network_info: [{"id": "5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b", "address": "fa:16:3e:8b:e0:96", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc7ee1a-4f", "ovs_interfaceid": "5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:37:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e9164e0f-a44e-4dbd-a0aa-322c535f3911 req-be1c7e2b-1675-426d-aaaa-fc95041fa561 service nova] Releasing lock "refresh_cache-f4f7788c-fcca-47c1-b5b8-72892253982d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:37:00 user nova-compute[73484]: DEBUG nova.network.neutron [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Successfully created port: cb7f3901-875e-489a-87f8-5642b9fded9c {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:37:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5cc7ee1a-4f, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:37:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5cc7ee1a-4f, col_values=(('external_ids', {'iface-id': '5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:e0:96', 'vm-uuid': 'f4f7788c-fcca-47c1-b5b8-72892253982d'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:37:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:37:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:01 user nova-compute[73484]: INFO os_vif [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e0:96,bridge_name='br-int',has_traffic_filtering=True,id=5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b,network=Network(4ec437fc-4371-48d6-8026-b64423fbc0ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc7ee1a-4f')
Aug 14 13:37:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:37:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] No VIF found with MAC fa:16:3e:8b:e0:96, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:37:01 user nova-compute[73484]: DEBUG nova.network.neutron [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Successfully created port: 290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:37:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:03 user nova-compute[73484]: DEBUG nova.network.neutron [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Successfully updated port: 511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:37:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "refresh_cache-0a3a174b-d870-4164-891e-a2fa8cc8c8b8" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:37:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquired lock "refresh_cache-0a3a174b-d870-4164-891e-a2fa8cc8c8b8" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:37:03 user nova-compute[73484]: DEBUG nova.network.neutron [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:37:03 user nova-compute[73484]: DEBUG nova.network.neutron [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Successfully updated port: cb7f3901-875e-489a-87f8-5642b9fded9c {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:37:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "refresh_cache-07bac569-8b2c-4555-b4d5-a74f7384630b" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:37:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquired lock "refresh_cache-07bac569-8b2c-4555-b4d5-a74f7384630b" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:37:03 user nova-compute[73484]: DEBUG nova.network.neutron [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:37:03 user nova-compute[73484]: DEBUG nova.compute.manager [req-e6a14bb1-2719-49f1-b4f1-e68b95f2d555 req-b733baee-b809-4634-9389-6c573d61d99c service nova] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Received event network-changed-cb7f3901-875e-489a-87f8-5642b9fded9c {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:37:03 user nova-compute[73484]: DEBUG nova.compute.manager [req-e6a14bb1-2719-49f1-b4f1-e68b95f2d555 req-b733baee-b809-4634-9389-6c573d61d99c service nova] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Refreshing instance network info cache due to event network-changed-cb7f3901-875e-489a-87f8-5642b9fded9c. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:37:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e6a14bb1-2719-49f1-b4f1-e68b95f2d555 req-b733baee-b809-4634-9389-6c573d61d99c service nova] Acquiring lock "refresh_cache-07bac569-8b2c-4555-b4d5-a74f7384630b" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:37:03 user nova-compute[73484]: DEBUG nova.compute.manager [req-4d674ac2-88dd-48ba-9e78-3c3d545a5528 req-7ac08e22-5e20-4987-a5ea-bc3156d29692 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received event network-changed-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:37:03 user nova-compute[73484]: DEBUG nova.compute.manager [req-4d674ac2-88dd-48ba-9e78-3c3d545a5528 req-7ac08e22-5e20-4987-a5ea-bc3156d29692 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Refreshing instance network info cache due to event network-changed-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:37:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4d674ac2-88dd-48ba-9e78-3c3d545a5528 req-7ac08e22-5e20-4987-a5ea-bc3156d29692 service nova] Acquiring lock "refresh_cache-0a3a174b-d870-4164-891e-a2fa8cc8c8b8" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:37:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:03 user nova-compute[73484]: DEBUG nova.network.neutron [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:37:04 user nova-compute[73484]: DEBUG nova.network.neutron [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:37:04 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020224.475287, f4f7788c-fcca-47c1-b5b8-72892253982d => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:37:04 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] VM Resumed (Lifecycle Event)
Aug 14 13:37:04 user nova-compute[73484]: DEBUG nova.compute.manager [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:37:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:37:04 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Instance spawned successfully.
Aug 14 13:37:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:37:04 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:37:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:04 user nova-compute[73484]: DEBUG nova.network.neutron [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Successfully updated port: 290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:37:04 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:37:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Acquiring lock "refresh_cache-66e161f1-2f3b-4777-9a0d-5f4d62e850d5" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:37:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Acquired lock "refresh_cache-66e161f1-2f3b-4777-9a0d-5f4d62e850d5" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:37:04 user nova-compute[73484]: DEBUG nova.network.neutron [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:37:04 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:37:04 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020224.4768686, f4f7788c-fcca-47c1-b5b8-72892253982d => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:37:04 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] VM Started (Lifecycle Event)
Aug 14 13:37:04 user nova-compute[73484]: INFO nova.compute.manager [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Took 16.81 seconds to spawn the instance on the hypervisor.
Aug 14 13:37:04 user nova-compute[73484]: DEBUG nova.compute.manager [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:37:04 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:37:04 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:37:04 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:37:04 user nova-compute[73484]: DEBUG nova.network.neutron [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:37:04 user nova-compute[73484]: INFO nova.compute.manager [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Took 17.95 seconds to build instance.
Aug 14 13:37:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d212e0c6-5502-4446-af0b-499e78791eaf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "f4f7788c-fcca-47c1-b5b8-72892253982d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.161s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.network.neutron [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Updating instance_info_cache with network_info: [{"id": "cb7f3901-875e-489a-87f8-5642b9fded9c", "address": "fa:16:3e:6c:13:9e", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7f3901-87", "ovs_interfaceid": "cb7f3901-875e-489a-87f8-5642b9fded9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Releasing lock "refresh_cache-07bac569-8b2c-4555-b4d5-a74f7384630b" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.compute.manager [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Instance network_info: |[{"id": "cb7f3901-875e-489a-87f8-5642b9fded9c", "address": "fa:16:3e:6c:13:9e", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7f3901-87", "ovs_interfaceid": "cb7f3901-875e-489a-87f8-5642b9fded9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e6a14bb1-2719-49f1-b4f1-e68b95f2d555 req-b733baee-b809-4634-9389-6c573d61d99c service nova] Acquired lock "refresh_cache-07bac569-8b2c-4555-b4d5-a74f7384630b" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.network.neutron [req-e6a14bb1-2719-49f1-b4f1-e68b95f2d555 req-b733baee-b809-4634-9389-6c573d61d99c service nova] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Refreshing network info cache for port cb7f3901-875e-489a-87f8-5642b9fded9c {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Start _get_guest_xml network_info=[{"id": "cb7f3901-875e-489a-87f8-5642b9fded9c", "address": "fa:16:3e:6c:13:9e", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7f3901-87", "ovs_interfaceid": "cb7f3901-875e-489a-87f8-5642b9fded9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.network.neutron [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Updating instance_info_cache with network_info: [{"id": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "address": "fa:16:3e:b8:35:a4", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511cc5ad-6f", "ovs_interfaceid": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:37:05 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:37:05 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Releasing lock "refresh_cache-0a3a174b-d870-4164-891e-a2fa8cc8c8b8" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.compute.manager [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Instance network_info: |[{"id": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "address": "fa:16:3e:b8:35:a4", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511cc5ad-6f", "ovs_interfaceid": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4d674ac2-88dd-48ba-9e78-3c3d545a5528 req-7ac08e22-5e20-4987-a5ea-bc3156d29692 service nova] Acquired lock "refresh_cache-0a3a174b-d870-4164-891e-a2fa8cc8c8b8" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.network.neutron [req-4d674ac2-88dd-48ba-9e78-3c3d545a5528 req-7ac08e22-5e20-4987-a5ea-bc3156d29692 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Refreshing network info cache for port 511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Start _get_guest_xml network_info=[{"id": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "address": "fa:16:3e:b8:35:a4", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511cc5ad-6f", "ovs_interfaceid": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:36:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-309867077',display_name='tempest-ServerActionsTestOtherA-server-309867077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-309867077',id=3,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+U0YM0H+9FtSMWW9gC7hlmEYl+cufNxOVmMIw8gQGmCCRzcGdOpZ2rClVjHI02XniG6rU6cneNsbww6ySr+rPSIW5KD8/op2pTaoCA25ZKyUod+b+1u3EAmeZWFbiG0g==',key_name='tempest-keypair-1679559247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff9e3bd3df8a408e96e9054775c3cb83',ramdisk_id='',reservation_id='r-en88zafj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2033458528',owner_user_name='tempest-ServerActionsTestOtherA-2033458528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:36:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b22dfe5647e149a5b3a19d843f0efd66',uuid=07bac569-8b2c-4555-b4d5-a74f7384630b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb7f3901-875e-489a-87f8-5642b9fded9c", "address": "fa:16:3e:6c:13:9e", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7f3901-87", "ovs_interfaceid": "cb7f3901-875e-489a-87f8-5642b9fded9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Converting VIF {"id": "cb7f3901-875e-489a-87f8-5642b9fded9c", "address": "fa:16:3e:6c:13:9e", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7f3901-87", "ovs_interfaceid": "cb7f3901-875e-489a-87f8-5642b9fded9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:13:9e,bridge_name='br-int',has_traffic_filtering=True,id=cb7f3901-875e-489a-87f8-5642b9fded9c,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb7f3901-87') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.objects.instance [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lazy-loading 'pci_devices' on Instance uuid 07bac569-8b2c-4555-b4d5-a74f7384630b {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:37:05 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:37:05 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:37:05 user nova-compute[73484]:   <uuid>07bac569-8b2c-4555-b4d5-a74f7384630b</uuid>
Aug 14 13:37:05 user nova-compute[73484]:   <name>instance-00000003</name>
Aug 14 13:37:05 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:37:05 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:37:05 user nova-compute[73484]:   <metadata>
Aug 14 13:37:05 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:37:05 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:37:05 user nova-compute[73484]:       <nova:name>tempest-ServerActionsTestOtherA-server-309867077</nova:name>
Aug 14 13:37:05 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:37:05</nova:creationTime>
Aug 14 13:37:05 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:37:05 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:37:05 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:37:05 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:37:05 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:37:05 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:37:05 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:37:05 user nova-compute[73484]:       <nova:owner>
Aug 14 13:37:05 user nova-compute[73484]:         <nova:user uuid="b22dfe5647e149a5b3a19d843f0efd66">tempest-ServerActionsTestOtherA-2033458528-project-member</nova:user>
Aug 14 13:37:05 user nova-compute[73484]:         <nova:project uuid="ff9e3bd3df8a408e96e9054775c3cb83">tempest-ServerActionsTestOtherA-2033458528</nova:project>
Aug 14 13:37:05 user nova-compute[73484]:       </nova:owner>
Aug 14 13:37:05 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:37:05 user nova-compute[73484]:       <nova:ports>
Aug 14 13:37:05 user nova-compute[73484]:         <nova:port uuid="cb7f3901-875e-489a-87f8-5642b9fded9c">
Aug 14 13:37:05 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 13:37:05 user nova-compute[73484]:         </nova:port>
Aug 14 13:37:05 user nova-compute[73484]:       </nova:ports>
Aug 14 13:37:05 user nova-compute[73484]:     </nova:instance>
Aug 14 13:37:05 user nova-compute[73484]:   </metadata>
Aug 14 13:37:05 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:37:05 user nova-compute[73484]:     <system>
Aug 14 13:37:05 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:37:05 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:37:05 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:37:05 user nova-compute[73484]:       <entry name="serial">07bac569-8b2c-4555-b4d5-a74f7384630b</entry>
Aug 14 13:37:05 user nova-compute[73484]:       <entry name="uuid">07bac569-8b2c-4555-b4d5-a74f7384630b</entry>
Aug 14 13:37:05 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:37:05 user nova-compute[73484]:     </system>
Aug 14 13:37:05 user nova-compute[73484]:   </sysinfo>
Aug 14 13:37:05 user nova-compute[73484]:   <os>
Aug 14 13:37:05 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:37:05 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:37:05 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:37:05 user nova-compute[73484]:   </os>
Aug 14 13:37:05 user nova-compute[73484]:   <features>
Aug 14 13:37:05 user nova-compute[73484]:     <acpi/>
Aug 14 13:37:05 user nova-compute[73484]:     <apic/>
Aug 14 13:37:05 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:37:05 user nova-compute[73484]:   </features>
Aug 14 13:37:05 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:37:05 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:37:05 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:37:05 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:37:05 user nova-compute[73484]:   </clock>
Aug 14 13:37:05 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:37:05 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:37:05 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:37:05 user nova-compute[73484]:   </cpu>
Aug 14 13:37:05 user nova-compute[73484]:   <devices>
Aug 14 13:37:05 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:37:05 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:37:05 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk"/>
Aug 14 13:37:05 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:37:05 user nova-compute[73484]:     </disk>
Aug 14 13:37:05 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:37:05 user nova-compute[73484]:       <mac address="fa:16:3e:6c:13:9e"/>
Aug 14 13:37:05 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:37:05 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:37:05 user nova-compute[73484]:       <target dev="tapcb7f3901-87"/>
Aug 14 13:37:05 user nova-compute[73484]:     </interface>
Aug 14 13:37:05 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:37:05 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/console.log" append="off"/>
Aug 14 13:37:05 user nova-compute[73484]:     </serial>
Aug 14 13:37:05 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:37:05 user nova-compute[73484]:     <video>
Aug 14 13:37:05 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:37:05 user nova-compute[73484]:     </video>
Aug 14 13:37:05 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:37:05 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:37:05 user nova-compute[73484]:     </rng>
Aug 14 13:37:05 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:37:05 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:37:05 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:37:05 user nova-compute[73484]:     </memballoon>
Aug 14 13:37:05 user nova-compute[73484]:   </devices>
Aug 14 13:37:05 user nova-compute[73484]: </domain>
Aug 14 13:37:05 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:36:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-309867077',display_name='tempest-ServerActionsTestOtherA-server-309867077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-309867077',id=3,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+U0YM0H+9FtSMWW9gC7hlmEYl+cufNxOVmMIw8gQGmCCRzcGdOpZ2rClVjHI02XniG6rU6cneNsbww6ySr+rPSIW5KD8/op2pTaoCA25ZKyUod+b+1u3EAmeZWFbiG0g==',key_name='tempest-keypair-1679559247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff9e3bd3df8a408e96e9054775c3cb83',ramdisk_id='',reservation_id='r-en88zafj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2033458528',owner_user_name='tempest-ServerActionsTestOtherA-2033458528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:36:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b22dfe5647e149a5b3a19d843f0efd66',uuid=07bac569-8b2c-4555-b4d5-a74f7384630b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb7f3901-875e-489a-87f8-5642b9fded9c", "address": "fa:16:3e:6c:13:9e", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7f3901-87", "ovs_interfaceid": "cb7f3901-875e-489a-87f8-5642b9fded9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Converting VIF {"id": "cb7f3901-875e-489a-87f8-5642b9fded9c", "address": "fa:16:3e:6c:13:9e", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7f3901-87", "ovs_interfaceid": "cb7f3901-875e-489a-87f8-5642b9fded9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:13:9e,bridge_name='br-int',has_traffic_filtering=True,id=cb7f3901-875e-489a-87f8-5642b9fded9c,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb7f3901-87') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG os_vif [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:13:9e,bridge_name='br-int',has_traffic_filtering=True,id=cb7f3901-875e-489a-87f8-5642b9fded9c,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb7f3901-87') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb7f3901-87, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcb7f3901-87, col_values=(('external_ids', {'iface-id': 'cb7f3901-875e-489a-87f8-5642b9fded9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:13:9e', 'vm-uuid': '07bac569-8b2c-4555-b4d5-a74f7384630b'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:36:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1545874430',display_name='tempest-AttachVolumeTestJSON-server-1545874430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1545874430',id=2,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALz2dA1fCV3zsqvRCM3si65BX/s2RWbHAvxkMavxCm+Cz33FBQTUMagzswhJU7/mAqiPPhCjI04IhkLCYoINFrAPHP37QxwSFtMKgaz77wIK1BXGoScfZ85G5EKo7vD3A==',key_name='tempest-keypair-1440897791',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d2114819cda450ca1827ddd5557da23',ramdisk_id='',reservation_id='r-ifpiz561',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-852428779',owner_user_name='tempest-AttachVolumeTestJSON-852428779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:36:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fac94bacad00447d9743d8a44118ea47',uuid=0a3a174b-d870-4164-891e-a2fa8cc8c8b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "address": "fa:16:3e:b8:35:a4", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511cc5ad-6f", "ovs_interfaceid": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Converting VIF {"id": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "address": "fa:16:3e:b8:35:a4", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511cc5ad-6f", "ovs_interfaceid": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:35:a4,bridge_name='br-int',has_traffic_filtering=True,id=511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a,network=Network(cddd6eb8-767a-42c5-8cca-a1fe1d2eb604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511cc5ad-6f') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.objects.instance [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:37:05 user nova-compute[73484]: INFO os_vif [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:13:9e,bridge_name='br-int',has_traffic_filtering=True,id=cb7f3901-875e-489a-87f8-5642b9fded9c,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb7f3901-87')
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:37:05 user nova-compute[73484]:   <uuid>0a3a174b-d870-4164-891e-a2fa8cc8c8b8</uuid>
Aug 14 13:37:05 user nova-compute[73484]:   <name>instance-00000002</name>
Aug 14 13:37:05 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:37:05 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:37:05 user nova-compute[73484]:   <metadata>
Aug 14 13:37:05 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:37:05 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:37:05 user nova-compute[73484]:       <nova:name>tempest-AttachVolumeTestJSON-server-1545874430</nova:name>
Aug 14 13:37:05 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:37:05</nova:creationTime>
Aug 14 13:37:05 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:37:05 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:37:05 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:37:05 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:37:05 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:37:05 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:37:05 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:37:05 user nova-compute[73484]:       <nova:owner>
Aug 14 13:37:05 user nova-compute[73484]:         <nova:user uuid="fac94bacad00447d9743d8a44118ea47">tempest-AttachVolumeTestJSON-852428779-project-member</nova:user>
Aug 14 13:37:05 user nova-compute[73484]:         <nova:project uuid="3d2114819cda450ca1827ddd5557da23">tempest-AttachVolumeTestJSON-852428779</nova:project>
Aug 14 13:37:05 user nova-compute[73484]:       </nova:owner>
Aug 14 13:37:05 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:37:05 user nova-compute[73484]:       <nova:ports>
Aug 14 13:37:05 user nova-compute[73484]:         <nova:port uuid="511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a">
Aug 14 13:37:05 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 13:37:05 user nova-compute[73484]:         </nova:port>
Aug 14 13:37:05 user nova-compute[73484]:       </nova:ports>
Aug 14 13:37:05 user nova-compute[73484]:     </nova:instance>
Aug 14 13:37:05 user nova-compute[73484]:   </metadata>
Aug 14 13:37:05 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:37:05 user nova-compute[73484]:     <system>
Aug 14 13:37:05 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:37:05 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:37:05 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:37:05 user nova-compute[73484]:       <entry name="serial">0a3a174b-d870-4164-891e-a2fa8cc8c8b8</entry>
Aug 14 13:37:05 user nova-compute[73484]:       <entry name="uuid">0a3a174b-d870-4164-891e-a2fa8cc8c8b8</entry>
Aug 14 13:37:05 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:37:05 user nova-compute[73484]:     </system>
Aug 14 13:37:05 user nova-compute[73484]:   </sysinfo>
Aug 14 13:37:05 user nova-compute[73484]:   <os>
Aug 14 13:37:05 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:37:05 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:37:05 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:37:05 user nova-compute[73484]:   </os>
Aug 14 13:37:05 user nova-compute[73484]:   <features>
Aug 14 13:37:05 user nova-compute[73484]:     <acpi/>
Aug 14 13:37:05 user nova-compute[73484]:     <apic/>
Aug 14 13:37:05 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:37:05 user nova-compute[73484]:   </features>
Aug 14 13:37:05 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:37:05 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:37:05 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:37:05 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:37:05 user nova-compute[73484]:   </clock>
Aug 14 13:37:05 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:37:05 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:37:05 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:37:05 user nova-compute[73484]:   </cpu>
Aug 14 13:37:05 user nova-compute[73484]:   <devices>
Aug 14 13:37:05 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:37:05 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:37:05 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk"/>
Aug 14 13:37:05 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:37:05 user nova-compute[73484]:     </disk>
Aug 14 13:37:05 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:37:05 user nova-compute[73484]:       <mac address="fa:16:3e:b8:35:a4"/>
Aug 14 13:37:05 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:37:05 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:37:05 user nova-compute[73484]:       <target dev="tap511cc5ad-6f"/>
Aug 14 13:37:05 user nova-compute[73484]:     </interface>
Aug 14 13:37:05 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:37:05 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/console.log" append="off"/>
Aug 14 13:37:05 user nova-compute[73484]:     </serial>
Aug 14 13:37:05 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:37:05 user nova-compute[73484]:     <video>
Aug 14 13:37:05 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:37:05 user nova-compute[73484]:     </video>
Aug 14 13:37:05 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:37:05 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:37:05 user nova-compute[73484]:     </rng>
Aug 14 13:37:05 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:37:05 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:37:05 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:37:05 user nova-compute[73484]:     </memballoon>
Aug 14 13:37:05 user nova-compute[73484]:   </devices>
Aug 14 13:37:05 user nova-compute[73484]: </domain>
Aug 14 13:37:05 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:36:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1545874430',display_name='tempest-AttachVolumeTestJSON-server-1545874430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1545874430',id=2,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALz2dA1fCV3zsqvRCM3si65BX/s2RWbHAvxkMavxCm+Cz33FBQTUMagzswhJU7/mAqiPPhCjI04IhkLCYoINFrAPHP37QxwSFtMKgaz77wIK1BXGoScfZ85G5EKo7vD3A==',key_name='tempest-keypair-1440897791',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d2114819cda450ca1827ddd5557da23',ramdisk_id='',reservation_id='r-ifpiz561',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-852428779',owner_user_name='tempest-AttachVolumeTestJSON-852428779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:36:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fac94bacad00447d9743d8a44118ea47',uuid=0a3a174b-d870-4164-891e-a2fa8cc8c8b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "address": "fa:16:3e:b8:35:a4", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511cc5ad-6f", "ovs_interfaceid": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Converting VIF {"id": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "address": "fa:16:3e:b8:35:a4", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511cc5ad-6f", "ovs_interfaceid": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:35:a4,bridge_name='br-int',has_traffic_filtering=True,id=511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a,network=Network(cddd6eb8-767a-42c5-8cca-a1fe1d2eb604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511cc5ad-6f') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG os_vif [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:35:a4,bridge_name='br-int',has_traffic_filtering=True,id=511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a,network=Network(cddd6eb8-767a-42c5-8cca-a1fe1d2eb604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511cc5ad-6f') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap511cc5ad-6f, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap511cc5ad-6f, col_values=(('external_ids', {'iface-id': '511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:35:a4', 'vm-uuid': '0a3a174b-d870-4164-891e-a2fa8cc8c8b8'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:05 user nova-compute[73484]: INFO os_vif [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:35:a4,bridge_name='br-int',has_traffic_filtering=True,id=511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a,network=Network(cddd6eb8-767a-42c5-8cca-a1fe1d2eb604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511cc5ad-6f')
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] No VIF found with MAC fa:16:3e:6c:13:9e, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] No VIF found with MAC fa:16:3e:b8:35:a4, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.compute.manager [req-fee70dfb-06d8-416f-9b21-1cae98df5d09 req-e1809d72-9f76-418a-8986-761ee8e780c8 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Received event network-changed-290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.compute.manager [req-fee70dfb-06d8-416f-9b21-1cae98df5d09 req-e1809d72-9f76-418a-8986-761ee8e780c8 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Refreshing instance network info cache due to event network-changed-290c0b61-ba11-4074-a7f2-cb172a576a19. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-fee70dfb-06d8-416f-9b21-1cae98df5d09 req-e1809d72-9f76-418a-8986-761ee8e780c8 service nova] Acquiring lock "refresh_cache-66e161f1-2f3b-4777-9a0d-5f4d62e850d5" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:37:05 user nova-compute[73484]: DEBUG nova.network.neutron [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Updating instance_info_cache with network_info: [{"id": "290c0b61-ba11-4074-a7f2-cb172a576a19", "address": "fa:16:3e:69:2f:ce", "network": {"id": "2306cc91-8443-4c0e-b5a6-3883766b686a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-577320480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ea5214248845418e322d18d298c449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap290c0b61-ba", "ovs_interfaceid": "290c0b61-ba11-4074-a7f2-cb172a576a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Releasing lock "refresh_cache-66e161f1-2f3b-4777-9a0d-5f4d62e850d5" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG nova.compute.manager [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Instance network_info: |[{"id": "290c0b61-ba11-4074-a7f2-cb172a576a19", "address": "fa:16:3e:69:2f:ce", "network": {"id": "2306cc91-8443-4c0e-b5a6-3883766b686a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-577320480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ea5214248845418e322d18d298c449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap290c0b61-ba", "ovs_interfaceid": "290c0b61-ba11-4074-a7f2-cb172a576a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-fee70dfb-06d8-416f-9b21-1cae98df5d09 req-e1809d72-9f76-418a-8986-761ee8e780c8 service nova] Acquired lock "refresh_cache-66e161f1-2f3b-4777-9a0d-5f4d62e850d5" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG nova.network.neutron [req-fee70dfb-06d8-416f-9b21-1cae98df5d09 req-e1809d72-9f76-418a-8986-761ee8e780c8 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Refreshing network info cache for port 290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Start _get_guest_xml network_info=[{"id": "290c0b61-ba11-4074-a7f2-cb172a576a19", "address": "fa:16:3e:69:2f:ce", "network": {"id": "2306cc91-8443-4c0e-b5a6-3883766b686a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-577320480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ea5214248845418e322d18d298c449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap290c0b61-ba", "ovs_interfaceid": "290c0b61-ba11-4074-a7f2-cb172a576a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:37:06 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:37:06 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:37:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:36:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1545246932',display_name='tempest-ServerStableDeviceRescueTest-server-1545246932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1545246932',id=4,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNnPFytjTYkiccqtCpAzJGkmVj4GkS19LS49sca5TI0sqXkCY1rk1X/hROtXBUUkImQA/+wT95tfW91orX+01oToWNzGrpj6pbVY4SfyVkrwI//uxjHErhihJanzPyxbg==',key_name='tempest-keypair-183088637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1ea5214248845418e322d18d298c449',ramdisk_id='',reservation_id='r-x171fkwc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-779507232',owner_user_name='tempest-ServerStableDeviceRescueTest-779507232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:36:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c0b51afa7a147ce9a3047642651c6bb',uuid=66e161f1-2f3b-4777-9a0d-5f4d62e850d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "290c0b61-ba11-4074-a7f2-cb172a576a19", "address": "fa:16:3e:69:2f:ce", "network": {"id": "2306cc91-8443-4c0e-b5a6-3883766b686a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-577320480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ea5214248845418e322d18d298c449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap290c0b61-ba", "ovs_interfaceid": "290c0b61-ba11-4074-a7f2-cb172a576a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Converting VIF {"id": "290c0b61-ba11-4074-a7f2-cb172a576a19", "address": "fa:16:3e:69:2f:ce", "network": {"id": "2306cc91-8443-4c0e-b5a6-3883766b686a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-577320480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ea5214248845418e322d18d298c449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap290c0b61-ba", "ovs_interfaceid": "290c0b61-ba11-4074-a7f2-cb172a576a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:2f:ce,bridge_name='br-int',has_traffic_filtering=True,id=290c0b61-ba11-4074-a7f2-cb172a576a19,network=Network(2306cc91-8443-4c0e-b5a6-3883766b686a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap290c0b61-ba') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG nova.objects.instance [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lazy-loading 'pci_devices' on Instance uuid 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:37:06 user nova-compute[73484]:   <uuid>66e161f1-2f3b-4777-9a0d-5f4d62e850d5</uuid>
Aug 14 13:37:06 user nova-compute[73484]:   <name>instance-00000004</name>
Aug 14 13:37:06 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:37:06 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:37:06 user nova-compute[73484]:   <metadata>
Aug 14 13:37:06 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:37:06 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:37:06 user nova-compute[73484]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1545246932</nova:name>
Aug 14 13:37:06 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:37:06</nova:creationTime>
Aug 14 13:37:06 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:37:06 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:37:06 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:37:06 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:37:06 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:37:06 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:37:06 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:37:06 user nova-compute[73484]:       <nova:owner>
Aug 14 13:37:06 user nova-compute[73484]:         <nova:user uuid="3c0b51afa7a147ce9a3047642651c6bb">tempest-ServerStableDeviceRescueTest-779507232-project-member</nova:user>
Aug 14 13:37:06 user nova-compute[73484]:         <nova:project uuid="f1ea5214248845418e322d18d298c449">tempest-ServerStableDeviceRescueTest-779507232</nova:project>
Aug 14 13:37:06 user nova-compute[73484]:       </nova:owner>
Aug 14 13:37:06 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:37:06 user nova-compute[73484]:       <nova:ports>
Aug 14 13:37:06 user nova-compute[73484]:         <nova:port uuid="290c0b61-ba11-4074-a7f2-cb172a576a19">
Aug 14 13:37:06 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 13:37:06 user nova-compute[73484]:         </nova:port>
Aug 14 13:37:06 user nova-compute[73484]:       </nova:ports>
Aug 14 13:37:06 user nova-compute[73484]:     </nova:instance>
Aug 14 13:37:06 user nova-compute[73484]:   </metadata>
Aug 14 13:37:06 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:37:06 user nova-compute[73484]:     <system>
Aug 14 13:37:06 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:37:06 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:37:06 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:37:06 user nova-compute[73484]:       <entry name="serial">66e161f1-2f3b-4777-9a0d-5f4d62e850d5</entry>
Aug 14 13:37:06 user nova-compute[73484]:       <entry name="uuid">66e161f1-2f3b-4777-9a0d-5f4d62e850d5</entry>
Aug 14 13:37:06 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:37:06 user nova-compute[73484]:     </system>
Aug 14 13:37:06 user nova-compute[73484]:   </sysinfo>
Aug 14 13:37:06 user nova-compute[73484]:   <os>
Aug 14 13:37:06 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:37:06 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:37:06 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:37:06 user nova-compute[73484]:   </os>
Aug 14 13:37:06 user nova-compute[73484]:   <features>
Aug 14 13:37:06 user nova-compute[73484]:     <acpi/>
Aug 14 13:37:06 user nova-compute[73484]:     <apic/>
Aug 14 13:37:06 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:37:06 user nova-compute[73484]:   </features>
Aug 14 13:37:06 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:37:06 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:37:06 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:37:06 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:37:06 user nova-compute[73484]:   </clock>
Aug 14 13:37:06 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:37:06 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:37:06 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:37:06 user nova-compute[73484]:   </cpu>
Aug 14 13:37:06 user nova-compute[73484]:   <devices>
Aug 14 13:37:06 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:37:06 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:37:06 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk"/>
Aug 14 13:37:06 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:37:06 user nova-compute[73484]:     </disk>
Aug 14 13:37:06 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:37:06 user nova-compute[73484]:       <mac address="fa:16:3e:69:2f:ce"/>
Aug 14 13:37:06 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:37:06 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:37:06 user nova-compute[73484]:       <target dev="tap290c0b61-ba"/>
Aug 14 13:37:06 user nova-compute[73484]:     </interface>
Aug 14 13:37:06 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:37:06 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/console.log" append="off"/>
Aug 14 13:37:06 user nova-compute[73484]:     </serial>
Aug 14 13:37:06 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:37:06 user nova-compute[73484]:     <video>
Aug 14 13:37:06 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:37:06 user nova-compute[73484]:     </video>
Aug 14 13:37:06 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:37:06 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:37:06 user nova-compute[73484]:     </rng>
Aug 14 13:37:06 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:37:06 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:37:06 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:37:06 user nova-compute[73484]:     </memballoon>
Aug 14 13:37:06 user nova-compute[73484]:   </devices>
Aug 14 13:37:06 user nova-compute[73484]: </domain>
Aug 14 13:37:06 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:36:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1545246932',display_name='tempest-ServerStableDeviceRescueTest-server-1545246932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1545246932',id=4,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNnPFytjTYkiccqtCpAzJGkmVj4GkS19LS49sca5TI0sqXkCY1rk1X/hROtXBUUkImQA/+wT95tfW91orX+01oToWNzGrpj6pbVY4SfyVkrwI//uxjHErhihJanzPyxbg==',key_name='tempest-keypair-183088637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1ea5214248845418e322d18d298c449',ramdisk_id='',reservation_id='r-x171fkwc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-779507232',owner_user_name='tempest-ServerStableDeviceRescueTest-779507232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:36:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c0b51afa7a147ce9a3047642651c6bb',uuid=66e161f1-2f3b-4777-9a0d-5f4d62e850d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "290c0b61-ba11-4074-a7f2-cb172a576a19", "address": "fa:16:3e:69:2f:ce", "network": {"id": "2306cc91-8443-4c0e-b5a6-3883766b686a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-577320480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ea5214248845418e322d18d298c449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap290c0b61-ba", "ovs_interfaceid": "290c0b61-ba11-4074-a7f2-cb172a576a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Converting VIF {"id": "290c0b61-ba11-4074-a7f2-cb172a576a19", "address": "fa:16:3e:69:2f:ce", "network": {"id": "2306cc91-8443-4c0e-b5a6-3883766b686a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-577320480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ea5214248845418e322d18d298c449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap290c0b61-ba", "ovs_interfaceid": "290c0b61-ba11-4074-a7f2-cb172a576a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:2f:ce,bridge_name='br-int',has_traffic_filtering=True,id=290c0b61-ba11-4074-a7f2-cb172a576a19,network=Network(2306cc91-8443-4c0e-b5a6-3883766b686a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap290c0b61-ba') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG os_vif [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:2f:ce,bridge_name='br-int',has_traffic_filtering=True,id=290c0b61-ba11-4074-a7f2-cb172a576a19,network=Network(2306cc91-8443-4c0e-b5a6-3883766b686a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap290c0b61-ba') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap290c0b61-ba, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap290c0b61-ba, col_values=(('external_ids', {'iface-id': '290c0b61-ba11-4074-a7f2-cb172a576a19', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:2f:ce', 'vm-uuid': '66e161f1-2f3b-4777-9a0d-5f4d62e850d5'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:06 user nova-compute[73484]: INFO os_vif [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:2f:ce,bridge_name='br-int',has_traffic_filtering=True,id=290c0b61-ba11-4074-a7f2-cb172a576a19,network=Network(2306cc91-8443-4c0e-b5a6-3883766b686a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap290c0b61-ba')
Aug 14 13:37:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] No VIF found with MAC fa:16:3e:69:2f:ce, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:37:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:07 user nova-compute[73484]: DEBUG nova.network.neutron [req-e6a14bb1-2719-49f1-b4f1-e68b95f2d555 req-b733baee-b809-4634-9389-6c573d61d99c service nova] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Updated VIF entry in instance network info cache for port cb7f3901-875e-489a-87f8-5642b9fded9c. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:37:07 user nova-compute[73484]: DEBUG nova.network.neutron [req-e6a14bb1-2719-49f1-b4f1-e68b95f2d555 req-b733baee-b809-4634-9389-6c573d61d99c service nova] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Updating instance_info_cache with network_info: [{"id": "cb7f3901-875e-489a-87f8-5642b9fded9c", "address": "fa:16:3e:6c:13:9e", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7f3901-87", "ovs_interfaceid": "cb7f3901-875e-489a-87f8-5642b9fded9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:37:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e6a14bb1-2719-49f1-b4f1-e68b95f2d555 req-b733baee-b809-4634-9389-6c573d61d99c service nova] Releasing lock "refresh_cache-07bac569-8b2c-4555-b4d5-a74f7384630b" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:37:07 user nova-compute[73484]: DEBUG nova.network.neutron [req-4d674ac2-88dd-48ba-9e78-3c3d545a5528 req-7ac08e22-5e20-4987-a5ea-bc3156d29692 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Updated VIF entry in instance network info cache for port 511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:37:07 user nova-compute[73484]: DEBUG nova.network.neutron [req-4d674ac2-88dd-48ba-9e78-3c3d545a5528 req-7ac08e22-5e20-4987-a5ea-bc3156d29692 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Updating instance_info_cache with network_info: [{"id": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "address": "fa:16:3e:b8:35:a4", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511cc5ad-6f", "ovs_interfaceid": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:37:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4d674ac2-88dd-48ba-9e78-3c3d545a5528 req-7ac08e22-5e20-4987-a5ea-bc3156d29692 service nova] Releasing lock "refresh_cache-0a3a174b-d870-4164-891e-a2fa8cc8c8b8" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:37:07 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:08 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:08 user nova-compute[73484]: DEBUG nova.network.neutron [req-fee70dfb-06d8-416f-9b21-1cae98df5d09 req-e1809d72-9f76-418a-8986-761ee8e780c8 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Updated VIF entry in instance network info cache for port 290c0b61-ba11-4074-a7f2-cb172a576a19. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:37:08 user nova-compute[73484]: DEBUG nova.network.neutron [req-fee70dfb-06d8-416f-9b21-1cae98df5d09 req-e1809d72-9f76-418a-8986-761ee8e780c8 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Updating instance_info_cache with network_info: [{"id": "290c0b61-ba11-4074-a7f2-cb172a576a19", "address": "fa:16:3e:69:2f:ce", "network": {"id": "2306cc91-8443-4c0e-b5a6-3883766b686a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-577320480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ea5214248845418e322d18d298c449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap290c0b61-ba", "ovs_interfaceid": "290c0b61-ba11-4074-a7f2-cb172a576a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:37:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-fee70dfb-06d8-416f-9b21-1cae98df5d09 req-e1809d72-9f76-418a-8986-761ee8e780c8 service nova] Releasing lock "refresh_cache-66e161f1-2f3b-4777-9a0d-5f4d62e850d5" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:37:08 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Acquiring lock "b889688d-13dd-4f7b-bfef-26dc5347fd6e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "b889688d-13dd-4f7b-bfef-26dc5347fd6e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:13 user nova-compute[73484]: DEBUG nova.compute.manager [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:37:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:13 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:37:13 user nova-compute[73484]: INFO nova.compute.claims [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Claim successful on node user
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020234.4442074, 07bac569-8b2c-4555-b4d5-a74f7384630b => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:37:14 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] VM Resumed (Lifecycle Event)
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:37:14 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Instance spawned successfully.
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.662s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:37:14 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020234.4497783, 07bac569-8b2c-4555-b4d5-a74f7384630b => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:37:14 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] VM Started (Lifecycle Event)
Aug 14 13:37:14 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Instance spawned successfully.
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:37:14 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Instance spawned successfully.
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:37:14 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020234.5189197, 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:37:14 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] VM Resumed (Lifecycle Event)
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.network.neutron [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:37:14 user nova-compute[73484]: INFO nova.compute.manager [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Took 16.86 seconds to spawn the instance on the hypervisor.
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:37:14 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:14 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020234.5193639, 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:37:14 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] VM Started (Lifecycle Event)
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:37:14 user nova-compute[73484]: INFO nova.compute.manager [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Took 17.27 seconds to spawn the instance on the hypervisor.
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:37:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:14 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020234.609264, 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:37:14 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] VM Resumed (Lifecycle Event)
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.policy [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d89860cdc284bc898c650b2a6fc3a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a95ec66f3424934bdff0335e262cc9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:37:14 user nova-compute[73484]: INFO nova.compute.manager [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Took 18.22 seconds to build instance.
Aug 14 13:37:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:37:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:37:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-dede42a7-577d-4414-bf2a-9320c4d06b6f tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.475s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:15 user nova-compute[73484]: INFO nova.compute.manager [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Took 18.67 seconds to spawn the instance on the hypervisor.
Aug 14 13:37:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:37:15 user nova-compute[73484]: INFO nova.compute.manager [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Took 18.45 seconds to build instance.
Aug 14 13:37:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-977e3c79-75a5-4232-8cdc-3eec6d34bee4 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "07bac569-8b2c-4555-b4d5-a74f7384630b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.647s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:15 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:37:15 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020234.6101377, 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:37:15 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] VM Started (Lifecycle Event)
Aug 14 13:37:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:37:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:37:15 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Creating image(s)
Aug 14 13:37:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Acquiring lock "/opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "/opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "/opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:37:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:15 user nova-compute[73484]: INFO nova.compute.manager [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Took 19.72 seconds to build instance.
Aug 14 13:37:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:37:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c98de373-3deb-4bab-bdd5-dee6d9e4d9e2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.883s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.298s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.230s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk 1073741824" returned: 0 in 0.099s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.354s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.360s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:16 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:37:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:16 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Cannot resize image /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:37:16 user nova-compute[73484]: DEBUG nova.objects.instance [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lazy-loading 'migration_context' on Instance uuid b889688d-13dd-4f7b-bfef-26dc5347fd6e {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:37:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:37:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Ensure instance console log exists: /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:37:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:17 user nova-compute[73484]: DEBUG nova.network.neutron [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Successfully created port: cd94675b-f6af-48b1-a32f-0a39549f404d {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:37:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Acquiring lock "377257a6-916e-4269-bc53-a81d8bed6bdb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Lock "377257a6-916e-4269-bc53-a81d8bed6bdb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:19 user nova-compute[73484]: DEBUG nova.compute.manager [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:37:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:19 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:37:19 user nova-compute[73484]: INFO nova.compute.claims [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Claim successful on node user
Aug 14 13:37:20 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:37:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Acquiring lock "96025e5d-7c98-4ed4-8180-7c2cdb1d65bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lock "96025e5d-7c98-4ed4-8180-7c2cdb1d65bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:20 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:37:20 user nova-compute[73484]: DEBUG nova.compute.manager [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:37:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.892s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:20 user nova-compute[73484]: DEBUG nova.compute.manager [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:37:20 user nova-compute[73484]: DEBUG nova.compute.manager [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:37:20 user nova-compute[73484]: DEBUG nova.network.neutron [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:37:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:20 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:37:20 user nova-compute[73484]: INFO nova.compute.claims [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Claim successful on node user
Aug 14 13:37:20 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:37:20 user nova-compute[73484]: DEBUG nova.compute.manager [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:37:20 user nova-compute[73484]: DEBUG nova.compute.manager [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:37:20 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:37:20 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Creating image(s)
Aug 14 13:37:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Acquiring lock "/opt/stack/data/nova/instances/377257a6-916e-4269-bc53-a81d8bed6bdb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Lock "/opt/stack/data/nova/instances/377257a6-916e-4269-bc53-a81d8bed6bdb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Lock "/opt/stack/data/nova/instances/377257a6-916e-4269-bc53-a81d8bed6bdb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.220s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG nova.policy [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e9bac745e5da4b4f9bccf6aa53c45a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd28ddec1473427ca368b92bb6fbd1df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG nova.network.neutron [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Successfully updated port: cd94675b-f6af-48b1-a32f-0a39549f404d {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.222s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/377257a6-916e-4269-bc53-a81d8bed6bdb/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Acquiring lock "refresh_cache-b889688d-13dd-4f7b-bfef-26dc5347fd6e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Acquired lock "refresh_cache-b889688d-13dd-4f7b-bfef-26dc5347fd6e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG nova.network.neutron [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG nova.compute.manager [req-78293e92-b97e-46c3-a503-137e8cea2fc4 req-2c0550e1-c7b2-4359-ab54-d0288638eab9 service nova] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Received event network-changed-cd94675b-f6af-48b1-a32f-0a39549f404d {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG nova.compute.manager [req-78293e92-b97e-46c3-a503-137e8cea2fc4 req-2c0550e1-c7b2-4359-ab54-d0288638eab9 service nova] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Refreshing instance network info cache due to event network-changed-cd94675b-f6af-48b1-a32f-0a39549f404d. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-78293e92-b97e-46c3-a503-137e8cea2fc4 req-2c0550e1-c7b2-4359-ab54-d0288638eab9 service nova] Acquiring lock "refresh_cache-b889688d-13dd-4f7b-bfef-26dc5347fd6e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/377257a6-916e-4269-bc53-a81d8bed6bdb/disk 1073741824" returned: 0 in 0.084s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.949s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.249s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Checking if we can resize image /opt/stack/data/nova/instances/377257a6-916e-4269-bc53-a81d8bed6bdb/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/377257a6-916e-4269-bc53-a81d8bed6bdb/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG nova.network.neutron [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG nova.network.neutron [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:37:21 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 14 13:37:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/377257a6-916e-4269-bc53-a81d8bed6bdb/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Cannot resize image /opt/stack/data/nova/instances/377257a6-916e-4269-bc53-a81d8bed6bdb/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG nova.objects.instance [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Lazy-loading 'migration_context' on Instance uuid 377257a6-916e-4269-bc53-a81d8bed6bdb {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Ensure instance console log exists: /opt/stack/data/nova/instances/377257a6-916e-4269-bc53-a81d8bed6bdb/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:37:21 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Creating image(s)
Aug 14 13:37:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Acquiring lock "/opt/stack/data/nova/instances/96025e5d-7c98-4ed4-8180-7c2cdb1d65bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lock "/opt/stack/data/nova/instances/96025e5d-7c98-4ed4-8180-7c2cdb1d65bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lock "/opt/stack/data/nova/instances/96025e5d-7c98-4ed4-8180-7c2cdb1d65bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Acquiring lock "42dc9dc150abdf2e807305fbee99ae173b4ed395" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lock "42dc9dc150abdf2e807305fbee99ae173b4ed395" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:22 user nova-compute[73484]: DEBUG nova.policy [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '70f1240cf6d545f7b5b99cd8a7ddb9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55f538430f3b45b9905698823d51c054', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:37:22 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42dc9dc150abdf2e807305fbee99ae173b4ed395.part --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:22 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:22 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42dc9dc150abdf2e807305fbee99ae173b4ed395.part --force-share --output=json" returned: 0 in 0.251s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:22 user nova-compute[73484]: DEBUG nova.virt.images [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] 3c91a38b-3e53-488d-af95-8276da600614 was qcow2, converting to raw {{(pid=73484) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 13:37:22 user nova-compute[73484]: DEBUG nova.privsep.utils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73484) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 13:37:22 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/42dc9dc150abdf2e807305fbee99ae173b4ed395.part /opt/stack/data/nova/instances/_base/42dc9dc150abdf2e807305fbee99ae173b4ed395.converted {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG nova.network.neutron [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Successfully created port: de0da088-b53c-4792-b764-b6c6cd9dc5a3 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/42dc9dc150abdf2e807305fbee99ae173b4ed395.part /opt/stack/data/nova/instances/_base/42dc9dc150abdf2e807305fbee99ae173b4ed395.converted" returned: 0 in 0.602s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42dc9dc150abdf2e807305fbee99ae173b4ed395.converted --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42dc9dc150abdf2e807305fbee99ae173b4ed395.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lock "42dc9dc150abdf2e807305fbee99ae173b4ed395" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.693s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42dc9dc150abdf2e807305fbee99ae173b4ed395 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG nova.network.neutron [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Updating instance_info_cache with network_info: [{"id": "cd94675b-f6af-48b1-a32f-0a39549f404d", "address": "fa:16:3e:7d:02:29", "network": {"id": "988c9059-476e-4558-8e68-3cfe68a53a09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1683768593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a95ec66f3424934bdff0335e262cc9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd94675b-f6", "ovs_interfaceid": "cd94675b-f6af-48b1-a32f-0a39549f404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Acquiring lock "7ac05f68-a20f-4a57-b990-ef0799aadc58" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lock "7ac05f68-a20f-4a57-b990-ef0799aadc58" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Releasing lock "refresh_cache-b889688d-13dd-4f7b-bfef-26dc5347fd6e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG nova.compute.manager [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Instance network_info: |[{"id": "cd94675b-f6af-48b1-a32f-0a39549f404d", "address": "fa:16:3e:7d:02:29", "network": {"id": "988c9059-476e-4558-8e68-3cfe68a53a09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1683768593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a95ec66f3424934bdff0335e262cc9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd94675b-f6", "ovs_interfaceid": "cd94675b-f6af-48b1-a32f-0a39549f404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-78293e92-b97e-46c3-a503-137e8cea2fc4 req-2c0550e1-c7b2-4359-ab54-d0288638eab9 service nova] Acquired lock "refresh_cache-b889688d-13dd-4f7b-bfef-26dc5347fd6e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG nova.network.neutron [req-78293e92-b97e-46c3-a503-137e8cea2fc4 req-2c0550e1-c7b2-4359-ab54-d0288638eab9 service nova] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Refreshing network info cache for port cd94675b-f6af-48b1-a32f-0a39549f404d {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Start _get_guest_xml network_info=[{"id": "cd94675b-f6af-48b1-a32f-0a39549f404d", "address": "fa:16:3e:7d:02:29", "network": {"id": "988c9059-476e-4558-8e68-3cfe68a53a09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1683768593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a95ec66f3424934bdff0335e262cc9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd94675b-f6", "ovs_interfaceid": "cd94675b-f6af-48b1-a32f-0a39549f404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG nova.compute.manager [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:37:23 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:37:23 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:37:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-509440637',display_name='tempest-VolumesAdminNegativeTest-server-509440637',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-509440637',id=5,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3Wz96SUnWyQVq0ihJIu2YwAhTs2Lj/ulEHdQO6NEEo6qvv2i4bzsbUOltHeuSdFluC5QPPUoTPGmJIXmapKoUEMpdadG+tuxCZ2kmwpd4rGn3FG3iQlj5vLArK27oCTQ==',key_name='tempest-keypair-1658501023',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a95ec66f3424934bdff0335e262cc9e',ramdisk_id='',reservation_id='r-f8nxg0l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-730276289',owner_user_name='tempest-VolumesAdminNegativeTest-730276289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:37:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d89860cdc284bc898c650b2a6fc3a2a',uuid=b889688d-13dd-4f7b-bfef-26dc5347fd6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd94675b-f6af-48b1-a32f-0a39549f404d", "address": "fa:16:3e:7d:02:29", "network": {"id": "988c9059-476e-4558-8e68-3cfe68a53a09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1683768593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a95ec66f3424934bdff0335e262cc9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd94675b-f6", "ovs_interfaceid": "cd94675b-f6af-48b1-a32f-0a39549f404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Converting VIF {"id": "cd94675b-f6af-48b1-a32f-0a39549f404d", "address": "fa:16:3e:7d:02:29", "network": {"id": "988c9059-476e-4558-8e68-3cfe68a53a09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1683768593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a95ec66f3424934bdff0335e262cc9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd94675b-f6", "ovs_interfaceid": "cd94675b-f6af-48b1-a32f-0a39549f404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:02:29,bridge_name='br-int',has_traffic_filtering=True,id=cd94675b-f6af-48b1-a32f-0a39549f404d,network=Network(988c9059-476e-4558-8e68-3cfe68a53a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd94675b-f6') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG nova.objects.instance [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lazy-loading 'pci_devices' on Instance uuid b889688d-13dd-4f7b-bfef-26dc5347fd6e {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:37:23 user nova-compute[73484]:   <uuid>b889688d-13dd-4f7b-bfef-26dc5347fd6e</uuid>
Aug 14 13:37:23 user nova-compute[73484]:   <name>instance-00000005</name>
Aug 14 13:37:23 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:37:23 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:37:23 user nova-compute[73484]:   <metadata>
Aug 14 13:37:23 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:37:23 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:37:23 user nova-compute[73484]:       <nova:name>tempest-VolumesAdminNegativeTest-server-509440637</nova:name>
Aug 14 13:37:23 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:37:23</nova:creationTime>
Aug 14 13:37:23 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:37:23 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:37:23 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:37:23 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:37:23 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:37:23 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:37:23 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:37:23 user nova-compute[73484]:       <nova:owner>
Aug 14 13:37:23 user nova-compute[73484]:         <nova:user uuid="6d89860cdc284bc898c650b2a6fc3a2a">tempest-VolumesAdminNegativeTest-730276289-project-member</nova:user>
Aug 14 13:37:23 user nova-compute[73484]:         <nova:project uuid="6a95ec66f3424934bdff0335e262cc9e">tempest-VolumesAdminNegativeTest-730276289</nova:project>
Aug 14 13:37:23 user nova-compute[73484]:       </nova:owner>
Aug 14 13:37:23 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:37:23 user nova-compute[73484]:       <nova:ports>
Aug 14 13:37:23 user nova-compute[73484]:         <nova:port uuid="cd94675b-f6af-48b1-a32f-0a39549f404d">
Aug 14 13:37:23 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 13:37:23 user nova-compute[73484]:         </nova:port>
Aug 14 13:37:23 user nova-compute[73484]:       </nova:ports>
Aug 14 13:37:23 user nova-compute[73484]:     </nova:instance>
Aug 14 13:37:23 user nova-compute[73484]:   </metadata>
Aug 14 13:37:23 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:37:23 user nova-compute[73484]:     <system>
Aug 14 13:37:23 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:37:23 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:37:23 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:37:23 user nova-compute[73484]:       <entry name="serial">b889688d-13dd-4f7b-bfef-26dc5347fd6e</entry>
Aug 14 13:37:23 user nova-compute[73484]:       <entry name="uuid">b889688d-13dd-4f7b-bfef-26dc5347fd6e</entry>
Aug 14 13:37:23 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:37:23 user nova-compute[73484]:     </system>
Aug 14 13:37:23 user nova-compute[73484]:   </sysinfo>
Aug 14 13:37:23 user nova-compute[73484]:   <os>
Aug 14 13:37:23 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:37:23 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:37:23 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:37:23 user nova-compute[73484]:   </os>
Aug 14 13:37:23 user nova-compute[73484]:   <features>
Aug 14 13:37:23 user nova-compute[73484]:     <acpi/>
Aug 14 13:37:23 user nova-compute[73484]:     <apic/>
Aug 14 13:37:23 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:37:23 user nova-compute[73484]:   </features>
Aug 14 13:37:23 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:37:23 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:37:23 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:37:23 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:37:23 user nova-compute[73484]:   </clock>
Aug 14 13:37:23 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:37:23 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:37:23 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:37:23 user nova-compute[73484]:   </cpu>
Aug 14 13:37:23 user nova-compute[73484]:   <devices>
Aug 14 13:37:23 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:37:23 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:37:23 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk"/>
Aug 14 13:37:23 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:37:23 user nova-compute[73484]:     </disk>
Aug 14 13:37:23 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:37:23 user nova-compute[73484]:       <mac address="fa:16:3e:7d:02:29"/>
Aug 14 13:37:23 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:37:23 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:37:23 user nova-compute[73484]:       <target dev="tapcd94675b-f6"/>
Aug 14 13:37:23 user nova-compute[73484]:     </interface>
Aug 14 13:37:23 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:37:23 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/console.log" append="off"/>
Aug 14 13:37:23 user nova-compute[73484]:     </serial>
Aug 14 13:37:23 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:37:23 user nova-compute[73484]:     <video>
Aug 14 13:37:23 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:37:23 user nova-compute[73484]:     </video>
Aug 14 13:37:23 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:37:23 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:37:23 user nova-compute[73484]:     </rng>
Aug 14 13:37:23 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:37:23 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:37:23 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:37:23 user nova-compute[73484]:     </memballoon>
Aug 14 13:37:23 user nova-compute[73484]:   </devices>
Aug 14 13:37:23 user nova-compute[73484]: </domain>
Aug 14 13:37:23 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-509440637',display_name='tempest-VolumesAdminNegativeTest-server-509440637',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-509440637',id=5,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3Wz96SUnWyQVq0ihJIu2YwAhTs2Lj/ulEHdQO6NEEo6qvv2i4bzsbUOltHeuSdFluC5QPPUoTPGmJIXmapKoUEMpdadG+tuxCZ2kmwpd4rGn3FG3iQlj5vLArK27oCTQ==',key_name='tempest-keypair-1658501023',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a95ec66f3424934bdff0335e262cc9e',ramdisk_id='',reservation_id='r-f8nxg0l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-730276289',owner_user_name='tempest-VolumesAdminNegativeTest-730276289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:37:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d89860cdc284bc898c650b2a6fc3a2a',uuid=b889688d-13dd-4f7b-bfef-26dc5347fd6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd94675b-f6af-48b1-a32f-0a39549f404d", "address": "fa:16:3e:7d:02:29", "network": {"id": "988c9059-476e-4558-8e68-3cfe68a53a09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1683768593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a95ec66f3424934bdff0335e262cc9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd94675b-f6", "ovs_interfaceid": "cd94675b-f6af-48b1-a32f-0a39549f404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Converting VIF {"id": "cd94675b-f6af-48b1-a32f-0a39549f404d", "address": "fa:16:3e:7d:02:29", "network": {"id": "988c9059-476e-4558-8e68-3cfe68a53a09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1683768593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a95ec66f3424934bdff0335e262cc9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd94675b-f6", "ovs_interfaceid": "cd94675b-f6af-48b1-a32f-0a39549f404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:02:29,bridge_name='br-int',has_traffic_filtering=True,id=cd94675b-f6af-48b1-a32f-0a39549f404d,network=Network(988c9059-476e-4558-8e68-3cfe68a53a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd94675b-f6') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG os_vif [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:02:29,bridge_name='br-int',has_traffic_filtering=True,id=cd94675b-f6af-48b1-a32f-0a39549f404d,network=Network(988c9059-476e-4558-8e68-3cfe68a53a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd94675b-f6') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42dc9dc150abdf2e807305fbee99ae173b4ed395 --force-share --output=json" returned: 0 in 0.227s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd94675b-f6, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcd94675b-f6, col_values=(('external_ids', {'iface-id': 'cd94675b-f6af-48b1-a32f-0a39549f404d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:02:29', 'vm-uuid': 'b889688d-13dd-4f7b-bfef-26dc5347fd6e'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Acquiring lock "42dc9dc150abdf2e807305fbee99ae173b4ed395" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lock "42dc9dc150abdf2e807305fbee99ae173b4ed395" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42dc9dc150abdf2e807305fbee99ae173b4ed395 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:37:23 user nova-compute[73484]: INFO os_vif [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:02:29,bridge_name='br-int',has_traffic_filtering=True,id=cd94675b-f6af-48b1-a32f-0a39549f404d,network=Network(988c9059-476e-4558-8e68-3cfe68a53a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd94675b-f6')
Aug 14 13:37:23 user nova-compute[73484]: DEBUG nova.network.neutron [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Successfully created port: 16674c9f-fc44-461d-ac6b-1a7239360f06 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:37:24 user nova-compute[73484]: INFO nova.compute.claims [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Claim successful on node user
Aug 14 13:37:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] No VIF found with MAC fa:16:3e:7d:02:29, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42dc9dc150abdf2e807305fbee99ae173b4ed395 --force-share --output=json" returned: 0 in 0.241s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/42dc9dc150abdf2e807305fbee99ae173b4ed395,backing_fmt=raw /opt/stack/data/nova/instances/96025e5d-7c98-4ed4-8180-7c2cdb1d65bf/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/42dc9dc150abdf2e807305fbee99ae173b4ed395,backing_fmt=raw /opt/stack/data/nova/instances/96025e5d-7c98-4ed4-8180-7c2cdb1d65bf/disk 1073741824" returned: 0 in 0.065s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lock "42dc9dc150abdf2e807305fbee99ae173b4ed395" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42dc9dc150abdf2e807305fbee99ae173b4ed395 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG nova.network.neutron [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Successfully updated port: de0da088-b53c-4792-b764-b6c6cd9dc5a3 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Acquiring lock "refresh_cache-96025e5d-7c98-4ed4-8180-7c2cdb1d65bf" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Acquired lock "refresh_cache-96025e5d-7c98-4ed4-8180-7c2cdb1d65bf" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG nova.network.neutron [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG nova.compute.manager [req-75ad07b3-9ec2-4b1b-8a0a-7f4820c9a436 req-e12bcf32-7d13-4124-ba96-42926401c19e service nova] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Received event network-changed-de0da088-b53c-4792-b764-b6c6cd9dc5a3 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG nova.compute.manager [req-75ad07b3-9ec2-4b1b-8a0a-7f4820c9a436 req-e12bcf32-7d13-4124-ba96-42926401c19e service nova] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Refreshing instance network info cache due to event network-changed-de0da088-b53c-4792-b764-b6c6cd9dc5a3. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-75ad07b3-9ec2-4b1b-8a0a-7f4820c9a436 req-e12bcf32-7d13-4124-ba96-42926401c19e service nova] Acquiring lock "refresh_cache-96025e5d-7c98-4ed4-8180-7c2cdb1d65bf" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/42dc9dc150abdf2e807305fbee99ae173b4ed395 --force-share --output=json" returned: 0 in 0.268s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Checking if we can resize image /opt/stack/data/nova/instances/96025e5d-7c98-4ed4-8180-7c2cdb1d65bf/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96025e5d-7c98-4ed4-8180-7c2cdb1d65bf/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG nova.network.neutron [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.673s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG nova.compute.manager [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Acquiring lock "7348b004-4d46-4db5-a451-afd3b7476569" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "7348b004-4d46-4db5-a451-afd3b7476569" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG nova.compute.manager [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG nova.network.neutron [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96025e5d-7c98-4ed4-8180-7c2cdb1d65bf/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG nova.compute.manager [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Cannot resize image /opt/stack/data/nova/instances/96025e5d-7c98-4ed4-8180-7c2cdb1d65bf/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG nova.objects.instance [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lazy-loading 'migration_context' on Instance uuid 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:37:24 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:37:24 user nova-compute[73484]: DEBUG nova.compute.manager [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Ensure instance console log exists: /opt/stack/data/nova/instances/96025e5d-7c98-4ed4-8180-7c2cdb1d65bf/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:24 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:37:24 user nova-compute[73484]: INFO nova.compute.claims [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Claim successful on node user
Aug 14 13:37:24 user nova-compute[73484]: DEBUG nova.network.neutron [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Updating instance_info_cache with network_info: [{"id": "de0da088-b53c-4792-b764-b6c6cd9dc5a3", "address": "fa:16:3e:76:d0:d2", "network": {"id": "e557c45b-1bcb-487b-8510-0d3d31efb70e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-254555588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55f538430f3b45b9905698823d51c054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0da088-b5", "ovs_interfaceid": "de0da088-b53c-4792-b764-b6c6cd9dc5a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Releasing lock "refresh_cache-96025e5d-7c98-4ed4-8180-7c2cdb1d65bf" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.compute.manager [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Instance network_info: |[{"id": "de0da088-b53c-4792-b764-b6c6cd9dc5a3", "address": "fa:16:3e:76:d0:d2", "network": {"id": "e557c45b-1bcb-487b-8510-0d3d31efb70e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-254555588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55f538430f3b45b9905698823d51c054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0da088-b5", "ovs_interfaceid": "de0da088-b53c-4792-b764-b6c6cd9dc5a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-75ad07b3-9ec2-4b1b-8a0a-7f4820c9a436 req-e12bcf32-7d13-4124-ba96-42926401c19e service nova] Acquired lock "refresh_cache-96025e5d-7c98-4ed4-8180-7c2cdb1d65bf" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.network.neutron [req-75ad07b3-9ec2-4b1b-8a0a-7f4820c9a436 req-e12bcf32-7d13-4124-ba96-42926401c19e service nova] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Refreshing network info cache for port de0da088-b53c-4792-b764-b6c6cd9dc5a3 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Start _get_guest_xml network_info=[{"id": "de0da088-b53c-4792-b764-b6c6cd9dc5a3", "address": "fa:16:3e:76:d0:d2", "network": {"id": "e557c45b-1bcb-487b-8510-0d3d31efb70e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-254555588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55f538430f3b45b9905698823d51c054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0da088-b5", "ovs_interfaceid": "de0da088-b53c-4792-b764-b6c6cd9dc5a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:37:10Z,direct_url=<?>,disk_format='qcow2',id=3c91a38b-3e53-488d-af95-8276da600614,min_disk=0,min_ram=0,name='',owner='90dafacb391849eeb9943d3c994e7179',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:37:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/sda', 'encrypted': False, 'disk_bus': 'scsi', 'encryption_format': None, 'device_type': 'disk', 'image_id': '3c91a38b-3e53-488d-af95-8276da600614'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:37:25 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:37:25 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.compute.manager [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:37:25 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Creating image(s)
Aug 14 13:37:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ac05f68-a20f-4a57-b990-ef0799aadc58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lock "/opt/stack/data/nova/instances/7ac05f68-a20f-4a57-b990-ef0799aadc58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lock "/opt/stack/data/nova/instances/7ac05f68-a20f-4a57-b990-ef0799aadc58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.compute.manager [req-71812b97-6f60-46e4-9248-0b30b8eff7f0 req-419dedb9-bae2-4fdf-ad8c-8dd602585304 service nova] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Received event network-vif-plugged-5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-71812b97-6f60-46e4-9248-0b30b8eff7f0 req-419dedb9-bae2-4fdf-ad8c-8dd602585304 service nova] Acquiring lock "f4f7788c-fcca-47c1-b5b8-72892253982d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-71812b97-6f60-46e4-9248-0b30b8eff7f0 req-419dedb9-bae2-4fdf-ad8c-8dd602585304 service nova] Lock "f4f7788c-fcca-47c1-b5b8-72892253982d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-71812b97-6f60-46e4-9248-0b30b8eff7f0 req-419dedb9-bae2-4fdf-ad8c-8dd602585304 service nova] Lock "f4f7788c-fcca-47c1-b5b8-72892253982d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.compute.manager [req-71812b97-6f60-46e4-9248-0b30b8eff7f0 req-419dedb9-bae2-4fdf-ad8c-8dd602585304 service nova] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] No waiting events found dispatching network-vif-plugged-5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:37:25 user nova-compute[73484]: WARNING nova.compute.manager [req-71812b97-6f60-46e4-9248-0b30b8eff7f0 req-419dedb9-bae2-4fdf-ad8c-8dd602585304 service nova] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Received unexpected event network-vif-plugged-5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b for instance with vm_state active and task_state None.
Aug 14 13:37:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:37:10Z,direct_url=<?>,disk_format='qcow2',id=3c91a38b-3e53-488d-af95-8276da600614,min_disk=0,min_ram=0,name='',owner='90dafacb391849eeb9943d3c994e7179',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:37:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2123277952',display_name='tempest-AttachSCSIVolumeTestJSON-server-2123277952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2123277952',id=7,image_ref='3c91a38b-3e53-488d-af95-8276da600614',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCj17lJFfTjChU76wO5GKKieC0+TjWqX5UXQQDjKpMcf2sUOv584odaKkPi5/WM6bD/S4zNn9sG5UdZ4kXUsAA1miIvrxVXM19Gwczuk8QDucOZelKZUC+AVurpLMXkhQ==',key_name='tempest-keypair-1488820723',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55f538430f3b45b9905698823d51c054',ramdisk_id='',reservation_id='r-bkvfl88l',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3c91a38b-3e53-488d-af95-8276da600614',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-558500768',owner_user_name='tempest-AttachSCSIVolumeTestJSON-558500768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:37:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70f1240cf6d545f7b5b99cd8a7ddb9d1',uuid=96025e5d-7c98-4ed4-8180-7c2cdb1d65bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de0da088-b53c-4792-b764-b6c6cd9dc5a3", "address": "fa:16:3e:76:d0:d2", "network": {"id": "e557c45b-1bcb-487b-8510-0d3d31efb70e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-254555588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55f538430f3b45b9905698823d51c054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0da088-b5", "ovs_interfaceid": "de0da088-b53c-4792-b764-b6c6cd9dc5a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Converting VIF {"id": "de0da088-b53c-4792-b764-b6c6cd9dc5a3", "address": "fa:16:3e:76:d0:d2", "network": {"id": "e557c45b-1bcb-487b-8510-0d3d31efb70e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-254555588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55f538430f3b45b9905698823d51c054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0da088-b5", "ovs_interfaceid": "de0da088-b53c-4792-b764-b6c6cd9dc5a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:d0:d2,bridge_name='br-int',has_traffic_filtering=True,id=de0da088-b53c-4792-b764-b6c6cd9dc5a3,network=Network(e557c45b-1bcb-487b-8510-0d3d31efb70e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0da088-b5') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.objects.instance [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lazy-loading 'pci_devices' on Instance uuid 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.policy [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c17cf880b304d98bbbf47a495f09562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02feed89293147398ae749494502ca78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.network.neutron [req-78293e92-b97e-46c3-a503-137e8cea2fc4 req-2c0550e1-c7b2-4359-ab54-d0288638eab9 service nova] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Updated VIF entry in instance network info cache for port cd94675b-f6af-48b1-a32f-0a39549f404d. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.network.neutron [req-78293e92-b97e-46c3-a503-137e8cea2fc4 req-2c0550e1-c7b2-4359-ab54-d0288638eab9 service nova] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Updating instance_info_cache with network_info: [{"id": "cd94675b-f6af-48b1-a32f-0a39549f404d", "address": "fa:16:3e:7d:02:29", "network": {"id": "988c9059-476e-4558-8e68-3cfe68a53a09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1683768593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a95ec66f3424934bdff0335e262cc9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd94675b-f6", "ovs_interfaceid": "cd94675b-f6af-48b1-a32f-0a39549f404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:37:25 user nova-compute[73484]:   <uuid>96025e5d-7c98-4ed4-8180-7c2cdb1d65bf</uuid>
Aug 14 13:37:25 user nova-compute[73484]:   <name>instance-00000007</name>
Aug 14 13:37:25 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:37:25 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:37:25 user nova-compute[73484]:   <metadata>
Aug 14 13:37:25 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:37:25 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:37:25 user nova-compute[73484]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-2123277952</nova:name>
Aug 14 13:37:25 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:37:25</nova:creationTime>
Aug 14 13:37:25 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:37:25 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:37:25 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:37:25 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:37:25 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:37:25 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:37:25 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:37:25 user nova-compute[73484]:       <nova:owner>
Aug 14 13:37:25 user nova-compute[73484]:         <nova:user uuid="70f1240cf6d545f7b5b99cd8a7ddb9d1">tempest-AttachSCSIVolumeTestJSON-558500768-project-member</nova:user>
Aug 14 13:37:25 user nova-compute[73484]:         <nova:project uuid="55f538430f3b45b9905698823d51c054">tempest-AttachSCSIVolumeTestJSON-558500768</nova:project>
Aug 14 13:37:25 user nova-compute[73484]:       </nova:owner>
Aug 14 13:37:25 user nova-compute[73484]:       <nova:root type="image" uuid="3c91a38b-3e53-488d-af95-8276da600614"/>
Aug 14 13:37:25 user nova-compute[73484]:       <nova:ports>
Aug 14 13:37:25 user nova-compute[73484]:         <nova:port uuid="de0da088-b53c-4792-b764-b6c6cd9dc5a3">
Aug 14 13:37:25 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 13:37:25 user nova-compute[73484]:         </nova:port>
Aug 14 13:37:25 user nova-compute[73484]:       </nova:ports>
Aug 14 13:37:25 user nova-compute[73484]:     </nova:instance>
Aug 14 13:37:25 user nova-compute[73484]:   </metadata>
Aug 14 13:37:25 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:37:25 user nova-compute[73484]:     <system>
Aug 14 13:37:25 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:37:25 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:37:25 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:37:25 user nova-compute[73484]:       <entry name="serial">96025e5d-7c98-4ed4-8180-7c2cdb1d65bf</entry>
Aug 14 13:37:25 user nova-compute[73484]:       <entry name="uuid">96025e5d-7c98-4ed4-8180-7c2cdb1d65bf</entry>
Aug 14 13:37:25 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:37:25 user nova-compute[73484]:     </system>
Aug 14 13:37:25 user nova-compute[73484]:   </sysinfo>
Aug 14 13:37:25 user nova-compute[73484]:   <os>
Aug 14 13:37:25 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:37:25 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:37:25 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:37:25 user nova-compute[73484]:   </os>
Aug 14 13:37:25 user nova-compute[73484]:   <features>
Aug 14 13:37:25 user nova-compute[73484]:     <acpi/>
Aug 14 13:37:25 user nova-compute[73484]:     <apic/>
Aug 14 13:37:25 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:37:25 user nova-compute[73484]:   </features>
Aug 14 13:37:25 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:37:25 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:37:25 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:37:25 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:37:25 user nova-compute[73484]:   </clock>
Aug 14 13:37:25 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:37:25 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:37:25 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:37:25 user nova-compute[73484]:   </cpu>
Aug 14 13:37:25 user nova-compute[73484]:   <devices>
Aug 14 13:37:25 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:37:25 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:37:25 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/96025e5d-7c98-4ed4-8180-7c2cdb1d65bf/disk"/>
Aug 14 13:37:25 user nova-compute[73484]:       <target dev="sda" bus="scsi"/>
Aug 14 13:37:25 user nova-compute[73484]:       <address type="drive" controller="0" unit="0"/>
Aug 14 13:37:25 user nova-compute[73484]:     </disk>
Aug 14 13:37:25 user nova-compute[73484]:     <disk type="file" device="cdrom">
Aug 14 13:37:25 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 13:37:25 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/96025e5d-7c98-4ed4-8180-7c2cdb1d65bf/disk.config"/>
Aug 14 13:37:25 user nova-compute[73484]:       <target dev="sdb" bus="scsi"/>
Aug 14 13:37:25 user nova-compute[73484]:       <address type="drive" controller="0" unit="1"/>
Aug 14 13:37:25 user nova-compute[73484]:     </disk>
Aug 14 13:37:25 user nova-compute[73484]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 14 13:37:25 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:37:25 user nova-compute[73484]:       <mac address="fa:16:3e:76:d0:d2"/>
Aug 14 13:37:25 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:37:25 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:37:25 user nova-compute[73484]:       <target dev="tapde0da088-b5"/>
Aug 14 13:37:25 user nova-compute[73484]:     </interface>
Aug 14 13:37:25 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:37:25 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/96025e5d-7c98-4ed4-8180-7c2cdb1d65bf/console.log" append="off"/>
Aug 14 13:37:25 user nova-compute[73484]:     </serial>
Aug 14 13:37:25 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:37:25 user nova-compute[73484]:     <video>
Aug 14 13:37:25 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:37:25 user nova-compute[73484]:     </video>
Aug 14 13:37:25 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:37:25 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:37:25 user nova-compute[73484]:     </rng>
Aug 14 13:37:25 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:37:25 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:37:25 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:37:25 user nova-compute[73484]:     </memballoon>
Aug 14 13:37:25 user nova-compute[73484]:   </devices>
Aug 14 13:37:25 user nova-compute[73484]: </domain>
Aug 14 13:37:25 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2123277952',display_name='tempest-AttachSCSIVolumeTestJSON-server-2123277952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2123277952',id=7,image_ref='3c91a38b-3e53-488d-af95-8276da600614',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCj17lJFfTjChU76wO5GKKieC0+TjWqX5UXQQDjKpMcf2sUOv584odaKkPi5/WM6bD/S4zNn9sG5UdZ4kXUsAA1miIvrxVXM19Gwczuk8QDucOZelKZUC+AVurpLMXkhQ==',key_name='tempest-keypair-1488820723',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55f538430f3b45b9905698823d51c054',ramdisk_id='',reservation_id='r-bkvfl88l',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3c91a38b-3e53-488d-af95-8276da600614',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-558500768',owner_user_name='tempest-AttachSCSIVolumeTestJSON-558500768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:37:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70f1240cf6d545f7b5b99cd8a7ddb9d1',uuid=96025e5d-7c98-4ed4-8180-7c2cdb1d65bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de0da088-b53c-4792-b764-b6c6cd9dc5a3", "address": "fa:16:3e:76:d0:d2", "network": {"id": "e557c45b-1bcb-487b-8510-0d3d31efb70e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-254555588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55f538430f3b45b9905698823d51c054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0da088-b5", "ovs_interfaceid": "de0da088-b53c-4792-b764-b6c6cd9dc5a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Converting VIF {"id": "de0da088-b53c-4792-b764-b6c6cd9dc5a3", "address": "fa:16:3e:76:d0:d2", "network": {"id": "e557c45b-1bcb-487b-8510-0d3d31efb70e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-254555588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55f538430f3b45b9905698823d51c054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0da088-b5", "ovs_interfaceid": "de0da088-b53c-4792-b764-b6c6cd9dc5a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:d0:d2,bridge_name='br-int',has_traffic_filtering=True,id=de0da088-b53c-4792-b764-b6c6cd9dc5a3,network=Network(e557c45b-1bcb-487b-8510-0d3d31efb70e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0da088-b5') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG os_vif [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:d0:d2,bridge_name='br-int',has_traffic_filtering=True,id=de0da088-b53c-4792-b764-b6c6cd9dc5a3,network=Network(e557c45b-1bcb-487b-8510-0d3d31efb70e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0da088-b5') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-78293e92-b97e-46c3-a503-137e8cea2fc4 req-2c0550e1-c7b2-4359-ab54-d0288638eab9 service nova] Releasing lock "refresh_cache-b889688d-13dd-4f7b-bfef-26dc5347fd6e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde0da088-b5, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapde0da088-b5, col_values=(('external_ids', {'iface-id': 'de0da088-b53c-4792-b764-b6c6cd9dc5a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:d0:d2', 'vm-uuid': '96025e5d-7c98-4ed4-8180-7c2cdb1d65bf'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:25 user nova-compute[73484]: INFO os_vif [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:d0:d2,bridge_name='br-int',has_traffic_filtering=True,id=de0da088-b53c-4792-b764-b6c6cd9dc5a3,network=Network(e557c45b-1bcb-487b-8510-0d3d31efb70e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0da088-b5')
Aug 14 13:37:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.252s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] No BDM found with device name sda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] No VIF found with MAC fa:16:3e:76:d0:d2, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:37:25 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Using config drive
Aug 14 13:37:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.240s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/7ac05f68-a20f-4a57-b990-ef0799aadc58/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/7ac05f68-a20f-4a57-b990-ef0799aadc58/disk 1073741824" returned: 0 in 0.084s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.329s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.network.neutron [req-75ad07b3-9ec2-4b1b-8a0a-7f4820c9a436 req-e12bcf32-7d13-4124-ba96-42926401c19e service nova] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Updated VIF entry in instance network info cache for port de0da088-b53c-4792-b764-b6c6cd9dc5a3. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.network.neutron [req-75ad07b3-9ec2-4b1b-8a0a-7f4820c9a436 req-e12bcf32-7d13-4124-ba96-42926401c19e service nova] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Updating instance_info_cache with network_info: [{"id": "de0da088-b53c-4792-b764-b6c6cd9dc5a3", "address": "fa:16:3e:76:d0:d2", "network": {"id": "e557c45b-1bcb-487b-8510-0d3d31efb70e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-254555588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55f538430f3b45b9905698823d51c054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0da088-b5", "ovs_interfaceid": "de0da088-b53c-4792-b764-b6c6cd9dc5a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-75ad07b3-9ec2-4b1b-8a0a-7f4820c9a436 req-e12bcf32-7d13-4124-ba96-42926401c19e service nova] Releasing lock "refresh_cache-96025e5d-7c98-4ed4-8180-7c2cdb1d65bf" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.955s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.compute.manager [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.257s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ac05f68-a20f-4a57-b990-ef0799aadc58/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:37:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac05f68-a20f-4a57-b990-ef0799aadc58/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:26 user nova-compute[73484]: DEBUG nova.compute.manager [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:37:26 user nova-compute[73484]: DEBUG nova.network.neutron [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:37:26 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:37:26 user nova-compute[73484]: DEBUG nova.compute.manager [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:37:26 user nova-compute[73484]: DEBUG nova.policy [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '602233ac777c42ac8f97536c706d5fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900fe242d672495d832feee598acf991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:37:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac05f68-a20f-4a57-b990-ef0799aadc58/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:26 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Cannot resize image /opt/stack/data/nova/instances/7ac05f68-a20f-4a57-b990-ef0799aadc58/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:37:26 user nova-compute[73484]: DEBUG nova.objects.instance [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lazy-loading 'migration_context' on Instance uuid 7ac05f68-a20f-4a57-b990-ef0799aadc58 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:37:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:37:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Ensure instance console log exists: /opt/stack/data/nova/instances/7ac05f68-a20f-4a57-b990-ef0799aadc58/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:37:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:26 user nova-compute[73484]: DEBUG nova.compute.manager [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:37:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:37:26 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Creating image(s)
Aug 14 13:37:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Acquiring lock "/opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "/opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "/opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.251s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.204s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/disk 1073741824" returned: 0 in 0.081s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:26 user nova-compute[73484]: DEBUG nova.network.neutron [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Successfully created port: 2eb5bc00-16a1-43cd-ac1f-db1d191fba75 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:37:27 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.204s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:27 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:37:27 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:27 user nova-compute[73484]: DEBUG nova.compute.manager [req-ee8c33d5-ec0d-4b7e-aba1-fc5623253a1a req-c4f02996-fc8e-4024-b2c2-be560442e8d4 service nova] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Received event network-vif-plugged-5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:37:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ee8c33d5-ec0d-4b7e-aba1-fc5623253a1a req-c4f02996-fc8e-4024-b2c2-be560442e8d4 service nova] Acquiring lock "f4f7788c-fcca-47c1-b5b8-72892253982d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ee8c33d5-ec0d-4b7e-aba1-fc5623253a1a req-c4f02996-fc8e-4024-b2c2-be560442e8d4 service nova] Lock "f4f7788c-fcca-47c1-b5b8-72892253982d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ee8c33d5-ec0d-4b7e-aba1-fc5623253a1a req-c4f02996-fc8e-4024-b2c2-be560442e8d4 service nova] Lock "f4f7788c-fcca-47c1-b5b8-72892253982d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:27 user nova-compute[73484]: DEBUG nova.compute.manager [req-ee8c33d5-ec0d-4b7e-aba1-fc5623253a1a req-c4f02996-fc8e-4024-b2c2-be560442e8d4 service nova] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] No waiting events found dispatching network-vif-plugged-5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:37:27 user nova-compute[73484]: WARNING nova.compute.manager [req-ee8c33d5-ec0d-4b7e-aba1-fc5623253a1a req-c4f02996-fc8e-4024-b2c2-be560442e8d4 service nova] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Received unexpected event network-vif-plugged-5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b for instance with vm_state active and task_state None.
Aug 14 13:37:27 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:27 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Cannot resize image /opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:37:27 user nova-compute[73484]: DEBUG nova.objects.instance [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lazy-loading 'migration_context' on Instance uuid 7348b004-4d46-4db5-a451-afd3b7476569 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:37:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:37:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Ensure instance console log exists: /opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:37:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:27 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Creating config drive at /opt/stack/data/nova/instances/96025e5d-7c98-4ed4-8180-7c2cdb1d65bf/disk.config
Aug 14 13:37:27 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/96025e5d-7c98-4ed4-8180-7c2cdb1d65bf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmps3gcxphi {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:27 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/96025e5d-7c98-4ed4-8180-7c2cdb1d65bf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmps3gcxphi" returned: 0 in 0.069s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:27 user nova-compute[73484]: DEBUG nova.network.neutron [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Successfully updated port: 2eb5bc00-16a1-43cd-ac1f-db1d191fba75 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:37:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Acquiring lock "refresh_cache-7348b004-4d46-4db5-a451-afd3b7476569" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:37:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Acquired lock "refresh_cache-7348b004-4d46-4db5-a451-afd3b7476569" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:37:27 user nova-compute[73484]: DEBUG nova.network.neutron [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:37:27 user nova-compute[73484]: DEBUG nova.compute.manager [req-6b25cfff-7c77-4bcc-9eb2-0c77498ad0b1 req-db04ce82-4426-4a62-ba45-69846f49a5f7 service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Received event network-changed-2eb5bc00-16a1-43cd-ac1f-db1d191fba75 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:37:27 user nova-compute[73484]: DEBUG nova.compute.manager [req-6b25cfff-7c77-4bcc-9eb2-0c77498ad0b1 req-db04ce82-4426-4a62-ba45-69846f49a5f7 service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Refreshing instance network info cache due to event network-changed-2eb5bc00-16a1-43cd-ac1f-db1d191fba75. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:37:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6b25cfff-7c77-4bcc-9eb2-0c77498ad0b1 req-db04ce82-4426-4a62-ba45-69846f49a5f7 service nova] Acquiring lock "refresh_cache-7348b004-4d46-4db5-a451-afd3b7476569" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:37:27 user nova-compute[73484]: DEBUG nova.network.neutron [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.network.neutron [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Successfully updated port: 16674c9f-fc44-461d-ac6b-1a7239360f06 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Acquiring lock "refresh_cache-377257a6-916e-4269-bc53-a81d8bed6bdb" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Acquired lock "refresh_cache-377257a6-916e-4269-bc53-a81d8bed6bdb" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.network.neutron [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.compute.manager [req-6c18f8dd-8779-4191-b8e8-013192763f2f req-c092db09-ef89-4042-aa91-16d4627b11ae service nova] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Received event network-changed-16674c9f-fc44-461d-ac6b-1a7239360f06 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.compute.manager [req-6c18f8dd-8779-4191-b8e8-013192763f2f req-c092db09-ef89-4042-aa91-16d4627b11ae service nova] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Refreshing instance network info cache due to event network-changed-16674c9f-fc44-461d-ac6b-1a7239360f06. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6c18f8dd-8779-4191-b8e8-013192763f2f req-c092db09-ef89-4042-aa91-16d4627b11ae service nova] Acquiring lock "refresh_cache-377257a6-916e-4269-bc53-a81d8bed6bdb" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.network.neutron [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.network.neutron [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Updating instance_info_cache with network_info: [{"id": "2eb5bc00-16a1-43cd-ac1f-db1d191fba75", "address": "fa:16:3e:a3:34:4e", "network": {"id": "06967e28-4529-4bb4-913e-406da0cbf817", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-360793833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "900fe242d672495d832feee598acf991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb5bc00-16", "ovs_interfaceid": "2eb5bc00-16a1-43cd-ac1f-db1d191fba75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020248.3341908, b889688d-13dd-4f7b-bfef-26dc5347fd6e => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:37:28 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] VM Resumed (Lifecycle Event)
Aug 14 13:37:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Releasing lock "refresh_cache-7348b004-4d46-4db5-a451-afd3b7476569" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Instance network_info: |[{"id": "2eb5bc00-16a1-43cd-ac1f-db1d191fba75", "address": "fa:16:3e:a3:34:4e", "network": {"id": "06967e28-4529-4bb4-913e-406da0cbf817", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-360793833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "900fe242d672495d832feee598acf991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb5bc00-16", "ovs_interfaceid": "2eb5bc00-16a1-43cd-ac1f-db1d191fba75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6b25cfff-7c77-4bcc-9eb2-0c77498ad0b1 req-db04ce82-4426-4a62-ba45-69846f49a5f7 service nova] Acquired lock "refresh_cache-7348b004-4d46-4db5-a451-afd3b7476569" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.network.neutron [req-6b25cfff-7c77-4bcc-9eb2-0c77498ad0b1 req-db04ce82-4426-4a62-ba45-69846f49a5f7 service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Refreshing network info cache for port 2eb5bc00-16a1-43cd-ac1f-db1d191fba75 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Start _get_guest_xml network_info=[{"id": "2eb5bc00-16a1-43cd-ac1f-db1d191fba75", "address": "fa:16:3e:a3:34:4e", "network": {"id": "06967e28-4529-4bb4-913e-406da0cbf817", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-360793833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "900fe242d672495d832feee598acf991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb5bc00-16", "ovs_interfaceid": "2eb5bc00-16a1-43cd-ac1f-db1d191fba75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:37:28 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Instance spawned successfully.
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:37:28 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:37:28 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:37:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-522186817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-522186817',id=9,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiK6LkV4LYXJ9k8WiSdM3r6iHP8qN1XXbA8EbfSGkzqKZ1oy8APH01wj6TnPRn+92njmmJyEDjXb8n2RsiEiMAkKvCvz4+a7zm6gB5yZrCVjYB/hhRdrNwSW43XY6YGlg==',key_name='tempest-keypair-2063229418',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='900fe242d672495d832feee598acf991',ramdisk_id='',reservation_id='r-smdsx10g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-696464863',owner_user_name='tempest-TaggedAttachmentsTest-696464863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:37:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='602233ac777c42ac8f97536c706d5fd8',uuid=7348b004-4d46-4db5-a451-afd3b7476569,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eb5bc00-16a1-43cd-ac1f-db1d191fba75", "address": "fa:16:3e:a3:34:4e", "network": {"id": "06967e28-4529-4bb4-913e-406da0cbf817", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-360793833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "900fe242d672495d832feee598acf991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb5bc00-16", "ovs_interfaceid": "2eb5bc00-16a1-43cd-ac1f-db1d191fba75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Converting VIF {"id": "2eb5bc00-16a1-43cd-ac1f-db1d191fba75", "address": "fa:16:3e:a3:34:4e", "network": {"id": "06967e28-4529-4bb4-913e-406da0cbf817", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-360793833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "900fe242d672495d832feee598acf991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb5bc00-16", "ovs_interfaceid": "2eb5bc00-16a1-43cd-ac1f-db1d191fba75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:34:4e,bridge_name='br-int',has_traffic_filtering=True,id=2eb5bc00-16a1-43cd-ac1f-db1d191fba75,network=Network(06967e28-4529-4bb4-913e-406da0cbf817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb5bc00-16') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.objects.instance [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lazy-loading 'pci_devices' on Instance uuid 7348b004-4d46-4db5-a451-afd3b7476569 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:37:28 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020248.346117, b889688d-13dd-4f7b-bfef-26dc5347fd6e => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:37:28 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] VM Started (Lifecycle Event)
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:37:28 user nova-compute[73484]:   <uuid>7348b004-4d46-4db5-a451-afd3b7476569</uuid>
Aug 14 13:37:28 user nova-compute[73484]:   <name>instance-00000009</name>
Aug 14 13:37:28 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:37:28 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:37:28 user nova-compute[73484]:   <metadata>
Aug 14 13:37:28 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:37:28 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:37:28 user nova-compute[73484]:       <nova:name>tempest-device-tagging-server-522186817</nova:name>
Aug 14 13:37:28 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:37:28</nova:creationTime>
Aug 14 13:37:28 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:37:28 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:37:28 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:37:28 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:37:28 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:37:28 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:37:28 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:37:28 user nova-compute[73484]:       <nova:owner>
Aug 14 13:37:28 user nova-compute[73484]:         <nova:user uuid="602233ac777c42ac8f97536c706d5fd8">tempest-TaggedAttachmentsTest-696464863-project-member</nova:user>
Aug 14 13:37:28 user nova-compute[73484]:         <nova:project uuid="900fe242d672495d832feee598acf991">tempest-TaggedAttachmentsTest-696464863</nova:project>
Aug 14 13:37:28 user nova-compute[73484]:       </nova:owner>
Aug 14 13:37:28 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:37:28 user nova-compute[73484]:       <nova:ports>
Aug 14 13:37:28 user nova-compute[73484]:         <nova:port uuid="2eb5bc00-16a1-43cd-ac1f-db1d191fba75">
Aug 14 13:37:28 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 13:37:28 user nova-compute[73484]:         </nova:port>
Aug 14 13:37:28 user nova-compute[73484]:       </nova:ports>
Aug 14 13:37:28 user nova-compute[73484]:     </nova:instance>
Aug 14 13:37:28 user nova-compute[73484]:   </metadata>
Aug 14 13:37:28 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:37:28 user nova-compute[73484]:     <system>
Aug 14 13:37:28 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:37:28 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:37:28 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:37:28 user nova-compute[73484]:       <entry name="serial">7348b004-4d46-4db5-a451-afd3b7476569</entry>
Aug 14 13:37:28 user nova-compute[73484]:       <entry name="uuid">7348b004-4d46-4db5-a451-afd3b7476569</entry>
Aug 14 13:37:28 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:37:28 user nova-compute[73484]:     </system>
Aug 14 13:37:28 user nova-compute[73484]:   </sysinfo>
Aug 14 13:37:28 user nova-compute[73484]:   <os>
Aug 14 13:37:28 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:37:28 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:37:28 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:37:28 user nova-compute[73484]:   </os>
Aug 14 13:37:28 user nova-compute[73484]:   <features>
Aug 14 13:37:28 user nova-compute[73484]:     <acpi/>
Aug 14 13:37:28 user nova-compute[73484]:     <apic/>
Aug 14 13:37:28 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:37:28 user nova-compute[73484]:   </features>
Aug 14 13:37:28 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:37:28 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:37:28 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:37:28 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:37:28 user nova-compute[73484]:   </clock>
Aug 14 13:37:28 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:37:28 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:37:28 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:37:28 user nova-compute[73484]:   </cpu>
Aug 14 13:37:28 user nova-compute[73484]:   <devices>
Aug 14 13:37:28 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:37:28 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:37:28 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/disk"/>
Aug 14 13:37:28 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:37:28 user nova-compute[73484]:     </disk>
Aug 14 13:37:28 user nova-compute[73484]:     <disk type="file" device="cdrom">
Aug 14 13:37:28 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 13:37:28 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/disk.config"/>
Aug 14 13:37:28 user nova-compute[73484]:       <target dev="hda" bus="ide"/>
Aug 14 13:37:28 user nova-compute[73484]:     </disk>
Aug 14 13:37:28 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:37:28 user nova-compute[73484]:       <mac address="fa:16:3e:a3:34:4e"/>
Aug 14 13:37:28 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:37:28 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:37:28 user nova-compute[73484]:       <target dev="tap2eb5bc00-16"/>
Aug 14 13:37:28 user nova-compute[73484]:     </interface>
Aug 14 13:37:28 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:37:28 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/console.log" append="off"/>
Aug 14 13:37:28 user nova-compute[73484]:     </serial>
Aug 14 13:37:28 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:37:28 user nova-compute[73484]:     <video>
Aug 14 13:37:28 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:37:28 user nova-compute[73484]:     </video>
Aug 14 13:37:28 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:37:28 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:37:28 user nova-compute[73484]:     </rng>
Aug 14 13:37:28 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:37:28 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:37:28 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:37:28 user nova-compute[73484]:     </memballoon>
Aug 14 13:37:28 user nova-compute[73484]:   </devices>
Aug 14 13:37:28 user nova-compute[73484]: </domain>
Aug 14 13:37:28 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:37:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-522186817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-522186817',id=9,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiK6LkV4LYXJ9k8WiSdM3r6iHP8qN1XXbA8EbfSGkzqKZ1oy8APH01wj6TnPRn+92njmmJyEDjXb8n2RsiEiMAkKvCvz4+a7zm6gB5yZrCVjYB/hhRdrNwSW43XY6YGlg==',key_name='tempest-keypair-2063229418',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='900fe242d672495d832feee598acf991',ramdisk_id='',reservation_id='r-smdsx10g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-696464863',owner_user_name='tempest-TaggedAttachmentsTest-696464863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:37:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='602233ac777c42ac8f97536c706d5fd8',uuid=7348b004-4d46-4db5-a451-afd3b7476569,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eb5bc00-16a1-43cd-ac1f-db1d191fba75", "address": "fa:16:3e:a3:34:4e", "network": {"id": "06967e28-4529-4bb4-913e-406da0cbf817", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-360793833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "900fe242d672495d832feee598acf991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb5bc00-16", "ovs_interfaceid": "2eb5bc00-16a1-43cd-ac1f-db1d191fba75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Converting VIF {"id": "2eb5bc00-16a1-43cd-ac1f-db1d191fba75", "address": "fa:16:3e:a3:34:4e", "network": {"id": "06967e28-4529-4bb4-913e-406da0cbf817", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-360793833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "900fe242d672495d832feee598acf991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb5bc00-16", "ovs_interfaceid": "2eb5bc00-16a1-43cd-ac1f-db1d191fba75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:34:4e,bridge_name='br-int',has_traffic_filtering=True,id=2eb5bc00-16a1-43cd-ac1f-db1d191fba75,network=Network(06967e28-4529-4bb4-913e-406da0cbf817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb5bc00-16') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG os_vif [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:34:4e,bridge_name='br-int',has_traffic_filtering=True,id=2eb5bc00-16a1-43cd-ac1f-db1d191fba75,network=Network(06967e28-4529-4bb4-913e-406da0cbf817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb5bc00-16') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:37:28 user nova-compute[73484]: INFO nova.compute.manager [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Took 13.38 seconds to spawn the instance on the hypervisor.
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2eb5bc00-16, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2eb5bc00-16, col_values=(('external_ids', {'iface-id': '2eb5bc00-16a1-43cd-ac1f-db1d191fba75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:34:4e', 'vm-uuid': '7348b004-4d46-4db5-a451-afd3b7476569'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:28 user nova-compute[73484]: INFO os_vif [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:34:4e,bridge_name='br-int',has_traffic_filtering=True,id=2eb5bc00-16a1-43cd-ac1f-db1d191fba75,network=Network(06967e28-4529-4bb4-913e-406da0cbf817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb5bc00-16')
Aug 14 13:37:28 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] No BDM found with device name hda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] No VIF found with MAC fa:16:3e:a3:34:4e, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:37:28 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Using config drive
Aug 14 13:37:28 user nova-compute[73484]: INFO nova.compute.manager [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Took 14.97 seconds to build instance.
Aug 14 13:37:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5ccc8286-786a-40a1-af76-288601f56786 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "b889688d-13dd-4f7b-bfef-26dc5347fd6e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.194s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Cleaning up deleted instances {{(pid=73484) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] There are 0 instances to clean {{(pid=73484) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73484) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 13:37:28 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:37:29 user nova-compute[73484]: DEBUG nova.network.neutron [req-6b25cfff-7c77-4bcc-9eb2-0c77498ad0b1 req-db04ce82-4426-4a62-ba45-69846f49a5f7 service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Updated VIF entry in instance network info cache for port 2eb5bc00-16a1-43cd-ac1f-db1d191fba75. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:37:29 user nova-compute[73484]: DEBUG nova.network.neutron [req-6b25cfff-7c77-4bcc-9eb2-0c77498ad0b1 req-db04ce82-4426-4a62-ba45-69846f49a5f7 service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Updating instance_info_cache with network_info: [{"id": "2eb5bc00-16a1-43cd-ac1f-db1d191fba75", "address": "fa:16:3e:a3:34:4e", "network": {"id": "06967e28-4529-4bb4-913e-406da0cbf817", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-360793833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "900fe242d672495d832feee598acf991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb5bc00-16", "ovs_interfaceid": "2eb5bc00-16a1-43cd-ac1f-db1d191fba75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:37:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6b25cfff-7c77-4bcc-9eb2-0c77498ad0b1 req-db04ce82-4426-4a62-ba45-69846f49a5f7 service nova] Releasing lock "refresh_cache-7348b004-4d46-4db5-a451-afd3b7476569" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:37:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:29 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Creating config drive at /opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/disk.config
Aug 14 13:37:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9hr8in99 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9hr8in99" returned: 0 in 0.089s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.network.neutron [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Successfully created port: 81a13981-b50f-4f1b-ac18-d4eea5f141fd {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.network.neutron [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Updating instance_info_cache with network_info: [{"id": "16674c9f-fc44-461d-ac6b-1a7239360f06", "address": "fa:16:3e:3e:15:05", "network": {"id": "4d15ff21-bb7f-4f6f-a5cb-7a77b1fd50a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-471876759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd28ddec1473427ca368b92bb6fbd1df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16674c9f-fc", "ovs_interfaceid": "16674c9f-fc44-461d-ac6b-1a7239360f06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Releasing lock "refresh_cache-377257a6-916e-4269-bc53-a81d8bed6bdb" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.compute.manager [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Instance network_info: |[{"id": "16674c9f-fc44-461d-ac6b-1a7239360f06", "address": "fa:16:3e:3e:15:05", "network": {"id": "4d15ff21-bb7f-4f6f-a5cb-7a77b1fd50a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-471876759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd28ddec1473427ca368b92bb6fbd1df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16674c9f-fc", "ovs_interfaceid": "16674c9f-fc44-461d-ac6b-1a7239360f06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6c18f8dd-8779-4191-b8e8-013192763f2f req-c092db09-ef89-4042-aa91-16d4627b11ae service nova] Acquired lock "refresh_cache-377257a6-916e-4269-bc53-a81d8bed6bdb" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.network.neutron [req-6c18f8dd-8779-4191-b8e8-013192763f2f req-c092db09-ef89-4042-aa91-16d4627b11ae service nova] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Refreshing network info cache for port 16674c9f-fc44-461d-ac6b-1a7239360f06 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Start _get_guest_xml network_info=[{"id": "16674c9f-fc44-461d-ac6b-1a7239360f06", "address": "fa:16:3e:3e:15:05", "network": {"id": "4d15ff21-bb7f-4f6f-a5cb-7a77b1fd50a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-471876759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd28ddec1473427ca368b92bb6fbd1df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16674c9f-fc", "ovs_interfaceid": "16674c9f-fc44-461d-ac6b-1a7239360f06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:37:30 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:37:30 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-903355159',display_name='tempest-VolumesAssistedSnapshotsTest-server-903355159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-903355159',id=6,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKwYW5kfSCK4Ikb6IEBR2A3Wi1QOLjgj/lI8Hw/M9tXCiZlSo1wMcAqx5xKdtrFuWIifz3dnwbltE0WvK5zYBMn3UEmy5mQ+rldU+mxzofxZ/aWUIU19+NmRei+5ZmwaA==',key_name='tempest-keypair-660594573',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd28ddec1473427ca368b92bb6fbd1df',ramdisk_id='',reservation_id='r-7oxnzmw6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1411250009',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1411250009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:37:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9bac745e5da4b4f9bccf6aa53c45a4a',uuid=377257a6-916e-4269-bc53-a81d8bed6bdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16674c9f-fc44-461d-ac6b-1a7239360f06", "address": "fa:16:3e:3e:15:05", "network": {"id": "4d15ff21-bb7f-4f6f-a5cb-7a77b1fd50a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-471876759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd28ddec1473427ca368b92bb6fbd1df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16674c9f-fc", "ovs_interfaceid": "16674c9f-fc44-461d-ac6b-1a7239360f06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Converting VIF {"id": "16674c9f-fc44-461d-ac6b-1a7239360f06", "address": "fa:16:3e:3e:15:05", "network": {"id": "4d15ff21-bb7f-4f6f-a5cb-7a77b1fd50a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-471876759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd28ddec1473427ca368b92bb6fbd1df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16674c9f-fc", "ovs_interfaceid": "16674c9f-fc44-461d-ac6b-1a7239360f06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:15:05,bridge_name='br-int',has_traffic_filtering=True,id=16674c9f-fc44-461d-ac6b-1a7239360f06,network=Network(4d15ff21-bb7f-4f6f-a5cb-7a77b1fd50a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16674c9f-fc') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.objects.instance [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Lazy-loading 'pci_devices' on Instance uuid 377257a6-916e-4269-bc53-a81d8bed6bdb {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:37:30 user nova-compute[73484]:   <uuid>377257a6-916e-4269-bc53-a81d8bed6bdb</uuid>
Aug 14 13:37:30 user nova-compute[73484]:   <name>instance-00000006</name>
Aug 14 13:37:30 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:37:30 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:37:30 user nova-compute[73484]:   <metadata>
Aug 14 13:37:30 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:37:30 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:37:30 user nova-compute[73484]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-903355159</nova:name>
Aug 14 13:37:30 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:37:30</nova:creationTime>
Aug 14 13:37:30 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:37:30 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:37:30 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:37:30 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:37:30 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:37:30 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:37:30 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:37:30 user nova-compute[73484]:       <nova:owner>
Aug 14 13:37:30 user nova-compute[73484]:         <nova:user uuid="e9bac745e5da4b4f9bccf6aa53c45a4a">tempest-VolumesAssistedSnapshotsTest-1411250009-project-member</nova:user>
Aug 14 13:37:30 user nova-compute[73484]:         <nova:project uuid="cd28ddec1473427ca368b92bb6fbd1df">tempest-VolumesAssistedSnapshotsTest-1411250009</nova:project>
Aug 14 13:37:30 user nova-compute[73484]:       </nova:owner>
Aug 14 13:37:30 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:37:30 user nova-compute[73484]:       <nova:ports>
Aug 14 13:37:30 user nova-compute[73484]:         <nova:port uuid="16674c9f-fc44-461d-ac6b-1a7239360f06">
Aug 14 13:37:30 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 13:37:30 user nova-compute[73484]:         </nova:port>
Aug 14 13:37:30 user nova-compute[73484]:       </nova:ports>
Aug 14 13:37:30 user nova-compute[73484]:     </nova:instance>
Aug 14 13:37:30 user nova-compute[73484]:   </metadata>
Aug 14 13:37:30 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:37:30 user nova-compute[73484]:     <system>
Aug 14 13:37:30 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:37:30 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:37:30 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:37:30 user nova-compute[73484]:       <entry name="serial">377257a6-916e-4269-bc53-a81d8bed6bdb</entry>
Aug 14 13:37:30 user nova-compute[73484]:       <entry name="uuid">377257a6-916e-4269-bc53-a81d8bed6bdb</entry>
Aug 14 13:37:30 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:37:30 user nova-compute[73484]:     </system>
Aug 14 13:37:30 user nova-compute[73484]:   </sysinfo>
Aug 14 13:37:30 user nova-compute[73484]:   <os>
Aug 14 13:37:30 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:37:30 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:37:30 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:37:30 user nova-compute[73484]:   </os>
Aug 14 13:37:30 user nova-compute[73484]:   <features>
Aug 14 13:37:30 user nova-compute[73484]:     <acpi/>
Aug 14 13:37:30 user nova-compute[73484]:     <apic/>
Aug 14 13:37:30 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:37:30 user nova-compute[73484]:   </features>
Aug 14 13:37:30 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:37:30 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:37:30 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:37:30 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:37:30 user nova-compute[73484]:   </clock>
Aug 14 13:37:30 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:37:30 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:37:30 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:37:30 user nova-compute[73484]:   </cpu>
Aug 14 13:37:30 user nova-compute[73484]:   <devices>
Aug 14 13:37:30 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:37:30 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:37:30 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/377257a6-916e-4269-bc53-a81d8bed6bdb/disk"/>
Aug 14 13:37:30 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:37:30 user nova-compute[73484]:     </disk>
Aug 14 13:37:30 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:37:30 user nova-compute[73484]:       <mac address="fa:16:3e:3e:15:05"/>
Aug 14 13:37:30 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:37:30 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:37:30 user nova-compute[73484]:       <target dev="tap16674c9f-fc"/>
Aug 14 13:37:30 user nova-compute[73484]:     </interface>
Aug 14 13:37:30 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:37:30 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/377257a6-916e-4269-bc53-a81d8bed6bdb/console.log" append="off"/>
Aug 14 13:37:30 user nova-compute[73484]:     </serial>
Aug 14 13:37:30 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:37:30 user nova-compute[73484]:     <video>
Aug 14 13:37:30 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:37:30 user nova-compute[73484]:     </video>
Aug 14 13:37:30 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:37:30 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:37:30 user nova-compute[73484]:     </rng>
Aug 14 13:37:30 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:37:30 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:37:30 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:37:30 user nova-compute[73484]:     </memballoon>
Aug 14 13:37:30 user nova-compute[73484]:   </devices>
Aug 14 13:37:30 user nova-compute[73484]: </domain>
Aug 14 13:37:30 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-903355159',display_name='tempest-VolumesAssistedSnapshotsTest-server-903355159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-903355159',id=6,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKwYW5kfSCK4Ikb6IEBR2A3Wi1QOLjgj/lI8Hw/M9tXCiZlSo1wMcAqx5xKdtrFuWIifz3dnwbltE0WvK5zYBMn3UEmy5mQ+rldU+mxzofxZ/aWUIU19+NmRei+5ZmwaA==',key_name='tempest-keypair-660594573',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd28ddec1473427ca368b92bb6fbd1df',ramdisk_id='',reservation_id='r-7oxnzmw6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1411250009',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1411250009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:37:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9bac745e5da4b4f9bccf6aa53c45a4a',uuid=377257a6-916e-4269-bc53-a81d8bed6bdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16674c9f-fc44-461d-ac6b-1a7239360f06", "address": "fa:16:3e:3e:15:05", "network": {"id": "4d15ff21-bb7f-4f6f-a5cb-7a77b1fd50a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-471876759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd28ddec1473427ca368b92bb6fbd1df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16674c9f-fc", "ovs_interfaceid": "16674c9f-fc44-461d-ac6b-1a7239360f06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Converting VIF {"id": "16674c9f-fc44-461d-ac6b-1a7239360f06", "address": "fa:16:3e:3e:15:05", "network": {"id": "4d15ff21-bb7f-4f6f-a5cb-7a77b1fd50a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-471876759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd28ddec1473427ca368b92bb6fbd1df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16674c9f-fc", "ovs_interfaceid": "16674c9f-fc44-461d-ac6b-1a7239360f06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:15:05,bridge_name='br-int',has_traffic_filtering=True,id=16674c9f-fc44-461d-ac6b-1a7239360f06,network=Network(4d15ff21-bb7f-4f6f-a5cb-7a77b1fd50a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16674c9f-fc') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG os_vif [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:15:05,bridge_name='br-int',has_traffic_filtering=True,id=16674c9f-fc44-461d-ac6b-1a7239360f06,network=Network(4d15ff21-bb7f-4f6f-a5cb-7a77b1fd50a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16674c9f-fc') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16674c9f-fc, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap16674c9f-fc, col_values=(('external_ids', {'iface-id': '16674c9f-fc44-461d-ac6b-1a7239360f06', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:15:05', 'vm-uuid': '377257a6-916e-4269-bc53-a81d8bed6bdb'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:30 user nova-compute[73484]: INFO os_vif [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:15:05,bridge_name='br-int',has_traffic_filtering=True,id=16674c9f-fc44-461d-ac6b-1a7239360f06,network=Network(4d15ff21-bb7f-4f6f-a5cb-7a77b1fd50a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16674c9f-fc')
Aug 14 13:37:30 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Rebuilding the list of instances to heal {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] No VIF found with MAC fa:16:3e:3e:15:05, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Skipping network cache update for instance because it is Building. {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Skipping network cache update for instance because it is Building. {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Skipping network cache update for instance because it is Building. {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 14 13:37:30 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Skipping network cache update for instance because it is Building. {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 14 13:37:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-f4f7788c-fcca-47c1-b5b8-72892253982d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:37:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-f4f7788c-fcca-47c1-b5b8-72892253982d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:37:31 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 13:37:31 user nova-compute[73484]: DEBUG nova.objects.instance [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lazy-loading 'info_cache' on Instance uuid f4f7788c-fcca-47c1-b5b8-72892253982d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:37:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:32 user nova-compute[73484]: DEBUG nova.compute.manager [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:37:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:37:32 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020252.7483697, 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:37:32 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] VM Resumed (Lifecycle Event)
Aug 14 13:37:32 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Instance spawned successfully.
Aug 14 13:37:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:37:32 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:37:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:32 user nova-compute[73484]: DEBUG nova.network.neutron [req-6c18f8dd-8779-4191-b8e8-013192763f2f req-c092db09-ef89-4042-aa91-16d4627b11ae service nova] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Updated VIF entry in instance network info cache for port 16674c9f-fc44-461d-ac6b-1a7239360f06. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:37:32 user nova-compute[73484]: DEBUG nova.network.neutron [req-6c18f8dd-8779-4191-b8e8-013192763f2f req-c092db09-ef89-4042-aa91-16d4627b11ae service nova] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Updating instance_info_cache with network_info: [{"id": "16674c9f-fc44-461d-ac6b-1a7239360f06", "address": "fa:16:3e:3e:15:05", "network": {"id": "4d15ff21-bb7f-4f6f-a5cb-7a77b1fd50a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-471876759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd28ddec1473427ca368b92bb6fbd1df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16674c9f-fc", "ovs_interfaceid": "16674c9f-fc44-461d-ac6b-1a7239360f06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:37:32 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:37:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6c18f8dd-8779-4191-b8e8-013192763f2f req-c092db09-ef89-4042-aa91-16d4627b11ae service nova] Releasing lock "refresh_cache-377257a6-916e-4269-bc53-a81d8bed6bdb" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:37:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:32 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:37:32 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020252.749733, 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:37:32 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] VM Started (Lifecycle Event)
Aug 14 13:37:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:32 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:37:32 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:37:32 user nova-compute[73484]: INFO nova.compute.manager [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Took 10.97 seconds to spawn the instance on the hypervisor.
Aug 14 13:37:32 user nova-compute[73484]: DEBUG nova.compute.manager [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:37:32 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:37:33 user nova-compute[73484]: INFO nova.compute.manager [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Took 12.69 seconds to build instance.
Aug 14 13:37:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3a42e037-9727-4a7a-898f-ae06e2651b61 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lock "96025e5d-7c98-4ed4-8180-7c2cdb1d65bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.852s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:33 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Updating instance_info_cache with network_info: [{"id": "5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b", "address": "fa:16:3e:8b:e0:96", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc7ee1a-4f", "ovs_interfaceid": "5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:37:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-f4f7788c-fcca-47c1-b5b8-72892253982d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:37:33 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 13:37:33 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:37:33 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:37:33 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 13:37:33 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:37:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:33 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 13:37:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:33 user nova-compute[73484]: DEBUG nova.compute.manager [req-69baab0c-d15c-4086-b753-f0a7427c763e req-1d1e098a-ca80-4985-896e-4e6c1c2b8830 service nova] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Received event network-vif-plugged-16674c9f-fc44-461d-ac6b-1a7239360f06 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:37:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-69baab0c-d15c-4086-b753-f0a7427c763e req-1d1e098a-ca80-4985-896e-4e6c1c2b8830 service nova] Acquiring lock "377257a6-916e-4269-bc53-a81d8bed6bdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-69baab0c-d15c-4086-b753-f0a7427c763e req-1d1e098a-ca80-4985-896e-4e6c1c2b8830 service nova] Lock "377257a6-916e-4269-bc53-a81d8bed6bdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-69baab0c-d15c-4086-b753-f0a7427c763e req-1d1e098a-ca80-4985-896e-4e6c1c2b8830 service nova] Lock "377257a6-916e-4269-bc53-a81d8bed6bdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:33 user nova-compute[73484]: DEBUG nova.compute.manager [req-69baab0c-d15c-4086-b753-f0a7427c763e req-1d1e098a-ca80-4985-896e-4e6c1c2b8830 service nova] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] No waiting events found dispatching network-vif-plugged-16674c9f-fc44-461d-ac6b-1a7239360f06 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:37:33 user nova-compute[73484]: WARNING nova.compute.manager [req-69baab0c-d15c-4086-b753-f0a7427c763e req-1d1e098a-ca80-4985-896e-4e6c1c2b8830 service nova] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Received unexpected event network-vif-plugged-16674c9f-fc44-461d-ac6b-1a7239360f06 for instance with vm_state building and task_state spawning.
Aug 14 13:37:33 user nova-compute[73484]: DEBUG nova.network.neutron [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Successfully updated port: 81a13981-b50f-4f1b-ac18-d4eea5f141fd {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:37:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Acquiring lock "refresh_cache-7ac05f68-a20f-4a57-b990-ef0799aadc58" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:37:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Acquired lock "refresh_cache-7ac05f68-a20f-4a57-b990-ef0799aadc58" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:37:33 user nova-compute[73484]: DEBUG nova.network.neutron [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:37:34 user nova-compute[73484]: DEBUG nova.compute.manager [req-dfb63c1c-7daa-422e-92e5-65d2399f4e78 req-f52b594e-716d-42b2-812a-a88816509b03 service nova] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Received event network-changed-81a13981-b50f-4f1b-ac18-d4eea5f141fd {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:37:34 user nova-compute[73484]: DEBUG nova.compute.manager [req-dfb63c1c-7daa-422e-92e5-65d2399f4e78 req-f52b594e-716d-42b2-812a-a88816509b03 service nova] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Refreshing instance network info cache due to event network-changed-81a13981-b50f-4f1b-ac18-d4eea5f141fd. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:37:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-dfb63c1c-7daa-422e-92e5-65d2399f4e78 req-f52b594e-716d-42b2-812a-a88816509b03 service nova] Acquiring lock "refresh_cache-7ac05f68-a20f-4a57-b990-ef0799aadc58" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:37:34 user nova-compute[73484]: DEBUG nova.network.neutron [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:37:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96025e5d-7c98-4ed4-8180-7c2cdb1d65bf/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96025e5d-7c98-4ed4-8180-7c2cdb1d65bf/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96025e5d-7c98-4ed4-8180-7c2cdb1d65bf/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96025e5d-7c98-4ed4-8180-7c2cdb1d65bf/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/377257a6-916e-4269-bc53-a81d8bed6bdb/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/377257a6-916e-4269-bc53-a81d8bed6bdb/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/377257a6-916e-4269-bc53-a81d8bed6bdb/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.network.neutron [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Updating instance_info_cache with network_info: [{"id": "81a13981-b50f-4f1b-ac18-d4eea5f141fd", "address": "fa:16:3e:6e:d0:0c", "network": {"id": "27abd91d-84d4-4660-8708-088648dcf2fd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-847318959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02feed89293147398ae749494502ca78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a13981-b5", "ovs_interfaceid": "81a13981-b50f-4f1b-ac18-d4eea5f141fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Releasing lock "refresh_cache-7ac05f68-a20f-4a57-b990-ef0799aadc58" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.compute.manager [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Instance network_info: |[{"id": "81a13981-b50f-4f1b-ac18-d4eea5f141fd", "address": "fa:16:3e:6e:d0:0c", "network": {"id": "27abd91d-84d4-4660-8708-088648dcf2fd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-847318959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02feed89293147398ae749494502ca78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a13981-b5", "ovs_interfaceid": "81a13981-b50f-4f1b-ac18-d4eea5f141fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-dfb63c1c-7daa-422e-92e5-65d2399f4e78 req-f52b594e-716d-42b2-812a-a88816509b03 service nova] Acquired lock "refresh_cache-7ac05f68-a20f-4a57-b990-ef0799aadc58" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.network.neutron [req-dfb63c1c-7daa-422e-92e5-65d2399f4e78 req-f52b594e-716d-42b2-812a-a88816509b03 service nova] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Refreshing network info cache for port 81a13981-b50f-4f1b-ac18-d4eea5f141fd {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Start _get_guest_xml network_info=[{"id": "81a13981-b50f-4f1b-ac18-d4eea5f141fd", "address": "fa:16:3e:6e:d0:0c", "network": {"id": "27abd91d-84d4-4660-8708-088648dcf2fd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-847318959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02feed89293147398ae749494502ca78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a13981-b5", "ovs_interfaceid": "81a13981-b50f-4f1b-ac18-d4eea5f141fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/377257a6-916e-4269-bc53-a81d8bed6bdb/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:35 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:37:35 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:37:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:37:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-573988650',display_name='tempest-TestVolumeSwap-server-573988650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-573988650',id=8,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/Kq6cH5c92nxB4XNNjgfHLK8f5wuchIFW4En1j6BpQ5CqeKDSXErpNl/zQ5RkLwZNd8dQqjMvuMgYdM/N5qCqJNAyc232zVGK8QH4yY4NfKPUmhyba+y4ES33I7fw/8A==',key_name='tempest-keypair-1631220374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02feed89293147398ae749494502ca78',ramdisk_id='',reservation_id='r-z5g5l0s9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-655788702',owner_user_name='tempest-TestVolumeSwap-655788702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:37:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c17cf880b304d98bbbf47a495f09562',uuid=7ac05f68-a20f-4a57-b990-ef0799aadc58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81a13981-b50f-4f1b-ac18-d4eea5f141fd", "address": "fa:16:3e:6e:d0:0c", "network": {"id": "27abd91d-84d4-4660-8708-088648dcf2fd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-847318959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02feed89293147398ae749494502ca78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a13981-b5", "ovs_interfaceid": "81a13981-b50f-4f1b-ac18-d4eea5f141fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Converting VIF {"id": "81a13981-b50f-4f1b-ac18-d4eea5f141fd", "address": "fa:16:3e:6e:d0:0c", "network": {"id": "27abd91d-84d4-4660-8708-088648dcf2fd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-847318959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02feed89293147398ae749494502ca78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a13981-b5", "ovs_interfaceid": "81a13981-b50f-4f1b-ac18-d4eea5f141fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:d0:0c,bridge_name='br-int',has_traffic_filtering=True,id=81a13981-b50f-4f1b-ac18-d4eea5f141fd,network=Network(27abd91d-84d4-4660-8708-088648dcf2fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a13981-b5') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.objects.instance [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ac05f68-a20f-4a57-b990-ef0799aadc58 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:37:35 user nova-compute[73484]:   <uuid>7ac05f68-a20f-4a57-b990-ef0799aadc58</uuid>
Aug 14 13:37:35 user nova-compute[73484]:   <name>instance-00000008</name>
Aug 14 13:37:35 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:37:35 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:37:35 user nova-compute[73484]:   <metadata>
Aug 14 13:37:35 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:37:35 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:37:35 user nova-compute[73484]:       <nova:name>tempest-TestVolumeSwap-server-573988650</nova:name>
Aug 14 13:37:35 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:37:35</nova:creationTime>
Aug 14 13:37:35 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:37:35 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:37:35 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:37:35 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:37:35 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:37:35 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:37:35 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:37:35 user nova-compute[73484]:       <nova:owner>
Aug 14 13:37:35 user nova-compute[73484]:         <nova:user uuid="0c17cf880b304d98bbbf47a495f09562">tempest-TestVolumeSwap-655788702-project-member</nova:user>
Aug 14 13:37:35 user nova-compute[73484]:         <nova:project uuid="02feed89293147398ae749494502ca78">tempest-TestVolumeSwap-655788702</nova:project>
Aug 14 13:37:35 user nova-compute[73484]:       </nova:owner>
Aug 14 13:37:35 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:37:35 user nova-compute[73484]:       <nova:ports>
Aug 14 13:37:35 user nova-compute[73484]:         <nova:port uuid="81a13981-b50f-4f1b-ac18-d4eea5f141fd">
Aug 14 13:37:35 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 13:37:35 user nova-compute[73484]:         </nova:port>
Aug 14 13:37:35 user nova-compute[73484]:       </nova:ports>
Aug 14 13:37:35 user nova-compute[73484]:     </nova:instance>
Aug 14 13:37:35 user nova-compute[73484]:   </metadata>
Aug 14 13:37:35 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:37:35 user nova-compute[73484]:     <system>
Aug 14 13:37:35 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:37:35 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:37:35 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:37:35 user nova-compute[73484]:       <entry name="serial">7ac05f68-a20f-4a57-b990-ef0799aadc58</entry>
Aug 14 13:37:35 user nova-compute[73484]:       <entry name="uuid">7ac05f68-a20f-4a57-b990-ef0799aadc58</entry>
Aug 14 13:37:35 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:37:35 user nova-compute[73484]:     </system>
Aug 14 13:37:35 user nova-compute[73484]:   </sysinfo>
Aug 14 13:37:35 user nova-compute[73484]:   <os>
Aug 14 13:37:35 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:37:35 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:37:35 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:37:35 user nova-compute[73484]:   </os>
Aug 14 13:37:35 user nova-compute[73484]:   <features>
Aug 14 13:37:35 user nova-compute[73484]:     <acpi/>
Aug 14 13:37:35 user nova-compute[73484]:     <apic/>
Aug 14 13:37:35 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:37:35 user nova-compute[73484]:   </features>
Aug 14 13:37:35 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:37:35 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:37:35 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:37:35 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:37:35 user nova-compute[73484]:   </clock>
Aug 14 13:37:35 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:37:35 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:37:35 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:37:35 user nova-compute[73484]:   </cpu>
Aug 14 13:37:35 user nova-compute[73484]:   <devices>
Aug 14 13:37:35 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:37:35 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:37:35 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/7ac05f68-a20f-4a57-b990-ef0799aadc58/disk"/>
Aug 14 13:37:35 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:37:35 user nova-compute[73484]:     </disk>
Aug 14 13:37:35 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:37:35 user nova-compute[73484]:       <mac address="fa:16:3e:6e:d0:0c"/>
Aug 14 13:37:35 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:37:35 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:37:35 user nova-compute[73484]:       <target dev="tap81a13981-b5"/>
Aug 14 13:37:35 user nova-compute[73484]:     </interface>
Aug 14 13:37:35 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:37:35 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/7ac05f68-a20f-4a57-b990-ef0799aadc58/console.log" append="off"/>
Aug 14 13:37:35 user nova-compute[73484]:     </serial>
Aug 14 13:37:35 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:37:35 user nova-compute[73484]:     <video>
Aug 14 13:37:35 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:37:35 user nova-compute[73484]:     </video>
Aug 14 13:37:35 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:37:35 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:37:35 user nova-compute[73484]:     </rng>
Aug 14 13:37:35 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:37:35 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:37:35 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:37:35 user nova-compute[73484]:     </memballoon>
Aug 14 13:37:35 user nova-compute[73484]:   </devices>
Aug 14 13:37:35 user nova-compute[73484]: </domain>
Aug 14 13:37:35 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:37:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-573988650',display_name='tempest-TestVolumeSwap-server-573988650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-573988650',id=8,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/Kq6cH5c92nxB4XNNjgfHLK8f5wuchIFW4En1j6BpQ5CqeKDSXErpNl/zQ5RkLwZNd8dQqjMvuMgYdM/N5qCqJNAyc232zVGK8QH4yY4NfKPUmhyba+y4ES33I7fw/8A==',key_name='tempest-keypair-1631220374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02feed89293147398ae749494502ca78',ramdisk_id='',reservation_id='r-z5g5l0s9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-655788702',owner_user_name='tempest-TestVolumeSwap-655788702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:37:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c17cf880b304d98bbbf47a495f09562',uuid=7ac05f68-a20f-4a57-b990-ef0799aadc58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81a13981-b50f-4f1b-ac18-d4eea5f141fd", "address": "fa:16:3e:6e:d0:0c", "network": {"id": "27abd91d-84d4-4660-8708-088648dcf2fd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-847318959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02feed89293147398ae749494502ca78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a13981-b5", "ovs_interfaceid": "81a13981-b50f-4f1b-ac18-d4eea5f141fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Converting VIF {"id": "81a13981-b50f-4f1b-ac18-d4eea5f141fd", "address": "fa:16:3e:6e:d0:0c", "network": {"id": "27abd91d-84d4-4660-8708-088648dcf2fd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-847318959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02feed89293147398ae749494502ca78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a13981-b5", "ovs_interfaceid": "81a13981-b50f-4f1b-ac18-d4eea5f141fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:d0:0c,bridge_name='br-int',has_traffic_filtering=True,id=81a13981-b50f-4f1b-ac18-d4eea5f141fd,network=Network(27abd91d-84d4-4660-8708-088648dcf2fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a13981-b5') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG os_vif [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:d0:0c,bridge_name='br-int',has_traffic_filtering=True,id=81a13981-b50f-4f1b-ac18-d4eea5f141fd,network=Network(27abd91d-84d4-4660-8708-088648dcf2fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a13981-b5') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81a13981-b5, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap81a13981-b5, col_values=(('external_ids', {'iface-id': '81a13981-b50f-4f1b-ac18-d4eea5f141fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:d0:0c', 'vm-uuid': '7ac05f68-a20f-4a57-b990-ef0799aadc58'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:35 user nova-compute[73484]: INFO os_vif [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:d0:0c,bridge_name='br-int',has_traffic_filtering=True,id=81a13981-b50f-4f1b-ac18-d4eea5f141fd,network=Network(27abd91d-84d4-4660-8708-088648dcf2fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a13981-b5')
Aug 14 13:37:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] No VIF found with MAC fa:16:3e:6e:d0:0c, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Acquiring lock "eaaccbea-d453-4943-9663-949c66029d87" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lock "eaaccbea-d453-4943-9663-949c66029d87" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.compute.manager [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:37:35 user nova-compute[73484]: INFO nova.compute.claims [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Claim successful on node user
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.compute.manager [req-29ce143e-30f2-4b67-a6b6-c32efc2f8383 req-adb87e1a-7584-48aa-97f4-74bc0a2f2b35 service nova] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Received event network-vif-plugged-16674c9f-fc44-461d-ac6b-1a7239360f06 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-29ce143e-30f2-4b67-a6b6-c32efc2f8383 req-adb87e1a-7584-48aa-97f4-74bc0a2f2b35 service nova] Acquiring lock "377257a6-916e-4269-bc53-a81d8bed6bdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-29ce143e-30f2-4b67-a6b6-c32efc2f8383 req-adb87e1a-7584-48aa-97f4-74bc0a2f2b35 service nova] Lock "377257a6-916e-4269-bc53-a81d8bed6bdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-29ce143e-30f2-4b67-a6b6-c32efc2f8383 req-adb87e1a-7584-48aa-97f4-74bc0a2f2b35 service nova] Lock "377257a6-916e-4269-bc53-a81d8bed6bdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:35 user nova-compute[73484]: DEBUG nova.compute.manager [req-29ce143e-30f2-4b67-a6b6-c32efc2f8383 req-adb87e1a-7584-48aa-97f4-74bc0a2f2b35 service nova] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] No waiting events found dispatching network-vif-plugged-16674c9f-fc44-461d-ac6b-1a7239360f06 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:37:35 user nova-compute[73484]: WARNING nova.compute.manager [req-29ce143e-30f2-4b67-a6b6-c32efc2f8383 req-adb87e1a-7584-48aa-97f4-74bc0a2f2b35 service nova] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Received unexpected event network-vif-plugged-16674c9f-fc44-461d-ac6b-1a7239360f06 for instance with vm_state building and task_state spawning.
Aug 14 13:37:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020256.5608408, 377257a6-916e-4269-bc53-a81d8bed6bdb => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:37:36 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] VM Resumed (Lifecycle Event)
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.compute.manager [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.compute.manager [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:37:36 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Instance spawned successfully.
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.network.neutron [req-dfb63c1c-7daa-422e-92e5-65d2399f4e78 req-f52b594e-716d-42b2-812a-a88816509b03 service nova] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Updated VIF entry in instance network info cache for port 81a13981-b50f-4f1b-ac18-d4eea5f141fd. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.network.neutron [req-dfb63c1c-7daa-422e-92e5-65d2399f4e78 req-f52b594e-716d-42b2-812a-a88816509b03 service nova] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Updating instance_info_cache with network_info: [{"id": "81a13981-b50f-4f1b-ac18-d4eea5f141fd", "address": "fa:16:3e:6e:d0:0c", "network": {"id": "27abd91d-84d4-4660-8708-088648dcf2fd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-847318959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02feed89293147398ae749494502ca78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a13981-b5", "ovs_interfaceid": "81a13981-b50f-4f1b-ac18-d4eea5f141fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-dfb63c1c-7daa-422e-92e5-65d2399f4e78 req-f52b594e-716d-42b2-812a-a88816509b03 service nova] Releasing lock "refresh_cache-7ac05f68-a20f-4a57-b990-ef0799aadc58" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:37:36 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Instance spawned successfully.
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:36 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020256.561364, 377257a6-916e-4269-bc53-a81d8bed6bdb => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:37:36 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] VM Started (Lifecycle Event)
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:37:36 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020256.5936193, 7348b004-4d46-4db5-a451-afd3b7476569 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:37:36 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] VM Resumed (Lifecycle Event)
Aug 14 13:37:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:37:36 user nova-compute[73484]: INFO nova.compute.manager [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Took 16.16 seconds to spawn the instance on the hypervisor.
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.compute.manager [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.038s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.compute.manager [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:37:36 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:37:37 user nova-compute[73484]: INFO nova.compute.manager [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Took 10.73 seconds to spawn the instance on the hypervisor.
Aug 14 13:37:37 user nova-compute[73484]: DEBUG nova.compute.manager [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:37:37 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:37:37 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020256.5937958, 7348b004-4d46-4db5-a451-afd3b7476569 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:37:37 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] VM Started (Lifecycle Event)
Aug 14 13:37:37 user nova-compute[73484]: DEBUG nova.compute.manager [req-96b13b4a-7617-42b3-96e3-04b266e3de09 req-f235f14e-529d-4bd2-a7a9-f6980609c1bb service nova] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Received event network-vif-plugged-cb7f3901-875e-489a-87f8-5642b9fded9c {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:37:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-96b13b4a-7617-42b3-96e3-04b266e3de09 req-f235f14e-529d-4bd2-a7a9-f6980609c1bb service nova] Acquiring lock "07bac569-8b2c-4555-b4d5-a74f7384630b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-96b13b4a-7617-42b3-96e3-04b266e3de09 req-f235f14e-529d-4bd2-a7a9-f6980609c1bb service nova] Lock "07bac569-8b2c-4555-b4d5-a74f7384630b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-96b13b4a-7617-42b3-96e3-04b266e3de09 req-f235f14e-529d-4bd2-a7a9-f6980609c1bb service nova] Lock "07bac569-8b2c-4555-b4d5-a74f7384630b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:37 user nova-compute[73484]: DEBUG nova.compute.manager [req-96b13b4a-7617-42b3-96e3-04b266e3de09 req-f235f14e-529d-4bd2-a7a9-f6980609c1bb service nova] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] No waiting events found dispatching network-vif-plugged-cb7f3901-875e-489a-87f8-5642b9fded9c {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:37:37 user nova-compute[73484]: WARNING nova.compute.manager [req-96b13b4a-7617-42b3-96e3-04b266e3de09 req-f235f14e-529d-4bd2-a7a9-f6980609c1bb service nova] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Received unexpected event network-vif-plugged-cb7f3901-875e-489a-87f8-5642b9fded9c for instance with vm_state active and task_state None.
Aug 14 13:37:37 user nova-compute[73484]: DEBUG nova.compute.manager [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:37:37 user nova-compute[73484]: DEBUG nova.network.neutron [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:37:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:37 user nova-compute[73484]: INFO nova.compute.manager [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Took 17.71 seconds to build instance.
Aug 14 13:37:37 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:37:37 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:37:37 user nova-compute[73484]: INFO nova.compute.manager [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Took 12.36 seconds to build instance.
Aug 14 13:37:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-99a79fa1-c081-4c4a-8f3a-33ff8ceabf12 tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Lock "377257a6-916e-4269-bc53-a81d8bed6bdb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.970s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:37 user nova-compute[73484]: DEBUG nova.policy [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f609a87c04f40b68af1b78f8503c45c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c04593677842fc9bed43bb42776176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:37:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ac9861fc-02d5-4824-9132-8271f9b5b38b tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "7348b004-4d46-4db5-a451-afd3b7476569" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.570s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:37 user nova-compute[73484]: DEBUG nova.compute.manager [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:37:37 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:37:37 user nova-compute[73484]: INFO nova.virt.block_device [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Booting with volume abbda33a-ae60-404c-85b3-9df266cc1567 at /dev/vda
Aug 14 13:37:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:37 user nova-compute[73484]: DEBUG os_brick.utils [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:37:37 user nova-compute[73484]: INFO oslo.privsep.daemon [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp6waeeefn/privsep.sock']
Aug 14 13:37:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:37 user sudo[84257]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp6waeeefn/privsep.sock
Aug 14 13:37:37 user sudo[84257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 14 13:37:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/disk --force-share --output=json" returned: 0 in 0.312s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:38 user nova-compute[73484]: DEBUG nova.network.neutron [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Successfully created port: 244b7f94-a32e-4724-858e-ae9be93a8003 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:37:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk --force-share --output=json" returned: 0 in 0.319s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:40 user sudo[84257]: pam_unix(sudo:session): session closed for user root
Aug 14 13:37:41 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020260.4866424, 7ac05f68-a20f-4a57-b990-ef0799aadc58 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:37:41 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] VM Resumed (Lifecycle Event)
Aug 14 13:37:41 user nova-compute[73484]: DEBUG nova.network.neutron [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Successfully updated port: 244b7f94-a32e-4724-858e-ae9be93a8003 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:37:41 user nova-compute[73484]: INFO oslo.privsep.daemon [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Spawned new privsep daemon via rootwrap
Aug 14 13:37:41 user nova-compute[73484]: DEBUG nova.compute.manager [req-08ffbac2-ebb7-4c36-a6e5-567fe3eb0991 req-8700f1f3-89ff-4324-be0f-03b0d6eb7c99 service nova] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Received event network-vif-plugged-cb7f3901-875e-489a-87f8-5642b9fded9c {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-08ffbac2-ebb7-4c36-a6e5-567fe3eb0991 req-8700f1f3-89ff-4324-be0f-03b0d6eb7c99 service nova] Acquiring lock "07bac569-8b2c-4555-b4d5-a74f7384630b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-08ffbac2-ebb7-4c36-a6e5-567fe3eb0991 req-8700f1f3-89ff-4324-be0f-03b0d6eb7c99 service nova] Lock "07bac569-8b2c-4555-b4d5-a74f7384630b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-08ffbac2-ebb7-4c36-a6e5-567fe3eb0991 req-8700f1f3-89ff-4324-be0f-03b0d6eb7c99 service nova] Lock "07bac569-8b2c-4555-b4d5-a74f7384630b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG nova.compute.manager [req-08ffbac2-ebb7-4c36-a6e5-567fe3eb0991 req-8700f1f3-89ff-4324-be0f-03b0d6eb7c99 service nova] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] No waiting events found dispatching network-vif-plugged-cb7f3901-875e-489a-87f8-5642b9fded9c {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:37:41 user nova-compute[73484]: WARNING nova.compute.manager [req-08ffbac2-ebb7-4c36-a6e5-567fe3eb0991 req-8700f1f3-89ff-4324-be0f-03b0d6eb7c99 service nova] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Received unexpected event network-vif-plugged-cb7f3901-875e-489a-87f8-5642b9fded9c for instance with vm_state active and task_state None.
Aug 14 13:37:41 user nova-compute[73484]: DEBUG nova.compute.manager [req-1e93280c-faf6-4c9b-a4d0-e6b913d1fd3a req-16aa7c31-7347-441e-ad96-d9f6dccb3c9b service nova] [instance: eaaccbea-d453-4943-9663-949c66029d87] Received event network-changed-244b7f94-a32e-4724-858e-ae9be93a8003 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG nova.compute.manager [req-1e93280c-faf6-4c9b-a4d0-e6b913d1fd3a req-16aa7c31-7347-441e-ad96-d9f6dccb3c9b service nova] [instance: eaaccbea-d453-4943-9663-949c66029d87] Refreshing instance network info cache due to event network-changed-244b7f94-a32e-4724-858e-ae9be93a8003. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1e93280c-faf6-4c9b-a4d0-e6b913d1fd3a req-16aa7c31-7347-441e-ad96-d9f6dccb3c9b service nova] Acquiring lock "refresh_cache-eaaccbea-d453-4943-9663-949c66029d87" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1e93280c-faf6-4c9b-a4d0-e6b913d1fd3a req-16aa7c31-7347-441e-ad96-d9f6dccb3c9b service nova] Acquired lock "refresh_cache-eaaccbea-d453-4943-9663-949c66029d87" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG nova.network.neutron [req-1e93280c-faf6-4c9b-a4d0-e6b913d1fd3a req-16aa7c31-7347-441e-ad96-d9f6dccb3c9b service nova] [instance: eaaccbea-d453-4943-9663-949c66029d87] Refreshing network info cache for port 244b7f94-a32e-4724-858e-ae9be93a8003 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG nova.compute.manager [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Acquiring lock "refresh_cache-eaaccbea-d453-4943-9663-949c66029d87" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:37:41 user nova-compute[73484]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 14 13:37:41 user nova-compute[73484]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 14 13:37:41 user nova-compute[73484]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 14 13:37:41 user nova-compute[73484]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84315
Aug 14 13:37:41 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[894b9864-44e8-4880-bae3-871467db4963]: (2,) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:37:41 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:37:41 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:37:41 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=7862MB free_disk=25.88308334350586GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:41 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Instance spawned successfully.
Aug 14 13:37:41 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:37:41 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:37:41 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020260.4877813, 7ac05f68-a20f-4a57-b990-ef0799aadc58 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:37:41 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] VM Started (Lifecycle Event)
Aug 14 13:37:41 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG nova.network.neutron [req-1e93280c-faf6-4c9b-a4d0-e6b913d1fd3a req-16aa7c31-7347-441e-ad96-d9f6dccb3c9b service nova] [instance: eaaccbea-d453-4943-9663-949c66029d87] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:41 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:37:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.029s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e10adc1-e3f7-4ae1-a4c1-43b038bc80c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:37:41 user nova-compute[73484]: WARNING os_brick.initiator.connectors.nvmeof [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 14 13:37:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.037s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97f2af7-2390-45d6-b9ad-89eaf8738f6b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a6e434-02ac-4c38-9e55-2323ee30aaba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1b420d-b7d9-44de-8705-7b57f8c34922]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:37:41 user nova-compute[73484]: INFO nova.compute.manager [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Took 16.66 seconds to spawn the instance on the hypervisor.
Aug 14 13:37:41 user nova-compute[73484]: DEBUG nova.compute.manager [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:37:41 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:37:41 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[617c270e-bb79-4bde-9acd-5751d8ef45bd]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG os_brick.utils [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] <== get_connector_properties: return (4202ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:37:41 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Updating existing volume attachment record: 8dbb3acd-63b6-413b-abb1-af1cccc98d99 {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:37:41 user nova-compute[73484]: INFO nova.compute.manager [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Took 18.05 seconds to build instance.
Aug 14 13:37:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-54ba7833-1a02-48fa-abce-8fdbca714a96 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lock "7ac05f68-a20f-4a57-b990-ef0799aadc58" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.238s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:42 user nova-compute[73484]: DEBUG nova.network.neutron [req-1e93280c-faf6-4c9b-a4d0-e6b913d1fd3a req-16aa7c31-7347-441e-ad96-d9f6dccb3c9b service nova] [instance: eaaccbea-d453-4943-9663-949c66029d87] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:37:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1e93280c-faf6-4c9b-a4d0-e6b913d1fd3a req-16aa7c31-7347-441e-ad96-d9f6dccb3c9b service nova] Releasing lock "refresh_cache-eaaccbea-d453-4943-9663-949c66029d87" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:37:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Acquired lock "refresh_cache-eaaccbea-d453-4943-9663-949c66029d87" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:37:42 user nova-compute[73484]: DEBUG nova.network.neutron [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:37:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance f4f7788c-fcca-47c1-b5b8-72892253982d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:37:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:37:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:37:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 07bac569-8b2c-4555-b4d5-a74f7384630b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:37:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance b889688d-13dd-4f7b-bfef-26dc5347fd6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:37:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 377257a6-916e-4269-bc53-a81d8bed6bdb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:37:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:37:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 7ac05f68-a20f-4a57-b990-ef0799aadc58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:37:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 7348b004-4d46-4db5-a451-afd3b7476569 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:37:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance eaaccbea-d453-4943-9663-949c66029d87 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:37:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 13:37:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 13:37:42 user nova-compute[73484]: DEBUG nova.network.neutron [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:37:42 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Refreshing inventories for resource provider 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 13:37:42 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Updating ProviderTree inventory for provider 165d4635-93b4-49a6-879a-21c1324822ab from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 13:37:42 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Updating inventory in ProviderTree for provider 165d4635-93b4-49a6-879a-21c1324822ab with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 13:37:42 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Refreshing aggregate associations for resource provider 165d4635-93b4-49a6-879a-21c1324822ab, aggregates: None {{(pid=73484) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 13:37:42 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Refreshing trait associations for resource provider 165d4635-93b4-49a6-879a-21c1324822ab, traits: COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS {{(pid=73484) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 13:37:42 user nova-compute[73484]: DEBUG nova.network.neutron [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Updating instance_info_cache with network_info: [{"id": "244b7f94-a32e-4724-858e-ae9be93a8003", "address": "fa:16:3e:4e:e1:a7", "network": {"id": "6480ad45-783a-4c79-adac-e661111d3cc8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1304007088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01c04593677842fc9bed43bb42776176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244b7f94-a3", "ovs_interfaceid": "244b7f94-a32e-4724-858e-ae9be93a8003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:37:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Releasing lock "refresh_cache-eaaccbea-d453-4943-9663-949c66029d87" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:37:42 user nova-compute[73484]: DEBUG nova.compute.manager [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Instance network_info: |[{"id": "244b7f94-a32e-4724-858e-ae9be93a8003", "address": "fa:16:3e:4e:e1:a7", "network": {"id": "6480ad45-783a-4c79-adac-e661111d3cc8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1304007088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01c04593677842fc9bed43bb42776176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244b7f94-a3", "ovs_interfaceid": "244b7f94-a32e-4724-858e-ae9be93a8003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:37:42 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:37:42 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:37:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 13:37:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.586s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:43 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:37:43 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:37:43 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:37:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:49 user nova-compute[73484]: DEBUG nova.compute.manager [req-63d1f954-6b11-435b-b6f9-f341544b8024 req-8dd36a95-5821-400e-8f3a-a820bd212191 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Received event network-vif-plugged-290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:37:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-63d1f954-6b11-435b-b6f9-f341544b8024 req-8dd36a95-5821-400e-8f3a-a820bd212191 service nova] Acquiring lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-63d1f954-6b11-435b-b6f9-f341544b8024 req-8dd36a95-5821-400e-8f3a-a820bd212191 service nova] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-63d1f954-6b11-435b-b6f9-f341544b8024 req-8dd36a95-5821-400e-8f3a-a820bd212191 service nova] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:49 user nova-compute[73484]: DEBUG nova.compute.manager [req-63d1f954-6b11-435b-b6f9-f341544b8024 req-8dd36a95-5821-400e-8f3a-a820bd212191 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] No waiting events found dispatching network-vif-plugged-290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:37:49 user nova-compute[73484]: WARNING nova.compute.manager [req-63d1f954-6b11-435b-b6f9-f341544b8024 req-8dd36a95-5821-400e-8f3a-a820bd212191 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Received unexpected event network-vif-plugged-290c0b61-ba11-4074-a7f2-cb172a576a19 for instance with vm_state active and task_state None.
Aug 14 13:37:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG nova.compute.manager [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Received event network-vif-plugged-290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] Acquiring lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG nova.compute.manager [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] No waiting events found dispatching network-vif-plugged-290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:37:51 user nova-compute[73484]: WARNING nova.compute.manager [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Received unexpected event network-vif-plugged-290c0b61-ba11-4074-a7f2-cb172a576a19 for instance with vm_state active and task_state None.
Aug 14 13:37:51 user nova-compute[73484]: DEBUG nova.compute.manager [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received event network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] Acquiring lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG nova.compute.manager [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] No waiting events found dispatching network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:37:51 user nova-compute[73484]: WARNING nova.compute.manager [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received unexpected event network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a for instance with vm_state active and task_state None.
Aug 14 13:37:51 user nova-compute[73484]: DEBUG nova.compute.manager [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received event network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] Acquiring lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG nova.compute.manager [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] No waiting events found dispatching network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:37:51 user nova-compute[73484]: WARNING nova.compute.manager [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received unexpected event network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a for instance with vm_state active and task_state None.
Aug 14 13:37:51 user nova-compute[73484]: DEBUG nova.compute.manager [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Received event network-vif-plugged-cd94675b-f6af-48b1-a32f-0a39549f404d {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] Acquiring lock "b889688d-13dd-4f7b-bfef-26dc5347fd6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] Lock "b889688d-13dd-4f7b-bfef-26dc5347fd6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] Lock "b889688d-13dd-4f7b-bfef-26dc5347fd6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG nova.compute.manager [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] No waiting events found dispatching network-vif-plugged-cd94675b-f6af-48b1-a32f-0a39549f404d {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:37:51 user nova-compute[73484]: WARNING nova.compute.manager [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Received unexpected event network-vif-plugged-cd94675b-f6af-48b1-a32f-0a39549f404d for instance with vm_state active and task_state None.
Aug 14 13:37:51 user nova-compute[73484]: DEBUG nova.compute.manager [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Received event network-vif-plugged-cd94675b-f6af-48b1-a32f-0a39549f404d {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] Acquiring lock "b889688d-13dd-4f7b-bfef-26dc5347fd6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] Lock "b889688d-13dd-4f7b-bfef-26dc5347fd6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] Lock "b889688d-13dd-4f7b-bfef-26dc5347fd6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG nova.compute.manager [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] No waiting events found dispatching network-vif-plugged-cd94675b-f6af-48b1-a32f-0a39549f404d {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:37:51 user nova-compute[73484]: WARNING nova.compute.manager [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Received unexpected event network-vif-plugged-cd94675b-f6af-48b1-a32f-0a39549f404d for instance with vm_state active and task_state None.
Aug 14 13:37:51 user nova-compute[73484]: DEBUG nova.compute.manager [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Received event network-vif-plugged-de0da088-b53c-4792-b764-b6c6cd9dc5a3 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] Acquiring lock "96025e5d-7c98-4ed4-8180-7c2cdb1d65bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] Lock "96025e5d-7c98-4ed4-8180-7c2cdb1d65bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] Lock "96025e5d-7c98-4ed4-8180-7c2cdb1d65bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG nova.compute.manager [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] No waiting events found dispatching network-vif-plugged-de0da088-b53c-4792-b764-b6c6cd9dc5a3 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:37:51 user nova-compute[73484]: WARNING nova.compute.manager [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Received unexpected event network-vif-plugged-de0da088-b53c-4792-b764-b6c6cd9dc5a3 for instance with vm_state active and task_state None.
Aug 14 13:37:51 user nova-compute[73484]: DEBUG nova.compute.manager [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Received event network-vif-plugged-de0da088-b53c-4792-b764-b6c6cd9dc5a3 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] Acquiring lock "96025e5d-7c98-4ed4-8180-7c2cdb1d65bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] Lock "96025e5d-7c98-4ed4-8180-7c2cdb1d65bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] Lock "96025e5d-7c98-4ed4-8180-7c2cdb1d65bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG nova.compute.manager [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] No waiting events found dispatching network-vif-plugged-de0da088-b53c-4792-b764-b6c6cd9dc5a3 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:37:51 user nova-compute[73484]: WARNING nova.compute.manager [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Received unexpected event network-vif-plugged-de0da088-b53c-4792-b764-b6c6cd9dc5a3 for instance with vm_state active and task_state None.
Aug 14 13:37:51 user nova-compute[73484]: DEBUG nova.compute.manager [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Received event network-vif-plugged-2eb5bc00-16a1-43cd-ac1f-db1d191fba75 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] Acquiring lock "7348b004-4d46-4db5-a451-afd3b7476569-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] Lock "7348b004-4d46-4db5-a451-afd3b7476569-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] Lock "7348b004-4d46-4db5-a451-afd3b7476569-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:51 user nova-compute[73484]: DEBUG nova.compute.manager [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] No waiting events found dispatching network-vif-plugged-2eb5bc00-16a1-43cd-ac1f-db1d191fba75 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:37:51 user nova-compute[73484]: WARNING nova.compute.manager [req-70153c3a-8a22-4c8d-980c-6e343176618d req-5fb65a60-3dda-45a2-86a5-2596ed2017f1 service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Received unexpected event network-vif-plugged-2eb5bc00-16a1-43cd-ac1f-db1d191fba75 for instance with vm_state active and task_state None.
Aug 14 13:37:52 user nova-compute[73484]: DEBUG nova.compute.manager [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:37:52 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Creating image(s)
Aug 14 13:37:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Did not create local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Ensure instance console log exists: /opt/stack/data/nova/instances/eaaccbea-d453-4943-9663-949c66029d87/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Start _get_guest_xml network_info=[{"id": "244b7f94-a32e-4724-858e-ae9be93a8003", "address": "fa:16:3e:4e:e1:a7", "network": {"id": "6480ad45-783a-4c79-adac-e661111d3cc8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1304007088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01c04593677842fc9bed43bb42776176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244b7f94-a3", "ovs_interfaceid": "244b7f94-a32e-4724-858e-ae9be93a8003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8dbb3acd-63b6-413b-abb1-af1cccc98d99', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NlzXhUZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eaaccbea-d453-4943-9663-949c66029d87', 'attached_at': '', 'detached_at': '', 'volume_id': 'abbda33a-ae60-404c-85b3-9df266cc1567', 'serial': 'abbda33a-ae60-404c-85b3-9df266cc1567'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:37:52 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:37:52 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:37:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG os_brick.initiator.connector [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Factory for ISCSI on None {{(pid=73484) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NlzXhUZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:37:52 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:37:52 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:37:52 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:37:52 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:37:52 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3f87fa-3547-4048-950b-b1fe18d52966]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:37:52 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e93584-d73a-4907-bd09-cd0e70b927f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567] added
Aug 14 13:37:52 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4db9a3-a647-445c-a778-c96c429fa036]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[17852eba-9ca4-4d35-8517-b20d9a2d5c49]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NlzXhUZD {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NlzXhUZD" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca9e508-b2c0-4027-bdaa-5cf5e19c8c6d]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NlzXhUZD'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[881ad652-1c94-4c86-89c1-fd838823735b]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f668e71d-0b55-49ae-8d60-bcd7e0a2e8ad]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 13:37:52 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 13:37:52 user nova-compute[73484]:  {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:37:52 user nova-compute[73484]: WARNING os_brick.initiator.connectors.iscsi [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 13:37:52 user nova-compute[73484]: 
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3715af0-aa45-4997-bd85-dd244ea64f84]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567, portal: 172.16.0.220,3260]
Aug 14 13:37:52 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567, portal: 172.16.0.220,3260] successful.
Aug 14 13:37:52 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e60f21c-eb6f-470c-a617-371b2d01dacd]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a704e588-970e-4fb0-b248-442d61f766b8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:37:52 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:37:52 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f744b90e-6c06-4647-a163-fbda68066335]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:37:52 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NlzXhUZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG nova.compute.manager [req-0b61e423-a90c-4087-a6d0-fd03377774c4 req-eb855205-4fbf-4190-a8ef-3a57d071278d service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Received event network-vif-plugged-2eb5bc00-16a1-43cd-ac1f-db1d191fba75 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0b61e423-a90c-4087-a6d0-fd03377774c4 req-eb855205-4fbf-4190-a8ef-3a57d071278d service nova] Acquiring lock "7348b004-4d46-4db5-a451-afd3b7476569-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0b61e423-a90c-4087-a6d0-fd03377774c4 req-eb855205-4fbf-4190-a8ef-3a57d071278d service nova] Lock "7348b004-4d46-4db5-a451-afd3b7476569-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0b61e423-a90c-4087-a6d0-fd03377774c4 req-eb855205-4fbf-4190-a8ef-3a57d071278d service nova] Lock "7348b004-4d46-4db5-a451-afd3b7476569-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG nova.compute.manager [req-0b61e423-a90c-4087-a6d0-fd03377774c4 req-eb855205-4fbf-4190-a8ef-3a57d071278d service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] No waiting events found dispatching network-vif-plugged-2eb5bc00-16a1-43cd-ac1f-db1d191fba75 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:37:53 user nova-compute[73484]: WARNING nova.compute.manager [req-0b61e423-a90c-4087-a6d0-fd03377774c4 req-eb855205-4fbf-4190-a8ef-3a57d071278d service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Received unexpected event network-vif-plugged-2eb5bc00-16a1-43cd-ac1f-db1d191fba75 for instance with vm_state active and task_state None.
Aug 14 13:37:53 user nova-compute[73484]: DEBUG nova.compute.manager [req-0b61e423-a90c-4087-a6d0-fd03377774c4 req-eb855205-4fbf-4190-a8ef-3a57d071278d service nova] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Received event network-vif-plugged-81a13981-b50f-4f1b-ac18-d4eea5f141fd {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0b61e423-a90c-4087-a6d0-fd03377774c4 req-eb855205-4fbf-4190-a8ef-3a57d071278d service nova] Acquiring lock "7ac05f68-a20f-4a57-b990-ef0799aadc58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0b61e423-a90c-4087-a6d0-fd03377774c4 req-eb855205-4fbf-4190-a8ef-3a57d071278d service nova] Lock "7ac05f68-a20f-4a57-b990-ef0799aadc58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0b61e423-a90c-4087-a6d0-fd03377774c4 req-eb855205-4fbf-4190-a8ef-3a57d071278d service nova] Lock "7ac05f68-a20f-4a57-b990-ef0799aadc58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG nova.compute.manager [req-0b61e423-a90c-4087-a6d0-fd03377774c4 req-eb855205-4fbf-4190-a8ef-3a57d071278d service nova] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] No waiting events found dispatching network-vif-plugged-81a13981-b50f-4f1b-ac18-d4eea5f141fd {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:37:53 user nova-compute[73484]: WARNING nova.compute.manager [req-0b61e423-a90c-4087-a6d0-fd03377774c4 req-eb855205-4fbf-4190-a8ef-3a57d071278d service nova] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Received unexpected event network-vif-plugged-81a13981-b50f-4f1b-ac18-d4eea5f141fd for instance with vm_state active and task_state None.
Aug 14 13:37:53 user nova-compute[73484]: DEBUG nova.compute.manager [req-0b61e423-a90c-4087-a6d0-fd03377774c4 req-eb855205-4fbf-4190-a8ef-3a57d071278d service nova] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Received event network-vif-plugged-81a13981-b50f-4f1b-ac18-d4eea5f141fd {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0b61e423-a90c-4087-a6d0-fd03377774c4 req-eb855205-4fbf-4190-a8ef-3a57d071278d service nova] Acquiring lock "7ac05f68-a20f-4a57-b990-ef0799aadc58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0b61e423-a90c-4087-a6d0-fd03377774c4 req-eb855205-4fbf-4190-a8ef-3a57d071278d service nova] Lock "7ac05f68-a20f-4a57-b990-ef0799aadc58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0b61e423-a90c-4087-a6d0-fd03377774c4 req-eb855205-4fbf-4190-a8ef-3a57d071278d service nova] Lock "7ac05f68-a20f-4a57-b990-ef0799aadc58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG nova.compute.manager [req-0b61e423-a90c-4087-a6d0-fd03377774c4 req-eb855205-4fbf-4190-a8ef-3a57d071278d service nova] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] No waiting events found dispatching network-vif-plugged-81a13981-b50f-4f1b-ac18-d4eea5f141fd {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:37:53 user nova-compute[73484]: WARNING nova.compute.manager [req-0b61e423-a90c-4087-a6d0-fd03377774c4 req-eb855205-4fbf-4190-a8ef-3a57d071278d service nova] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Received unexpected event network-vif-plugged-81a13981-b50f-4f1b-ac18-d4eea5f141fd for instance with vm_state active and task_state None.
Aug 14 13:37:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23465376430353639', 'path': '/dev/sdb'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465376430353639', 'path': '/dev/sdb'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:37:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-412988099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-412988099',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFj55/WSoxVS+Xy6UzME66O9FkMNrLin49xsiiA9z2iZT/1AKyfBBvPmClJSW2lvgg3Efp7L3zaMlvT135pSEqSZY+yrqXu3bGJndgNG3BKvJ92BRB7yHbpzJf2DGwaP3Q==',key_name='tempest-keypair-1536016686',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01c04593677842fc9bed43bb42776176',ramdisk_id='',reservation_id='r-cew2mp2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-38074168',owner_user_name='tempest-ServerActionsV293TestJSON-38074168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:37:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f609a87c04f40b68af1b78f8503c45c',uuid=eaaccbea-d453-4943-9663-949c66029d87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "244b7f94-a32e-4724-858e-ae9be93a8003", "address": "fa:16:3e:4e:e1:a7", "network": {"id": "6480ad45-783a-4c79-adac-e661111d3cc8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1304007088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01c04593677842fc9bed43bb42776176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244b7f94-a3", "ovs_interfaceid": "244b7f94-a32e-4724-858e-ae9be93a8003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Converting VIF {"id": "244b7f94-a32e-4724-858e-ae9be93a8003", "address": "fa:16:3e:4e:e1:a7", "network": {"id": "6480ad45-783a-4c79-adac-e661111d3cc8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1304007088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01c04593677842fc9bed43bb42776176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244b7f94-a3", "ovs_interfaceid": "244b7f94-a32e-4724-858e-ae9be93a8003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:e1:a7,bridge_name='br-int',has_traffic_filtering=True,id=244b7f94-a32e-4724-858e-ae9be93a8003,network=Network(6480ad45-783a-4c79-adac-e661111d3cc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244b7f94-a3') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG nova.objects.instance [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lazy-loading 'pci_devices' on Instance uuid eaaccbea-d453-4943-9663-949c66029d87 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:37:53 user nova-compute[73484]:   <uuid>eaaccbea-d453-4943-9663-949c66029d87</uuid>
Aug 14 13:37:53 user nova-compute[73484]:   <name>instance-0000000a</name>
Aug 14 13:37:53 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:37:53 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:37:53 user nova-compute[73484]:   <metadata>
Aug 14 13:37:53 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:37:53 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:37:53 user nova-compute[73484]:       <nova:name>tempest-ServerActionsV293TestJSON-server-412988099</nova:name>
Aug 14 13:37:53 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:37:52</nova:creationTime>
Aug 14 13:37:53 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:37:53 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:37:53 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:37:53 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:37:53 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:37:53 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:37:53 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:37:53 user nova-compute[73484]:       <nova:owner>
Aug 14 13:37:53 user nova-compute[73484]:         <nova:user uuid="9f609a87c04f40b68af1b78f8503c45c">tempest-ServerActionsV293TestJSON-38074168-project-member</nova:user>
Aug 14 13:37:53 user nova-compute[73484]:         <nova:project uuid="01c04593677842fc9bed43bb42776176">tempest-ServerActionsV293TestJSON-38074168</nova:project>
Aug 14 13:37:53 user nova-compute[73484]:       </nova:owner>
Aug 14 13:37:53 user nova-compute[73484]:       <nova:ports>
Aug 14 13:37:53 user nova-compute[73484]:         <nova:port uuid="244b7f94-a32e-4724-858e-ae9be93a8003">
Aug 14 13:37:53 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 13:37:53 user nova-compute[73484]:         </nova:port>
Aug 14 13:37:53 user nova-compute[73484]:       </nova:ports>
Aug 14 13:37:53 user nova-compute[73484]:     </nova:instance>
Aug 14 13:37:53 user nova-compute[73484]:   </metadata>
Aug 14 13:37:53 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:37:53 user nova-compute[73484]:     <system>
Aug 14 13:37:53 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:37:53 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:37:53 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:37:53 user nova-compute[73484]:       <entry name="serial">eaaccbea-d453-4943-9663-949c66029d87</entry>
Aug 14 13:37:53 user nova-compute[73484]:       <entry name="uuid">eaaccbea-d453-4943-9663-949c66029d87</entry>
Aug 14 13:37:53 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:37:53 user nova-compute[73484]:     </system>
Aug 14 13:37:53 user nova-compute[73484]:   </sysinfo>
Aug 14 13:37:53 user nova-compute[73484]:   <os>
Aug 14 13:37:53 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:37:53 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:37:53 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:37:53 user nova-compute[73484]:   </os>
Aug 14 13:37:53 user nova-compute[73484]:   <features>
Aug 14 13:37:53 user nova-compute[73484]:     <acpi/>
Aug 14 13:37:53 user nova-compute[73484]:     <apic/>
Aug 14 13:37:53 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:37:53 user nova-compute[73484]:   </features>
Aug 14 13:37:53 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:37:53 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:37:53 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:37:53 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:37:53 user nova-compute[73484]:   </clock>
Aug 14 13:37:53 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:37:53 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:37:53 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:37:53 user nova-compute[73484]:   </cpu>
Aug 14 13:37:53 user nova-compute[73484]:   <devices>
Aug 14 13:37:53 user nova-compute[73484]:     <disk type="block" device="disk">
Aug 14 13:37:53 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:37:53 user nova-compute[73484]:       <source dev="/dev/sdb"/>
Aug 14 13:37:53 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:37:53 user nova-compute[73484]:       <serial>abbda33a-ae60-404c-85b3-9df266cc1567</serial>
Aug 14 13:37:53 user nova-compute[73484]:     </disk>
Aug 14 13:37:53 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:37:53 user nova-compute[73484]:       <mac address="fa:16:3e:4e:e1:a7"/>
Aug 14 13:37:53 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:37:53 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:37:53 user nova-compute[73484]:       <target dev="tap244b7f94-a3"/>
Aug 14 13:37:53 user nova-compute[73484]:     </interface>
Aug 14 13:37:53 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:37:53 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/eaaccbea-d453-4943-9663-949c66029d87/console.log" append="off"/>
Aug 14 13:37:53 user nova-compute[73484]:     </serial>
Aug 14 13:37:53 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:37:53 user nova-compute[73484]:     <video>
Aug 14 13:37:53 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:37:53 user nova-compute[73484]:     </video>
Aug 14 13:37:53 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:37:53 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:37:53 user nova-compute[73484]:     </rng>
Aug 14 13:37:53 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:37:53 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:37:53 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:37:53 user nova-compute[73484]:     </memballoon>
Aug 14 13:37:53 user nova-compute[73484]:   </devices>
Aug 14 13:37:53 user nova-compute[73484]: </domain>
Aug 14 13:37:53 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:37:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-412988099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-412988099',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFj55/WSoxVS+Xy6UzME66O9FkMNrLin49xsiiA9z2iZT/1AKyfBBvPmClJSW2lvgg3Efp7L3zaMlvT135pSEqSZY+yrqXu3bGJndgNG3BKvJ92BRB7yHbpzJf2DGwaP3Q==',key_name='tempest-keypair-1536016686',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01c04593677842fc9bed43bb42776176',ramdisk_id='',reservation_id='r-cew2mp2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-38074168',owner_user_name='tempest-ServerActionsV293TestJSON-38074168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:37:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f609a87c04f40b68af1b78f8503c45c',uuid=eaaccbea-d453-4943-9663-949c66029d87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "244b7f94-a32e-4724-858e-ae9be93a8003", "address": "fa:16:3e:4e:e1:a7", "network": {"id": "6480ad45-783a-4c79-adac-e661111d3cc8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1304007088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01c04593677842fc9bed43bb42776176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244b7f94-a3", "ovs_interfaceid": "244b7f94-a32e-4724-858e-ae9be93a8003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Converting VIF {"id": "244b7f94-a32e-4724-858e-ae9be93a8003", "address": "fa:16:3e:4e:e1:a7", "network": {"id": "6480ad45-783a-4c79-adac-e661111d3cc8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1304007088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01c04593677842fc9bed43bb42776176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244b7f94-a3", "ovs_interfaceid": "244b7f94-a32e-4724-858e-ae9be93a8003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:e1:a7,bridge_name='br-int',has_traffic_filtering=True,id=244b7f94-a32e-4724-858e-ae9be93a8003,network=Network(6480ad45-783a-4c79-adac-e661111d3cc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244b7f94-a3') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG os_vif [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:e1:a7,bridge_name='br-int',has_traffic_filtering=True,id=244b7f94-a32e-4724-858e-ae9be93a8003,network=Network(6480ad45-783a-4c79-adac-e661111d3cc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244b7f94-a3') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap244b7f94-a3, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap244b7f94-a3, col_values=(('external_ids', {'iface-id': '244b7f94-a32e-4724-858e-ae9be93a8003', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:e1:a7', 'vm-uuid': 'eaaccbea-d453-4943-9663-949c66029d87'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:53 user nova-compute[73484]: INFO os_vif [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:e1:a7,bridge_name='br-int',has_traffic_filtering=True,id=244b7f94-a32e-4724-858e-ae9be93a8003,network=Network(6480ad45-783a-4c79-adac-e661111d3cc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244b7f94-a3')
Aug 14 13:37:53 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:37:53 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] No VIF found with MAC fa:16:3e:4e:e1:a7, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:37:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:55 user nova-compute[73484]: DEBUG nova.compute.manager [req-21371be6-70d4-49ae-8a52-6ccfaf046008 req-a909eee5-b370-4294-9720-9fd74de60e96 service nova] [instance: eaaccbea-d453-4943-9663-949c66029d87] Received event network-vif-plugged-244b7f94-a32e-4724-858e-ae9be93a8003 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:37:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-21371be6-70d4-49ae-8a52-6ccfaf046008 req-a909eee5-b370-4294-9720-9fd74de60e96 service nova] Acquiring lock "eaaccbea-d453-4943-9663-949c66029d87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-21371be6-70d4-49ae-8a52-6ccfaf046008 req-a909eee5-b370-4294-9720-9fd74de60e96 service nova] Lock "eaaccbea-d453-4943-9663-949c66029d87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-21371be6-70d4-49ae-8a52-6ccfaf046008 req-a909eee5-b370-4294-9720-9fd74de60e96 service nova] Lock "eaaccbea-d453-4943-9663-949c66029d87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:55 user nova-compute[73484]: DEBUG nova.compute.manager [req-21371be6-70d4-49ae-8a52-6ccfaf046008 req-a909eee5-b370-4294-9720-9fd74de60e96 service nova] [instance: eaaccbea-d453-4943-9663-949c66029d87] No waiting events found dispatching network-vif-plugged-244b7f94-a32e-4724-858e-ae9be93a8003 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:37:55 user nova-compute[73484]: WARNING nova.compute.manager [req-21371be6-70d4-49ae-8a52-6ccfaf046008 req-a909eee5-b370-4294-9720-9fd74de60e96 service nova] [instance: eaaccbea-d453-4943-9663-949c66029d87] Received unexpected event network-vif-plugged-244b7f94-a32e-4724-858e-ae9be93a8003 for instance with vm_state building and task_state spawning.
Aug 14 13:37:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:57 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020277.6614485, eaaccbea-d453-4943-9663-949c66029d87 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:37:57 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: eaaccbea-d453-4943-9663-949c66029d87] VM Resumed (Lifecycle Event)
Aug 14 13:37:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:37:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:37:57 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: eaaccbea-d453-4943-9663-949c66029d87] Instance spawned successfully.
Aug 14 13:37:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:37:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: eaaccbea-d453-4943-9663-949c66029d87] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:37:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: eaaccbea-d453-4943-9663-949c66029d87] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:37:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:37:57 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: eaaccbea-d453-4943-9663-949c66029d87] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:37:57 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020277.6649542, eaaccbea-d453-4943-9663-949c66029d87 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:37:57 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: eaaccbea-d453-4943-9663-949c66029d87] VM Started (Lifecycle Event)
Aug 14 13:37:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: eaaccbea-d453-4943-9663-949c66029d87] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:37:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: eaaccbea-d453-4943-9663-949c66029d87] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:37:57 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: eaaccbea-d453-4943-9663-949c66029d87] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:37:57 user nova-compute[73484]: INFO nova.compute.manager [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Took 5.42 seconds to spawn the instance on the hypervisor.
Aug 14 13:37:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:37:57 user nova-compute[73484]: DEBUG nova.compute.manager [req-124f15ab-bf1a-4636-84ec-09bf8ad28af4 req-074b9a8e-c508-4f08-82b4-efdddb0dd69f service nova] [instance: eaaccbea-d453-4943-9663-949c66029d87] Received event network-vif-plugged-244b7f94-a32e-4724-858e-ae9be93a8003 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:37:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-124f15ab-bf1a-4636-84ec-09bf8ad28af4 req-074b9a8e-c508-4f08-82b4-efdddb0dd69f service nova] Acquiring lock "eaaccbea-d453-4943-9663-949c66029d87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:37:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-124f15ab-bf1a-4636-84ec-09bf8ad28af4 req-074b9a8e-c508-4f08-82b4-efdddb0dd69f service nova] Lock "eaaccbea-d453-4943-9663-949c66029d87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:37:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-124f15ab-bf1a-4636-84ec-09bf8ad28af4 req-074b9a8e-c508-4f08-82b4-efdddb0dd69f service nova] Lock "eaaccbea-d453-4943-9663-949c66029d87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:57 user nova-compute[73484]: DEBUG nova.compute.manager [req-124f15ab-bf1a-4636-84ec-09bf8ad28af4 req-074b9a8e-c508-4f08-82b4-efdddb0dd69f service nova] [instance: eaaccbea-d453-4943-9663-949c66029d87] No waiting events found dispatching network-vif-plugged-244b7f94-a32e-4724-858e-ae9be93a8003 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:37:57 user nova-compute[73484]: WARNING nova.compute.manager [req-124f15ab-bf1a-4636-84ec-09bf8ad28af4 req-074b9a8e-c508-4f08-82b4-efdddb0dd69f service nova] [instance: eaaccbea-d453-4943-9663-949c66029d87] Received unexpected event network-vif-plugged-244b7f94-a32e-4724-858e-ae9be93a8003 for instance with vm_state building and task_state spawning.
Aug 14 13:37:57 user nova-compute[73484]: INFO nova.compute.manager [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Took 22.05 seconds to build instance.
Aug 14 13:37:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-30451e64-5649-4907-9ed3-c23fff3b32b1 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lock "eaaccbea-d453-4943-9663-949c66029d87" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.200s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:37:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:37:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Acquiring lock "18feef86-7a18-43e3-80cb-fb1d01d34d49" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:38:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:38:01 user nova-compute[73484]: DEBUG nova.compute.manager [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:38:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:38:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:38:01 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:38:01 user nova-compute[73484]: INFO nova.compute.claims [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Claim successful on node user
Aug 14 13:38:02 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:38:02 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:38:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.550s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:38:02 user nova-compute[73484]: DEBUG nova.compute.manager [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:38:02 user nova-compute[73484]: DEBUG nova.compute.manager [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:38:02 user nova-compute[73484]: DEBUG nova.network.neutron [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:38:02 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:38:02 user nova-compute[73484]: DEBUG nova.compute.manager [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:38:02 user nova-compute[73484]: INFO nova.virt.block_device [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Booting with volume f0e13048-762f-4009-88c3-d5594be47a07 at /dev/vda
Aug 14 13:38:02 user nova-compute[73484]: DEBUG nova.policy [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2355c1d4bfcb475ca72fbc555e38f6f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a61399aa994f3b890de6ad50d91d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:38:02 user nova-compute[73484]: DEBUG os_brick.utils [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:38:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:02 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2bac16-9947-4c36-bf7a-fd5fdaf10bc1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:02 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc44371e-a694-4f44-89db-578703ccc460]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:02 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbd3412-c9d4-429c-b475-eb8da53b6d3a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:02 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22ddb5f-f731-4fd3-8fcf-ec0853967691]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:38:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:38:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:38:02 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:38:02 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23956ca-4661-4c72-b92b-e0dd6de4b8a7]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:38:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:38:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:38:02 user nova-compute[73484]: DEBUG os_brick.utils [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:38:02 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Updating existing volume attachment record: ce8e2756-5e06-4c77-839d-0384e0d9263c {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:38:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:03 user nova-compute[73484]: DEBUG nova.network.neutron [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Successfully created port: 876f74d5-7991-4068-8fa4-625ac7cc3d22 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:38:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:04 user nova-compute[73484]: DEBUG nova.network.neutron [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Successfully created port: 29ec01c6-3b25-4dfa-a9de-5474a29d0c5e {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:38:05 user nova-compute[73484]: DEBUG nova.network.neutron [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Successfully created port: 9672687d-4ab3-4b9d-886b-fc73d8f551d6 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:38:05 user nova-compute[73484]: DEBUG nova.network.neutron [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Successfully created port: 489a48ce-8925-499b-a234-c92c2d760375 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:38:06 user nova-compute[73484]: DEBUG nova.network.neutron [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Successfully created port: a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:38:07 user nova-compute[73484]: DEBUG nova.network.neutron [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Successfully updated port: 876f74d5-7991-4068-8fa4-625ac7cc3d22 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:38:07 user nova-compute[73484]: DEBUG nova.compute.manager [req-5079c7c2-fe28-489c-8351-0a31b0e009c8 req-81537c6d-4df3-4bf2-a4ac-392a65b1e6f0 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-changed-876f74d5-7991-4068-8fa4-625ac7cc3d22 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:38:07 user nova-compute[73484]: DEBUG nova.compute.manager [req-5079c7c2-fe28-489c-8351-0a31b0e009c8 req-81537c6d-4df3-4bf2-a4ac-392a65b1e6f0 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Refreshing instance network info cache due to event network-changed-876f74d5-7991-4068-8fa4-625ac7cc3d22. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:38:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5079c7c2-fe28-489c-8351-0a31b0e009c8 req-81537c6d-4df3-4bf2-a4ac-392a65b1e6f0 service nova] Acquiring lock "refresh_cache-18feef86-7a18-43e3-80cb-fb1d01d34d49" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:38:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5079c7c2-fe28-489c-8351-0a31b0e009c8 req-81537c6d-4df3-4bf2-a4ac-392a65b1e6f0 service nova] Acquired lock "refresh_cache-18feef86-7a18-43e3-80cb-fb1d01d34d49" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:38:07 user nova-compute[73484]: DEBUG nova.network.neutron [req-5079c7c2-fe28-489c-8351-0a31b0e009c8 req-81537c6d-4df3-4bf2-a4ac-392a65b1e6f0 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Refreshing network info cache for port 876f74d5-7991-4068-8fa4-625ac7cc3d22 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:38:07 user nova-compute[73484]: DEBUG nova.network.neutron [req-5079c7c2-fe28-489c-8351-0a31b0e009c8 req-81537c6d-4df3-4bf2-a4ac-392a65b1e6f0 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:38:08 user nova-compute[73484]: DEBUG nova.network.neutron [req-5079c7c2-fe28-489c-8351-0a31b0e009c8 req-81537c6d-4df3-4bf2-a4ac-392a65b1e6f0 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:38:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5079c7c2-fe28-489c-8351-0a31b0e009c8 req-81537c6d-4df3-4bf2-a4ac-392a65b1e6f0 service nova] Releasing lock "refresh_cache-18feef86-7a18-43e3-80cb-fb1d01d34d49" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:38:08 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:08 user nova-compute[73484]: DEBUG nova.network.neutron [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Successfully updated port: 32ed41f4-a698-4873-98aa-ab0a08e09ad1 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:38:08 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:09 user nova-compute[73484]: DEBUG nova.compute.manager [req-a380a48b-144e-420d-9adf-d1f51998706e req-7145299f-586f-44b4-a316-3344614c5dc8 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-changed-32ed41f4-a698-4873-98aa-ab0a08e09ad1 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:38:09 user nova-compute[73484]: DEBUG nova.compute.manager [req-a380a48b-144e-420d-9adf-d1f51998706e req-7145299f-586f-44b4-a316-3344614c5dc8 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Refreshing instance network info cache due to event network-changed-32ed41f4-a698-4873-98aa-ab0a08e09ad1. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:38:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a380a48b-144e-420d-9adf-d1f51998706e req-7145299f-586f-44b4-a316-3344614c5dc8 service nova] Acquiring lock "refresh_cache-18feef86-7a18-43e3-80cb-fb1d01d34d49" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:38:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a380a48b-144e-420d-9adf-d1f51998706e req-7145299f-586f-44b4-a316-3344614c5dc8 service nova] Acquired lock "refresh_cache-18feef86-7a18-43e3-80cb-fb1d01d34d49" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:38:09 user nova-compute[73484]: DEBUG nova.network.neutron [req-a380a48b-144e-420d-9adf-d1f51998706e req-7145299f-586f-44b4-a316-3344614c5dc8 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Refreshing network info cache for port 32ed41f4-a698-4873-98aa-ab0a08e09ad1 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:38:09 user nova-compute[73484]: DEBUG nova.network.neutron [req-a380a48b-144e-420d-9adf-d1f51998706e req-7145299f-586f-44b4-a316-3344614c5dc8 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:38:09 user nova-compute[73484]: DEBUG nova.network.neutron [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Successfully updated port: 44be0321-53ca-43af-9af4-35ed291d2695 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:38:10 user nova-compute[73484]: DEBUG nova.network.neutron [req-a380a48b-144e-420d-9adf-d1f51998706e req-7145299f-586f-44b4-a316-3344614c5dc8 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:38:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a380a48b-144e-420d-9adf-d1f51998706e req-7145299f-586f-44b4-a316-3344614c5dc8 service nova] Releasing lock "refresh_cache-18feef86-7a18-43e3-80cb-fb1d01d34d49" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:38:11 user nova-compute[73484]: DEBUG nova.network.neutron [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Successfully updated port: 29ec01c6-3b25-4dfa-a9de-5474a29d0c5e {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:38:11 user nova-compute[73484]: DEBUG nova.compute.manager [req-ff3f3ee7-6f3d-477e-aaf1-f3e12ad386a1 req-a9262a04-dd82-4f70-8b02-cc8d1f6e6be8 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-changed-44be0321-53ca-43af-9af4-35ed291d2695 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:38:11 user nova-compute[73484]: DEBUG nova.compute.manager [req-ff3f3ee7-6f3d-477e-aaf1-f3e12ad386a1 req-a9262a04-dd82-4f70-8b02-cc8d1f6e6be8 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Refreshing instance network info cache due to event network-changed-44be0321-53ca-43af-9af4-35ed291d2695. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:38:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ff3f3ee7-6f3d-477e-aaf1-f3e12ad386a1 req-a9262a04-dd82-4f70-8b02-cc8d1f6e6be8 service nova] Acquiring lock "refresh_cache-18feef86-7a18-43e3-80cb-fb1d01d34d49" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:38:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ff3f3ee7-6f3d-477e-aaf1-f3e12ad386a1 req-a9262a04-dd82-4f70-8b02-cc8d1f6e6be8 service nova] Acquired lock "refresh_cache-18feef86-7a18-43e3-80cb-fb1d01d34d49" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:38:11 user nova-compute[73484]: DEBUG nova.network.neutron [req-ff3f3ee7-6f3d-477e-aaf1-f3e12ad386a1 req-a9262a04-dd82-4f70-8b02-cc8d1f6e6be8 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Refreshing network info cache for port 44be0321-53ca-43af-9af4-35ed291d2695 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:38:11 user nova-compute[73484]: DEBUG nova.network.neutron [req-ff3f3ee7-6f3d-477e-aaf1-f3e12ad386a1 req-a9262a04-dd82-4f70-8b02-cc8d1f6e6be8 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:38:11 user nova-compute[73484]: DEBUG nova.network.neutron [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Successfully updated port: 9672687d-4ab3-4b9d-886b-fc73d8f551d6 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:38:12 user nova-compute[73484]: DEBUG nova.network.neutron [req-ff3f3ee7-6f3d-477e-aaf1-f3e12ad386a1 req-a9262a04-dd82-4f70-8b02-cc8d1f6e6be8 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:38:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ff3f3ee7-6f3d-477e-aaf1-f3e12ad386a1 req-a9262a04-dd82-4f70-8b02-cc8d1f6e6be8 service nova] Releasing lock "refresh_cache-18feef86-7a18-43e3-80cb-fb1d01d34d49" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:38:12 user nova-compute[73484]: DEBUG nova.compute.manager [req-ff3f3ee7-6f3d-477e-aaf1-f3e12ad386a1 req-a9262a04-dd82-4f70-8b02-cc8d1f6e6be8 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-changed-29ec01c6-3b25-4dfa-a9de-5474a29d0c5e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:38:12 user nova-compute[73484]: DEBUG nova.compute.manager [req-ff3f3ee7-6f3d-477e-aaf1-f3e12ad386a1 req-a9262a04-dd82-4f70-8b02-cc8d1f6e6be8 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Refreshing instance network info cache due to event network-changed-29ec01c6-3b25-4dfa-a9de-5474a29d0c5e. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:38:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ff3f3ee7-6f3d-477e-aaf1-f3e12ad386a1 req-a9262a04-dd82-4f70-8b02-cc8d1f6e6be8 service nova] Acquiring lock "refresh_cache-18feef86-7a18-43e3-80cb-fb1d01d34d49" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:38:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ff3f3ee7-6f3d-477e-aaf1-f3e12ad386a1 req-a9262a04-dd82-4f70-8b02-cc8d1f6e6be8 service nova] Acquired lock "refresh_cache-18feef86-7a18-43e3-80cb-fb1d01d34d49" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:38:12 user nova-compute[73484]: DEBUG nova.network.neutron [req-ff3f3ee7-6f3d-477e-aaf1-f3e12ad386a1 req-a9262a04-dd82-4f70-8b02-cc8d1f6e6be8 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Refreshing network info cache for port 29ec01c6-3b25-4dfa-a9de-5474a29d0c5e {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:38:12 user nova-compute[73484]: DEBUG nova.network.neutron [req-ff3f3ee7-6f3d-477e-aaf1-f3e12ad386a1 req-a9262a04-dd82-4f70-8b02-cc8d1f6e6be8 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:38:12 user nova-compute[73484]: INFO nova.virt.block_device [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Booting with volume 7259b003-154c-4381-83d3-e5a23346a220 at /dev/vdb
Aug 14 13:38:12 user nova-compute[73484]: DEBUG os_brick.utils [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:38:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:12 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[32340588-072b-49dc-9644-1b63d32e35c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:12 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f307a7d-9f45-447d-9594-66c20691b2e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:12 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[be281ecd-eb90-4cda-ba36-666b4b728273]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:12 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed3146b-2a65-485a-9c3d-b17097774d56]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:38:12 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:38:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:38:12 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:38:12 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed1b5ee-43b5-43ed-8071-efb1ec1ee13e]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:12 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:38:12 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:38:12 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:38:12 user nova-compute[73484]: DEBUG os_brick.utils [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:38:12 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Updating existing volume attachment record: 9f4bc2ef-8e5b-4de7-b922-affbfacacf89 {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:38:12 user nova-compute[73484]: DEBUG nova.network.neutron [req-ff3f3ee7-6f3d-477e-aaf1-f3e12ad386a1 req-a9262a04-dd82-4f70-8b02-cc8d1f6e6be8 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:38:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ff3f3ee7-6f3d-477e-aaf1-f3e12ad386a1 req-a9262a04-dd82-4f70-8b02-cc8d1f6e6be8 service nova] Releasing lock "refresh_cache-18feef86-7a18-43e3-80cb-fb1d01d34d49" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:38:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:13 user nova-compute[73484]: DEBUG nova.network.neutron [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Successfully updated port: 489a48ce-8925-499b-a234-c92c2d760375 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:38:13 user nova-compute[73484]: DEBUG nova.compute.manager [req-6931370b-47c3-4c60-8a40-418a2c0942ab req-edd25543-b707-4b01-8a46-83582615292b service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-changed-9672687d-4ab3-4b9d-886b-fc73d8f551d6 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:38:13 user nova-compute[73484]: DEBUG nova.compute.manager [req-6931370b-47c3-4c60-8a40-418a2c0942ab req-edd25543-b707-4b01-8a46-83582615292b service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Refreshing instance network info cache due to event network-changed-9672687d-4ab3-4b9d-886b-fc73d8f551d6. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:38:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6931370b-47c3-4c60-8a40-418a2c0942ab req-edd25543-b707-4b01-8a46-83582615292b service nova] Acquiring lock "refresh_cache-18feef86-7a18-43e3-80cb-fb1d01d34d49" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:38:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6931370b-47c3-4c60-8a40-418a2c0942ab req-edd25543-b707-4b01-8a46-83582615292b service nova] Acquired lock "refresh_cache-18feef86-7a18-43e3-80cb-fb1d01d34d49" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:38:13 user nova-compute[73484]: DEBUG nova.network.neutron [req-6931370b-47c3-4c60-8a40-418a2c0942ab req-edd25543-b707-4b01-8a46-83582615292b service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Refreshing network info cache for port 9672687d-4ab3-4b9d-886b-fc73d8f551d6 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:38:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:13 user nova-compute[73484]: DEBUG nova.network.neutron [req-6931370b-47c3-4c60-8a40-418a2c0942ab req-edd25543-b707-4b01-8a46-83582615292b service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:38:14 user nova-compute[73484]: DEBUG nova.network.neutron [req-6931370b-47c3-4c60-8a40-418a2c0942ab req-edd25543-b707-4b01-8a46-83582615292b service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:38:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6931370b-47c3-4c60-8a40-418a2c0942ab req-edd25543-b707-4b01-8a46-83582615292b service nova] Releasing lock "refresh_cache-18feef86-7a18-43e3-80cb-fb1d01d34d49" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:38:14 user nova-compute[73484]: DEBUG nova.compute.manager [req-6931370b-47c3-4c60-8a40-418a2c0942ab req-edd25543-b707-4b01-8a46-83582615292b service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-changed-489a48ce-8925-499b-a234-c92c2d760375 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:38:14 user nova-compute[73484]: DEBUG nova.compute.manager [req-6931370b-47c3-4c60-8a40-418a2c0942ab req-edd25543-b707-4b01-8a46-83582615292b service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Refreshing instance network info cache due to event network-changed-489a48ce-8925-499b-a234-c92c2d760375. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:38:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6931370b-47c3-4c60-8a40-418a2c0942ab req-edd25543-b707-4b01-8a46-83582615292b service nova] Acquiring lock "refresh_cache-18feef86-7a18-43e3-80cb-fb1d01d34d49" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:38:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6931370b-47c3-4c60-8a40-418a2c0942ab req-edd25543-b707-4b01-8a46-83582615292b service nova] Acquired lock "refresh_cache-18feef86-7a18-43e3-80cb-fb1d01d34d49" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:38:14 user nova-compute[73484]: DEBUG nova.network.neutron [req-6931370b-47c3-4c60-8a40-418a2c0942ab req-edd25543-b707-4b01-8a46-83582615292b service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Refreshing network info cache for port 489a48ce-8925-499b-a234-c92c2d760375 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:38:14 user nova-compute[73484]: DEBUG nova.network.neutron [req-6931370b-47c3-4c60-8a40-418a2c0942ab req-edd25543-b707-4b01-8a46-83582615292b service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:38:14 user nova-compute[73484]: DEBUG nova.network.neutron [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Successfully updated port: a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:38:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Acquiring lock "refresh_cache-18feef86-7a18-43e3-80cb-fb1d01d34d49" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:38:14 user nova-compute[73484]: DEBUG nova.network.neutron [req-6931370b-47c3-4c60-8a40-418a2c0942ab req-edd25543-b707-4b01-8a46-83582615292b service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:38:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6931370b-47c3-4c60-8a40-418a2c0942ab req-edd25543-b707-4b01-8a46-83582615292b service nova] Releasing lock "refresh_cache-18feef86-7a18-43e3-80cb-fb1d01d34d49" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:38:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Acquired lock "refresh_cache-18feef86-7a18-43e3-80cb-fb1d01d34d49" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:38:14 user nova-compute[73484]: DEBUG nova.network.neutron [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:38:14 user nova-compute[73484]: DEBUG nova.network.neutron [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:38:15 user nova-compute[73484]: DEBUG nova.compute.manager [req-d937f8bc-da8b-4699-ac6e-983bbe39330e req-2c46a7ef-ac91-4afb-adf0-a075c279737a service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-changed-a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:38:15 user nova-compute[73484]: DEBUG nova.compute.manager [req-d937f8bc-da8b-4699-ac6e-983bbe39330e req-2c46a7ef-ac91-4afb-adf0-a075c279737a service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Refreshing instance network info cache due to event network-changed-a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:38:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d937f8bc-da8b-4699-ac6e-983bbe39330e req-2c46a7ef-ac91-4afb-adf0-a075c279737a service nova] Acquiring lock "refresh_cache-18feef86-7a18-43e3-80cb-fb1d01d34d49" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:38:16 user nova-compute[73484]: DEBUG nova.network.neutron [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Updating instance_info_cache with network_info: [{"id": "876f74d5-7991-4068-8fa4-625ac7cc3d22", "address": "fa:16:3e:66:68:cc", "network": {"id": "1a9b1894-c8aa-4c1c-a1dc-70f91e648b89", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1258957124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap876f74d5-79", "ovs_interfaceid": "876f74d5-7991-4068-8fa4-625ac7cc3d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "32ed41f4-a698-4873-98aa-ab0a08e09ad1", "address": "fa:16:3e:61:3b:99", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32ed41f4-a6", "ovs_interfaceid": "32ed41f4-a698-4873-98aa-ab0a08e09ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44be0321-53ca-43af-9af4-35ed291d2695", "address": "fa:16:3e:1f:78:bf", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44be0321-53", "ovs_interfaceid": "44be0321-53ca-43af-9af4-35ed291d2695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "29ec01c6-3b25-4dfa-a9de-5474a29d0c5e", "address": "fa:16:3e:90:ec:d6", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec01c6-3b", "ovs_interfaceid": "29ec01c6-3b25-4dfa-a9de-5474a29d0c5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9672687d-4ab3-4b9d-886b-fc73d8f551d6", "address": "fa:16:3e:7f:7d:8d", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9672687d-4a", "ovs_interfaceid": "9672687d-4ab3-4b9d-886b-fc73d8f551d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "489a48ce-8925-499b-a234-c92c2d760375", "address": "fa:16:3e:b9:d7:ad", "network": {"id": "6811ba1b-eff5-4665-8046-cfb393845d13", "bridge": "br-int", "label": "tempest-device-tagging-net2-585065546", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap489a48ce-89", "ovs_interfaceid": "489a48ce-8925-499b-a234-c92c2d760375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d", "address": "fa:16:3e:5d:7d:d6", "network": {"id": "6811ba1b-eff5-4665-8046-cfb393845d13", "bridge": "br-int", "label": "tempest-device-tagging-net2-585065546", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e1d6f8-1c", "ovs_interfaceid": "a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:38:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Releasing lock "refresh_cache-18feef86-7a18-43e3-80cb-fb1d01d34d49" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:38:16 user nova-compute[73484]: DEBUG nova.compute.manager [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Instance network_info: |[{"id": "876f74d5-7991-4068-8fa4-625ac7cc3d22", "address": "fa:16:3e:66:68:cc", "network": {"id": "1a9b1894-c8aa-4c1c-a1dc-70f91e648b89", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1258957124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap876f74d5-79", "ovs_interfaceid": "876f74d5-7991-4068-8fa4-625ac7cc3d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "32ed41f4-a698-4873-98aa-ab0a08e09ad1", "address": "fa:16:3e:61:3b:99", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32ed41f4-a6", "ovs_interfaceid": "32ed41f4-a698-4873-98aa-ab0a08e09ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44be0321-53ca-43af-9af4-35ed291d2695", "address": "fa:16:3e:1f:78:bf", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44be0321-53", "ovs_interfaceid": "44be0321-53ca-43af-9af4-35ed291d2695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "29ec01c6-3b25-4dfa-a9de-5474a29d0c5e", "address": "fa:16:3e:90:ec:d6", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec01c6-3b", "ovs_interfaceid": "29ec01c6-3b25-4dfa-a9de-5474a29d0c5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9672687d-4ab3-4b9d-886b-fc73d8f551d6", "address": "fa:16:3e:7f:7d:8d", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9672687d-4a", "ovs_interfaceid": "9672687d-4ab3-4b9d-886b-fc73d8f551d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "489a48ce-8925-499b-a234-c92c2d760375", "address": "fa:16:3e:b9:d7:ad", "network": {"id": "6811ba1b-eff5-4665-8046-cfb393845d13", "bridge": "br-int", "label": "tempest-device-tagging-net2-585065546", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap489a48ce-89", "ovs_interfaceid": "489a48ce-8925-499b-a234-c92c2d760375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d", "address": "fa:16:3e:5d:7d:d6", "network": {"id": "6811ba1b-eff5-4665-8046-cfb393845d13", "bridge": "br-int", "label": "tempest-device-tagging-net2-585065546", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e1d6f8-1c", "ovs_interfaceid": "a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:38:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d937f8bc-da8b-4699-ac6e-983bbe39330e req-2c46a7ef-ac91-4afb-adf0-a075c279737a service nova] Acquired lock "refresh_cache-18feef86-7a18-43e3-80cb-fb1d01d34d49" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:38:16 user nova-compute[73484]: DEBUG nova.network.neutron [req-d937f8bc-da8b-4699-ac6e-983bbe39330e req-2c46a7ef-ac91-4afb-adf0-a075c279737a service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Refreshing network info cache for port a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:38:17 user nova-compute[73484]: DEBUG nova.network.neutron [req-d937f8bc-da8b-4699-ac6e-983bbe39330e req-2c46a7ef-ac91-4afb-adf0-a075c279737a service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Updated VIF entry in instance network info cache for port a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:38:17 user nova-compute[73484]: DEBUG nova.network.neutron [req-d937f8bc-da8b-4699-ac6e-983bbe39330e req-2c46a7ef-ac91-4afb-adf0-a075c279737a service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Updating instance_info_cache with network_info: [{"id": "876f74d5-7991-4068-8fa4-625ac7cc3d22", "address": "fa:16:3e:66:68:cc", "network": {"id": "1a9b1894-c8aa-4c1c-a1dc-70f91e648b89", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1258957124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap876f74d5-79", "ovs_interfaceid": "876f74d5-7991-4068-8fa4-625ac7cc3d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "32ed41f4-a698-4873-98aa-ab0a08e09ad1", "address": "fa:16:3e:61:3b:99", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32ed41f4-a6", "ovs_interfaceid": "32ed41f4-a698-4873-98aa-ab0a08e09ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44be0321-53ca-43af-9af4-35ed291d2695", "address": "fa:16:3e:1f:78:bf", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44be0321-53", "ovs_interfaceid": "44be0321-53ca-43af-9af4-35ed291d2695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "29ec01c6-3b25-4dfa-a9de-5474a29d0c5e", "address": "fa:16:3e:90:ec:d6", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec01c6-3b", "ovs_interfaceid": "29ec01c6-3b25-4dfa-a9de-5474a29d0c5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9672687d-4ab3-4b9d-886b-fc73d8f551d6", "address": "fa:16:3e:7f:7d:8d", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9672687d-4a", "ovs_interfaceid": "9672687d-4ab3-4b9d-886b-fc73d8f551d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "489a48ce-8925-499b-a234-c92c2d760375", "address": "fa:16:3e:b9:d7:ad", "network": {"id": "6811ba1b-eff5-4665-8046-cfb393845d13", "bridge": "br-int", "label": "tempest-device-tagging-net2-585065546", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap489a48ce-89", "ovs_interfaceid": "489a48ce-8925-499b-a234-c92c2d760375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d", "address": "fa:16:3e:5d:7d:d6", "network": {"id": "6811ba1b-eff5-4665-8046-cfb393845d13", "bridge": "br-int", "label": "tempest-device-tagging-net2-585065546", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e1d6f8-1c", "ovs_interfaceid": "a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:38:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d937f8bc-da8b-4699-ac6e-983bbe39330e req-2c46a7ef-ac91-4afb-adf0-a075c279737a service nova] Releasing lock "refresh_cache-18feef86-7a18-43e3-80cb-fb1d01d34d49" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:38:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:21 user nova-compute[73484]: INFO nova.virt.block_device [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Booting with volume 50fa87d8-9dde-44bc-a634-e9415d684007 at /dev/vdc
Aug 14 13:38:21 user nova-compute[73484]: DEBUG os_brick.utils [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:38:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fb0663-c0f7-4414-a161-31835cb8d339]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[17727709-4471-4518-a30f-676d69c68516]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03950a8-d7e7-451b-b620-f627a52f1671]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e92e14a-ee02-4606-b491-4915c7851289]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:38:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:38:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:38:21 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:38:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[881d65dd-d927-483c-b8ad-a95596450a82]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:38:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:38:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:38:21 user nova-compute[73484]: DEBUG os_brick.utils [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:38:21 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Updating existing volume attachment record: 54ce7f67-d38c-4250-bb6e-c9a5755bca47 {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:38:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:28 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:38:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:29 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG nova.compute.manager [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:38:30 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Creating image(s)
Aug 14 13:38:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Did not create local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Ensure instance console log exists: /opt/stack/data/nova/instances/18feef86-7a18-43e3-80cb-fb1d01d34d49/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Start _get_guest_xml network_info=[{"id": "876f74d5-7991-4068-8fa4-625ac7cc3d22", "address": "fa:16:3e:66:68:cc", "network": {"id": "1a9b1894-c8aa-4c1c-a1dc-70f91e648b89", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1258957124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap876f74d5-79", "ovs_interfaceid": "876f74d5-7991-4068-8fa4-625ac7cc3d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "32ed41f4-a698-4873-98aa-ab0a08e09ad1", "address": "fa:16:3e:61:3b:99", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32ed41f4-a6", "ovs_interfaceid": "32ed41f4-a698-4873-98aa-ab0a08e09ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44be0321-53ca-43af-9af4-35ed291d2695", "address": "fa:16:3e:1f:78:bf", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44be0321-53", "ovs_interfaceid": "44be0321-53ca-43af-9af4-35ed291d2695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "29ec01c6-3b25-4dfa-a9de-5474a29d0c5e", "address": "fa:16:3e:90:ec:d6", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec01c6-3b", "ovs_interfaceid": "29ec01c6-3b25-4dfa-a9de-5474a29d0c5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9672687d-4ab3-4b9d-886b-fc73d8f551d6", "address": "fa:16:3e:7f:7d:8d", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9672687d-4a", "ovs_interfaceid": "9672687d-4ab3-4b9d-886b-fc73d8f551d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "489a48ce-8925-499b-a234-c92c2d760375", "address": "fa:16:3e:b9:d7:ad", "network": {"id": "6811ba1b-eff5-4665-8046-cfb393845d13", "bridge": "br-int", "label": "tempest-device-tagging-net2-585065546", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap489a48ce-89", "ovs_interfaceid": "489a48ce-8925-499b-a234-c92c2d760375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d", "address": "fa:16:3e:5d:7d:d6", "network": {"id": "6811ba1b-eff5-4665-8046-cfb393845d13", "bridge": "br-int", "label": "tempest-device-tagging-net2-585065546", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e1d6f8-1c", "ovs_interfaceid": "a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ce8e2756-5e06-4c77-839d-0384e0d9263c', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zYODyUgm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '18feef86-7a18-43e3-80cb-fb1d01d34d49', 'attached_at': '', 'detached_at': '', 'volume_id': 'f0e13048-762f-4009-88c3-d5594be47a07', 'serial': 'f0e13048-762f-4009-88c3-d5594be47a07'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}, {'attachment_id': '9f4bc2ef-8e5b-4de7-b922-affbfacacf89', 'guest_format': None, 'boot_index': 1, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hRgsIJwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '18feef86-7a18-43e3-80cb-fb1d01d34d49', 'attached_at': '', 'detached_at': '', 'volume_id': '7259b003-154c-4381-83d3-e5a23346a220', 'serial': '7259b003-154c-4381-83d3-e5a23346a220'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}, {'attachment_id': '54ce7f67-d38c-4250-bb6e-c9a5755bca47', 'guest_format': None, 'boot_index': 2, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roiphftj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '18feef86-7a18-43e3-80cb-fb1d01d34d49', 'attached_at': '', 'detached_at': '', 'volume_id': '50fa87d8-9dde-44bc-a634-e9415d684007', 'serial': '50fa87d8-9dde-44bc-a634-e9415d684007'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:38:30 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:38:30 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:38:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zYODyUgm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:38:30 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:38:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:38:30 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:38:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:38:30 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:38:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc84581-49b3-4e2c-ab18-3ab64649356b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:38:30 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ad5cc7-41ab-4af5-950a-2482437e0888]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07] added
Aug 14 13:38:30 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:38:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[306daeef-e0ff-471c-b903-44bb8a12f4dc]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8012ca9a-cc32-4f1d-9a8c-4d5790f64ae4]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zYODyUgm {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zYODyUgm" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[971f46e7-e09f-496e-833d-81a288b3c6f6]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zYODyUgm'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d60812-72a8-41f6-a94e-cdb804ac8eea]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[11aff4ce-c9ad-490e-914f-232106709544]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:38:31 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:38:31 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff69fdd-2194-49d8-8aec-d472e6bae5f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07, portal: 172.16.0.220,3260]
Aug 14 13:38:31 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07, portal: 172.16.0.220,3260] successful.
Aug 14 13:38:31 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ee21ba-e6ae-43db-96d7-e08d2be25af2]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eee34b1-d0e3-4ddb-87b2-a35c760a9b83]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:38:31 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:38:31 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:38:31 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:38:31 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23c2411-97ab-455b-97ae-89773d77713b]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zYODyUgm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-0a3a174b-d870-4164-891e-a2fa8cc8c8b8" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-0a3a174b-d870-4164-891e-a2fa8cc8c8b8" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:38:31 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '26662653639633063', 'path': '/dev/sdc'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662653639633063', 'path': '/dev/sdc'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hRgsIJwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:38:32 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:38:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:38:32 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:38:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:38:32 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03a834b-45a3-44d0-8f6d-b7250d8356b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:38:32 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea45c04d-4f91-4d3e-98e8-94eb89469301]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220] added
Aug 14 13:38:32 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e486a35c-78b1-45b1-81db-56164668d463]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ee23ab-0bbd-4979-a6fe-2f7269b23036]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hRgsIJwm {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hRgsIJwm" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6ebd73-e24b-4edb-8b2f-7945e99a5d17]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hRgsIJwm'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Updating instance_info_cache with network_info: [{"id": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "address": "fa:16:3e:b8:35:a4", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511cc5ad-6f", "ovs_interfaceid": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6d4a11-551c-4486-8883-bfeaf9f0dffb]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-0a3a174b-d870-4164-891e-a2fa8cc8c8b8" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c03cc74-2396-49a8-869c-628659d69a33]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:38:32 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:38:32 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:38:32 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:38:32 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3dbe90-ee30-4639-9fea-131fbf74f7ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220, portal: 172.16.0.220,3260]
Aug 14 13:38:32 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220, portal: 172.16.0.220,3260] successful.
Aug 14 13:38:32 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cc1d76-cce7-4b2d-9cab-ea165188aea1]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[844f9388-478a-48dc-b1c5-61aa4ad36b6c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:38:32 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:38:32 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:38:32 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:38:32 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:38:32 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:38:32 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa518cba-60ad-43c3-9d3e-2f61744f67f5]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hRgsIJwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96025e5d-7c98-4ed4-8180-7c2cdb1d65bf/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96025e5d-7c98-4ed4-8180-7c2cdb1d65bf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96025e5d-7c98-4ed4-8180-7c2cdb1d65bf/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96025e5d-7c98-4ed4-8180-7c2cdb1d65bf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/377257a6-916e-4269-bc53-a81d8bed6bdb/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/377257a6-916e-4269-bc53-a81d8bed6bdb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/377257a6-916e-4269-bc53-a81d8bed6bdb/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/377257a6-916e-4269-bc53-a81d8bed6bdb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23866346661663836', 'path': '/dev/sdd'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866346661663836', 'path': '/dev/sdd'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roiphftj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:38:33 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:38:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:38:33 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:38:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:38:33 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b85b499-2668-41fa-91be-c2d58abe7930]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:38:33 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[01385121-60fe-4e18-a632-0dcea44303ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007] added
Aug 14 13:38:33 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86a0656-6a75-47f5-8e88-545f92f789e1]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d1026c-fc15-4a46-afe4-02bfd291006c]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v roiphftj {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v roiphftj" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3218b156-a4ba-4c38-97ef-afb9ab8a2d74]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'roiphftj'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c6a2be-497c-4290-bff4-fd6e2194a0a0]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a208c08b-683d-45ce-ae9b-131590a5ff64]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:38:33 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:38:33 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:38:33 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:38:33 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:38:33 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:38:33 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd734ed5-71c5-4ca5-9979-c6e44ecdba1f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007, portal: 172.16.0.220,3260]
Aug 14 13:38:33 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007, portal: 172.16.0.220,3260] successful.
Aug 14 13:38:33 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbcce38-68e4-4778-b95e-d8ffdd17ad93]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[114ce43c-2755-46d9-af42-d2b7ea7acabb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:38:33 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:38:33 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:38:33 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:38:33 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:38:33 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:38:33 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:38:33 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:38:33 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c350c0bd-dd51-47e3-a12a-8512c1d1baa4]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:38:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roiphftj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:38:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:34 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:38:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac05f68-a20f-4a57-b990-ef0799aadc58/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:38:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23337373033663064', 'path': '/dev/sde'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:38:34 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337373033663064', 'path': '/dev/sde'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac05f68-a20f-4a57-b990-ef0799aadc58/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac05f68-a20f-4a57-b990-ef0799aadc58/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2091684054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2091684054',id=11,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYASXzOIIlX/renwy9P0bMTWnWqPwOvzELOuBlfAnHxtG8LsZBf1zV7H5dtd1aUubmLnuJxpB35cdMemRlWnH5SWrsXQBfo+vfoJ3yW+4lUfLxww0fOBI3IslW2hj3X2w==',key_name='tempest-keypair-575416246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16a61399aa994f3b890de6ad50d91d6b',ramdisk_id='',reservation_id='r-yn3od48m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2119808848',owner_user_name='tempest-TaggedBootDevicesTest_v242-2119808848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:38:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2355c1d4bfcb475ca72fbc555e38f6f7',uuid=18feef86-7a18-43e3-80cb-fb1d01d34d49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "876f74d5-7991-4068-8fa4-625ac7cc3d22", "address": "fa:16:3e:66:68:cc", "network": {"id": "1a9b1894-c8aa-4c1c-a1dc-70f91e648b89", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1258957124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap876f74d5-79", "ovs_interfaceid": "876f74d5-7991-4068-8fa4-625ac7cc3d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converting VIF {"id": "876f74d5-7991-4068-8fa4-625ac7cc3d22", "address": "fa:16:3e:66:68:cc", "network": {"id": "1a9b1894-c8aa-4c1c-a1dc-70f91e648b89", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1258957124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap876f74d5-79", "ovs_interfaceid": "876f74d5-7991-4068-8fa4-625ac7cc3d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:68:cc,bridge_name='br-int',has_traffic_filtering=True,id=876f74d5-7991-4068-8fa4-625ac7cc3d22,network=Network(1a9b1894-c8aa-4c1c-a1dc-70f91e648b89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap876f74d5-79') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2091684054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2091684054',id=11,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYASXzOIIlX/renwy9P0bMTWnWqPwOvzELOuBlfAnHxtG8LsZBf1zV7H5dtd1aUubmLnuJxpB35cdMemRlWnH5SWrsXQBfo+vfoJ3yW+4lUfLxww0fOBI3IslW2hj3X2w==',key_name='tempest-keypair-575416246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16a61399aa994f3b890de6ad50d91d6b',ramdisk_id='',reservation_id='r-yn3od48m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2119808848',owner_user_name='tempest-TaggedBootDevicesTest_v242-2119808848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:38:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2355c1d4bfcb475ca72fbc555e38f6f7',uuid=18feef86-7a18-43e3-80cb-fb1d01d34d49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32ed41f4-a698-4873-98aa-ab0a08e09ad1", "address": "fa:16:3e:61:3b:99", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32ed41f4-a6", "ovs_interfaceid": "32ed41f4-a698-4873-98aa-ab0a08e09ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converting VIF {"id": "32ed41f4-a698-4873-98aa-ab0a08e09ad1", "address": "fa:16:3e:61:3b:99", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32ed41f4-a6", "ovs_interfaceid": "32ed41f4-a698-4873-98aa-ab0a08e09ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:3b:99,bridge_name='br-int',has_traffic_filtering=True,id=32ed41f4-a698-4873-98aa-ab0a08e09ad1,network=Network(d684c792-0e3b-4523-865c-9a2d4cc25568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap32ed41f4-a6') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2091684054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2091684054',id=11,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYASXzOIIlX/renwy9P0bMTWnWqPwOvzELOuBlfAnHxtG8LsZBf1zV7H5dtd1aUubmLnuJxpB35cdMemRlWnH5SWrsXQBfo+vfoJ3yW+4lUfLxww0fOBI3IslW2hj3X2w==',key_name='tempest-keypair-575416246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16a61399aa994f3b890de6ad50d91d6b',ramdisk_id='',reservation_id='r-yn3od48m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2119808848',owner_user_name='tempest-TaggedBootDevicesTest_v242-2119808848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:38:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2355c1d4bfcb475ca72fbc555e38f6f7',uuid=18feef86-7a18-43e3-80cb-fb1d01d34d49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44be0321-53ca-43af-9af4-35ed291d2695", "address": "fa:16:3e:1f:78:bf", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44be0321-53", "ovs_interfaceid": "44be0321-53ca-43af-9af4-35ed291d2695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converting VIF {"id": "44be0321-53ca-43af-9af4-35ed291d2695", "address": "fa:16:3e:1f:78:bf", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44be0321-53", "ovs_interfaceid": "44be0321-53ca-43af-9af4-35ed291d2695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:78:bf,bridge_name='br-int',has_traffic_filtering=True,id=44be0321-53ca-43af-9af4-35ed291d2695,network=Network(d684c792-0e3b-4523-865c-9a2d4cc25568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44be0321-53') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2091684054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2091684054',id=11,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYASXzOIIlX/renwy9P0bMTWnWqPwOvzELOuBlfAnHxtG8LsZBf1zV7H5dtd1aUubmLnuJxpB35cdMemRlWnH5SWrsXQBfo+vfoJ3yW+4lUfLxww0fOBI3IslW2hj3X2w==',key_name='tempest-keypair-575416246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16a61399aa994f3b890de6ad50d91d6b',ramdisk_id='',reservation_id='r-yn3od48m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2119808848',owner_user_name='tempest-TaggedBootDevicesTest_v242-2119808848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:38:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2355c1d4bfcb475ca72fbc555e38f6f7',uuid=18feef86-7a18-43e3-80cb-fb1d01d34d49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29ec01c6-3b25-4dfa-a9de-5474a29d0c5e", "address": "fa:16:3e:90:ec:d6", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec01c6-3b", "ovs_interfaceid": "29ec01c6-3b25-4dfa-a9de-5474a29d0c5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converting VIF {"id": "29ec01c6-3b25-4dfa-a9de-5474a29d0c5e", "address": "fa:16:3e:90:ec:d6", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec01c6-3b", "ovs_interfaceid": "29ec01c6-3b25-4dfa-a9de-5474a29d0c5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:ec:d6,bridge_name='br-int',has_traffic_filtering=True,id=29ec01c6-3b25-4dfa-a9de-5474a29d0c5e,network=Network(d684c792-0e3b-4523-865c-9a2d4cc25568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ec01c6-3b') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2091684054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2091684054',id=11,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYASXzOIIlX/renwy9P0bMTWnWqPwOvzELOuBlfAnHxtG8LsZBf1zV7H5dtd1aUubmLnuJxpB35cdMemRlWnH5SWrsXQBfo+vfoJ3yW+4lUfLxww0fOBI3IslW2hj3X2w==',key_name='tempest-keypair-575416246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16a61399aa994f3b890de6ad50d91d6b',ramdisk_id='',reservation_id='r-yn3od48m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2119808848',owner_user_name='tempest-TaggedBootDevicesTest_v242-2119808848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:38:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2355c1d4bfcb475ca72fbc555e38f6f7',uuid=18feef86-7a18-43e3-80cb-fb1d01d34d49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9672687d-4ab3-4b9d-886b-fc73d8f551d6", "address": "fa:16:3e:7f:7d:8d", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9672687d-4a", "ovs_interfaceid": "9672687d-4ab3-4b9d-886b-fc73d8f551d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converting VIF {"id": "9672687d-4ab3-4b9d-886b-fc73d8f551d6", "address": "fa:16:3e:7f:7d:8d", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9672687d-4a", "ovs_interfaceid": "9672687d-4ab3-4b9d-886b-fc73d8f551d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:7d:8d,bridge_name='br-int',has_traffic_filtering=True,id=9672687d-4ab3-4b9d-886b-fc73d8f551d6,network=Network(d684c792-0e3b-4523-865c-9a2d4cc25568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9672687d-4a') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2091684054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2091684054',id=11,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYASXzOIIlX/renwy9P0bMTWnWqPwOvzELOuBlfAnHxtG8LsZBf1zV7H5dtd1aUubmLnuJxpB35cdMemRlWnH5SWrsXQBfo+vfoJ3yW+4lUfLxww0fOBI3IslW2hj3X2w==',key_name='tempest-keypair-575416246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16a61399aa994f3b890de6ad50d91d6b',ramdisk_id='',reservation_id='r-yn3od48m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2119808848',owner_user_name='tempest-TaggedBootDevicesTest_v242-2119808848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:38:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2355c1d4bfcb475ca72fbc555e38f6f7',uuid=18feef86-7a18-43e3-80cb-fb1d01d34d49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "489a48ce-8925-499b-a234-c92c2d760375", "address": "fa:16:3e:b9:d7:ad", "network": {"id": "6811ba1b-eff5-4665-8046-cfb393845d13", "bridge": "br-int", "label": "tempest-device-tagging-net2-585065546", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap489a48ce-89", "ovs_interfaceid": "489a48ce-8925-499b-a234-c92c2d760375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converting VIF {"id": "489a48ce-8925-499b-a234-c92c2d760375", "address": "fa:16:3e:b9:d7:ad", "network": {"id": "6811ba1b-eff5-4665-8046-cfb393845d13", "bridge": "br-int", "label": "tempest-device-tagging-net2-585065546", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap489a48ce-89", "ovs_interfaceid": "489a48ce-8925-499b-a234-c92c2d760375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d7:ad,bridge_name='br-int',has_traffic_filtering=True,id=489a48ce-8925-499b-a234-c92c2d760375,network=Network(6811ba1b-eff5-4665-8046-cfb393845d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap489a48ce-89') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2091684054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2091684054',id=11,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYASXzOIIlX/renwy9P0bMTWnWqPwOvzELOuBlfAnHxtG8LsZBf1zV7H5dtd1aUubmLnuJxpB35cdMemRlWnH5SWrsXQBfo+vfoJ3yW+4lUfLxww0fOBI3IslW2hj3X2w==',key_name='tempest-keypair-575416246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16a61399aa994f3b890de6ad50d91d6b',ramdisk_id='',reservation_id='r-yn3od48m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2119808848',owner_user_name='tempest-TaggedBootDevicesTest_v242-2119808848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:38:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2355c1d4bfcb475ca72fbc555e38f6f7',uuid=18feef86-7a18-43e3-80cb-fb1d01d34d49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d", "address": "fa:16:3e:5d:7d:d6", "network": {"id": "6811ba1b-eff5-4665-8046-cfb393845d13", "bridge": "br-int", "label": "tempest-device-tagging-net2-585065546", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e1d6f8-1c", "ovs_interfaceid": "a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converting VIF {"id": "a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d", "address": "fa:16:3e:5d:7d:d6", "network": {"id": "6811ba1b-eff5-4665-8046-cfb393845d13", "bridge": "br-int", "label": "tempest-device-tagging-net2-585065546", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e1d6f8-1c", "ovs_interfaceid": "a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:7d:d6,bridge_name='br-int',has_traffic_filtering=True,id=a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d,network=Network(6811ba1b-eff5-4665-8046-cfb393845d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e1d6f8-1c') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.objects.instance [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lazy-loading 'pci_devices' on Instance uuid 18feef86-7a18-43e3-80cb-fb1d01d34d49 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:38:35 user nova-compute[73484]:   <uuid>18feef86-7a18-43e3-80cb-fb1d01d34d49</uuid>
Aug 14 13:38:35 user nova-compute[73484]:   <name>instance-0000000b</name>
Aug 14 13:38:35 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:38:35 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:38:35 user nova-compute[73484]:   <metadata>
Aug 14 13:38:35 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:38:35 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:38:35 user nova-compute[73484]:       <nova:name>tempest-device-tagging-server-2091684054</nova:name>
Aug 14 13:38:35 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:38:30</nova:creationTime>
Aug 14 13:38:35 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:38:35 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:38:35 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:38:35 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:38:35 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:38:35 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:38:35 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:38:35 user nova-compute[73484]:       <nova:owner>
Aug 14 13:38:35 user nova-compute[73484]:         <nova:user uuid="2355c1d4bfcb475ca72fbc555e38f6f7">tempest-TaggedBootDevicesTest_v242-2119808848-project-member</nova:user>
Aug 14 13:38:35 user nova-compute[73484]:         <nova:project uuid="16a61399aa994f3b890de6ad50d91d6b">tempest-TaggedBootDevicesTest_v242-2119808848</nova:project>
Aug 14 13:38:35 user nova-compute[73484]:       </nova:owner>
Aug 14 13:38:35 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:38:35 user nova-compute[73484]:       <nova:ports>
Aug 14 13:38:35 user nova-compute[73484]:         <nova:port uuid="876f74d5-7991-4068-8fa4-625ac7cc3d22">
Aug 14 13:38:35 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 13:38:35 user nova-compute[73484]:         </nova:port>
Aug 14 13:38:35 user nova-compute[73484]:         <nova:port uuid="32ed41f4-a698-4873-98aa-ab0a08e09ad1">
Aug 14 13:38:35 user nova-compute[73484]:           <nova:ip type="fixed" address="10.1.1.254" ipVersion="4"/>
Aug 14 13:38:35 user nova-compute[73484]:         </nova:port>
Aug 14 13:38:35 user nova-compute[73484]:         <nova:port uuid="44be0321-53ca-43af-9af4-35ed291d2695">
Aug 14 13:38:35 user nova-compute[73484]:           <nova:ip type="fixed" address="10.1.1.45" ipVersion="4"/>
Aug 14 13:38:35 user nova-compute[73484]:         </nova:port>
Aug 14 13:38:35 user nova-compute[73484]:         <nova:port uuid="29ec01c6-3b25-4dfa-a9de-5474a29d0c5e">
Aug 14 13:38:35 user nova-compute[73484]:           <nova:ip type="fixed" address="10.1.1.168" ipVersion="4"/>
Aug 14 13:38:35 user nova-compute[73484]:         </nova:port>
Aug 14 13:38:35 user nova-compute[73484]:         <nova:port uuid="9672687d-4ab3-4b9d-886b-fc73d8f551d6">
Aug 14 13:38:35 user nova-compute[73484]:           <nova:ip type="fixed" address="10.1.1.108" ipVersion="4"/>
Aug 14 13:38:35 user nova-compute[73484]:         </nova:port>
Aug 14 13:38:35 user nova-compute[73484]:         <nova:port uuid="489a48ce-8925-499b-a234-c92c2d760375">
Aug 14 13:38:35 user nova-compute[73484]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 14 13:38:35 user nova-compute[73484]:         </nova:port>
Aug 14 13:38:35 user nova-compute[73484]:         <nova:port uuid="a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d">
Aug 14 13:38:35 user nova-compute[73484]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 14 13:38:35 user nova-compute[73484]:         </nova:port>
Aug 14 13:38:35 user nova-compute[73484]:       </nova:ports>
Aug 14 13:38:35 user nova-compute[73484]:     </nova:instance>
Aug 14 13:38:35 user nova-compute[73484]:   </metadata>
Aug 14 13:38:35 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:38:35 user nova-compute[73484]:     <system>
Aug 14 13:38:35 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:38:35 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:38:35 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:38:35 user nova-compute[73484]:       <entry name="serial">18feef86-7a18-43e3-80cb-fb1d01d34d49</entry>
Aug 14 13:38:35 user nova-compute[73484]:       <entry name="uuid">18feef86-7a18-43e3-80cb-fb1d01d34d49</entry>
Aug 14 13:38:35 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:38:35 user nova-compute[73484]:     </system>
Aug 14 13:38:35 user nova-compute[73484]:   </sysinfo>
Aug 14 13:38:35 user nova-compute[73484]:   <os>
Aug 14 13:38:35 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:38:35 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:38:35 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:38:35 user nova-compute[73484]:   </os>
Aug 14 13:38:35 user nova-compute[73484]:   <features>
Aug 14 13:38:35 user nova-compute[73484]:     <acpi/>
Aug 14 13:38:35 user nova-compute[73484]:     <apic/>
Aug 14 13:38:35 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:38:35 user nova-compute[73484]:   </features>
Aug 14 13:38:35 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:38:35 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:38:35 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:38:35 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:38:35 user nova-compute[73484]:   </clock>
Aug 14 13:38:35 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:38:35 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:38:35 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:38:35 user nova-compute[73484]:   </cpu>
Aug 14 13:38:35 user nova-compute[73484]:   <devices>
Aug 14 13:38:35 user nova-compute[73484]:     <disk type="file" device="cdrom">
Aug 14 13:38:35 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 13:38:35 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/18feef86-7a18-43e3-80cb-fb1d01d34d49/disk.config"/>
Aug 14 13:38:35 user nova-compute[73484]:       <target dev="hda" bus="ide"/>
Aug 14 13:38:35 user nova-compute[73484]:     </disk>
Aug 14 13:38:35 user nova-compute[73484]:     <disk type="block" device="disk">
Aug 14 13:38:35 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:38:35 user nova-compute[73484]:       <source dev="/dev/sdc"/>
Aug 14 13:38:35 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:38:35 user nova-compute[73484]:       <serial>f0e13048-762f-4009-88c3-d5594be47a07</serial>
Aug 14 13:38:35 user nova-compute[73484]:     </disk>
Aug 14 13:38:35 user nova-compute[73484]:     <disk type="block" device="disk">
Aug 14 13:38:35 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:38:35 user nova-compute[73484]:       <source dev="/dev/sdd"/>
Aug 14 13:38:35 user nova-compute[73484]:       <target dev="vdb" bus="virtio"/>
Aug 14 13:38:35 user nova-compute[73484]:       <serial>7259b003-154c-4381-83d3-e5a23346a220</serial>
Aug 14 13:38:35 user nova-compute[73484]:     </disk>
Aug 14 13:38:35 user nova-compute[73484]:     <disk type="block" device="disk">
Aug 14 13:38:35 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:38:35 user nova-compute[73484]:       <source dev="/dev/sde"/>
Aug 14 13:38:35 user nova-compute[73484]:       <target dev="vdc" bus="virtio"/>
Aug 14 13:38:35 user nova-compute[73484]:       <serial>50fa87d8-9dde-44bc-a634-e9415d684007</serial>
Aug 14 13:38:35 user nova-compute[73484]:     </disk>
Aug 14 13:38:35 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:38:35 user nova-compute[73484]:       <mac address="fa:16:3e:66:68:cc"/>
Aug 14 13:38:35 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:38:35 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:38:35 user nova-compute[73484]:       <target dev="tap876f74d5-79"/>
Aug 14 13:38:35 user nova-compute[73484]:     </interface>
Aug 14 13:38:35 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:38:35 user nova-compute[73484]:       <mac address="fa:16:3e:61:3b:99"/>
Aug 14 13:38:35 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:38:35 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:38:35 user nova-compute[73484]:       <target dev="tap32ed41f4-a6"/>
Aug 14 13:38:35 user nova-compute[73484]:     </interface>
Aug 14 13:38:35 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:38:35 user nova-compute[73484]:       <mac address="fa:16:3e:1f:78:bf"/>
Aug 14 13:38:35 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:38:35 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:38:35 user nova-compute[73484]:       <target dev="tap44be0321-53"/>
Aug 14 13:38:35 user nova-compute[73484]:     </interface>
Aug 14 13:38:35 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:38:35 user nova-compute[73484]:       <mac address="fa:16:3e:90:ec:d6"/>
Aug 14 13:38:35 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:38:35 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:38:35 user nova-compute[73484]:       <target dev="tap29ec01c6-3b"/>
Aug 14 13:38:35 user nova-compute[73484]:     </interface>
Aug 14 13:38:35 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:38:35 user nova-compute[73484]:       <mac address="fa:16:3e:7f:7d:8d"/>
Aug 14 13:38:35 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:38:35 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:38:35 user nova-compute[73484]:       <target dev="tap9672687d-4a"/>
Aug 14 13:38:35 user nova-compute[73484]:     </interface>
Aug 14 13:38:35 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:38:35 user nova-compute[73484]:       <mac address="fa:16:3e:b9:d7:ad"/>
Aug 14 13:38:35 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:38:35 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:38:35 user nova-compute[73484]:       <target dev="tap489a48ce-89"/>
Aug 14 13:38:35 user nova-compute[73484]:     </interface>
Aug 14 13:38:35 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:38:35 user nova-compute[73484]:       <mac address="fa:16:3e:5d:7d:d6"/>
Aug 14 13:38:35 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:38:35 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:38:35 user nova-compute[73484]:       <target dev="tapa1e1d6f8-1c"/>
Aug 14 13:38:35 user nova-compute[73484]:     </interface>
Aug 14 13:38:35 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:38:35 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/18feef86-7a18-43e3-80cb-fb1d01d34d49/console.log" append="off"/>
Aug 14 13:38:35 user nova-compute[73484]:     </serial>
Aug 14 13:38:35 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:38:35 user nova-compute[73484]:     <video>
Aug 14 13:38:35 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:38:35 user nova-compute[73484]:     </video>
Aug 14 13:38:35 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:38:35 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:38:35 user nova-compute[73484]:     </rng>
Aug 14 13:38:35 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:38:35 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:38:35 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:38:35 user nova-compute[73484]:     </memballoon>
Aug 14 13:38:35 user nova-compute[73484]:   </devices>
Aug 14 13:38:35 user nova-compute[73484]: </domain>
Aug 14 13:38:35 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2091684054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2091684054',id=11,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYASXzOIIlX/renwy9P0bMTWnWqPwOvzELOuBlfAnHxtG8LsZBf1zV7H5dtd1aUubmLnuJxpB35cdMemRlWnH5SWrsXQBfo+vfoJ3yW+4lUfLxww0fOBI3IslW2hj3X2w==',key_name='tempest-keypair-575416246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16a61399aa994f3b890de6ad50d91d6b',ramdisk_id='',reservation_id='r-yn3od48m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2119808848',owner_user_name='tempest-TaggedBootDevicesTest_v242-2119808848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:38:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2355c1d4bfcb475ca72fbc555e38f6f7',uuid=18feef86-7a18-43e3-80cb-fb1d01d34d49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "876f74d5-7991-4068-8fa4-625ac7cc3d22", "address": "fa:16:3e:66:68:cc", "network": {"id": "1a9b1894-c8aa-4c1c-a1dc-70f91e648b89", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1258957124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap876f74d5-79", "ovs_interfaceid": "876f74d5-7991-4068-8fa4-625ac7cc3d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converting VIF {"id": "876f74d5-7991-4068-8fa4-625ac7cc3d22", "address": "fa:16:3e:66:68:cc", "network": {"id": "1a9b1894-c8aa-4c1c-a1dc-70f91e648b89", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1258957124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap876f74d5-79", "ovs_interfaceid": "876f74d5-7991-4068-8fa4-625ac7cc3d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:68:cc,bridge_name='br-int',has_traffic_filtering=True,id=876f74d5-7991-4068-8fa4-625ac7cc3d22,network=Network(1a9b1894-c8aa-4c1c-a1dc-70f91e648b89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap876f74d5-79') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG os_vif [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:68:cc,bridge_name='br-int',has_traffic_filtering=True,id=876f74d5-7991-4068-8fa4-625ac7cc3d22,network=Network(1a9b1894-c8aa-4c1c-a1dc-70f91e648b89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap876f74d5-79') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap876f74d5-79, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap876f74d5-79, col_values=(('external_ids', {'iface-id': '876f74d5-7991-4068-8fa4-625ac7cc3d22', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:68:cc', 'vm-uuid': '18feef86-7a18-43e3-80cb-fb1d01d34d49'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:35 user nova-compute[73484]: INFO os_vif [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:68:cc,bridge_name='br-int',has_traffic_filtering=True,id=876f74d5-7991-4068-8fa4-625ac7cc3d22,network=Network(1a9b1894-c8aa-4c1c-a1dc-70f91e648b89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap876f74d5-79')
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2091684054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2091684054',id=11,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYASXzOIIlX/renwy9P0bMTWnWqPwOvzELOuBlfAnHxtG8LsZBf1zV7H5dtd1aUubmLnuJxpB35cdMemRlWnH5SWrsXQBfo+vfoJ3yW+4lUfLxww0fOBI3IslW2hj3X2w==',key_name='tempest-keypair-575416246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16a61399aa994f3b890de6ad50d91d6b',ramdisk_id='',reservation_id='r-yn3od48m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2119808848',owner_user_name='tempest-TaggedBootDevicesTest_v242-2119808848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:38:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2355c1d4bfcb475ca72fbc555e38f6f7',uuid=18feef86-7a18-43e3-80cb-fb1d01d34d49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32ed41f4-a698-4873-98aa-ab0a08e09ad1", "address": "fa:16:3e:61:3b:99", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32ed41f4-a6", "ovs_interfaceid": "32ed41f4-a698-4873-98aa-ab0a08e09ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converting VIF {"id": "32ed41f4-a698-4873-98aa-ab0a08e09ad1", "address": "fa:16:3e:61:3b:99", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32ed41f4-a6", "ovs_interfaceid": "32ed41f4-a698-4873-98aa-ab0a08e09ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:3b:99,bridge_name='br-int',has_traffic_filtering=True,id=32ed41f4-a698-4873-98aa-ab0a08e09ad1,network=Network(d684c792-0e3b-4523-865c-9a2d4cc25568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap32ed41f4-a6') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG os_vif [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:3b:99,bridge_name='br-int',has_traffic_filtering=True,id=32ed41f4-a698-4873-98aa-ab0a08e09ad1,network=Network(d684c792-0e3b-4523-865c-9a2d4cc25568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap32ed41f4-a6') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32ed41f4-a6, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap32ed41f4-a6, col_values=(('external_ids', {'iface-id': '32ed41f4-a698-4873-98aa-ab0a08e09ad1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:3b:99', 'vm-uuid': '18feef86-7a18-43e3-80cb-fb1d01d34d49'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:35 user nova-compute[73484]: INFO os_vif [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:3b:99,bridge_name='br-int',has_traffic_filtering=True,id=32ed41f4-a698-4873-98aa-ab0a08e09ad1,network=Network(d684c792-0e3b-4523-865c-9a2d4cc25568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap32ed41f4-a6')
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2091684054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2091684054',id=11,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYASXzOIIlX/renwy9P0bMTWnWqPwOvzELOuBlfAnHxtG8LsZBf1zV7H5dtd1aUubmLnuJxpB35cdMemRlWnH5SWrsXQBfo+vfoJ3yW+4lUfLxww0fOBI3IslW2hj3X2w==',key_name='tempest-keypair-575416246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16a61399aa994f3b890de6ad50d91d6b',ramdisk_id='',reservation_id='r-yn3od48m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2119808848',owner_user_name='tempest-TaggedBootDevicesTest_v242-2119808848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:38:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2355c1d4bfcb475ca72fbc555e38f6f7',uuid=18feef86-7a18-43e3-80cb-fb1d01d34d49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44be0321-53ca-43af-9af4-35ed291d2695", "address": "fa:16:3e:1f:78:bf", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44be0321-53", "ovs_interfaceid": "44be0321-53ca-43af-9af4-35ed291d2695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converting VIF {"id": "44be0321-53ca-43af-9af4-35ed291d2695", "address": "fa:16:3e:1f:78:bf", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44be0321-53", "ovs_interfaceid": "44be0321-53ca-43af-9af4-35ed291d2695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:78:bf,bridge_name='br-int',has_traffic_filtering=True,id=44be0321-53ca-43af-9af4-35ed291d2695,network=Network(d684c792-0e3b-4523-865c-9a2d4cc25568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44be0321-53') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG os_vif [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:78:bf,bridge_name='br-int',has_traffic_filtering=True,id=44be0321-53ca-43af-9af4-35ed291d2695,network=Network(d684c792-0e3b-4523-865c-9a2d4cc25568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44be0321-53') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44be0321-53, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap44be0321-53, col_values=(('external_ids', {'iface-id': '44be0321-53ca-43af-9af4-35ed291d2695', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:78:bf', 'vm-uuid': '18feef86-7a18-43e3-80cb-fb1d01d34d49'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:35 user nova-compute[73484]: INFO os_vif [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:78:bf,bridge_name='br-int',has_traffic_filtering=True,id=44be0321-53ca-43af-9af4-35ed291d2695,network=Network(d684c792-0e3b-4523-865c-9a2d4cc25568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44be0321-53')
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2091684054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2091684054',id=11,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYASXzOIIlX/renwy9P0bMTWnWqPwOvzELOuBlfAnHxtG8LsZBf1zV7H5dtd1aUubmLnuJxpB35cdMemRlWnH5SWrsXQBfo+vfoJ3yW+4lUfLxww0fOBI3IslW2hj3X2w==',key_name='tempest-keypair-575416246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16a61399aa994f3b890de6ad50d91d6b',ramdisk_id='',reservation_id='r-yn3od48m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2119808848',owner_user_name='tempest-TaggedBootDevicesTest_v242-2119808848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:38:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2355c1d4bfcb475ca72fbc555e38f6f7',uuid=18feef86-7a18-43e3-80cb-fb1d01d34d49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29ec01c6-3b25-4dfa-a9de-5474a29d0c5e", "address": "fa:16:3e:90:ec:d6", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec01c6-3b", "ovs_interfaceid": "29ec01c6-3b25-4dfa-a9de-5474a29d0c5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converting VIF {"id": "29ec01c6-3b25-4dfa-a9de-5474a29d0c5e", "address": "fa:16:3e:90:ec:d6", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec01c6-3b", "ovs_interfaceid": "29ec01c6-3b25-4dfa-a9de-5474a29d0c5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:ec:d6,bridge_name='br-int',has_traffic_filtering=True,id=29ec01c6-3b25-4dfa-a9de-5474a29d0c5e,network=Network(d684c792-0e3b-4523-865c-9a2d4cc25568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ec01c6-3b') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG os_vif [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:ec:d6,bridge_name='br-int',has_traffic_filtering=True,id=29ec01c6-3b25-4dfa-a9de-5474a29d0c5e,network=Network(d684c792-0e3b-4523-865c-9a2d4cc25568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ec01c6-3b') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac05f68-a20f-4a57-b990-ef0799aadc58/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29ec01c6-3b, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap29ec01c6-3b, col_values=(('external_ids', {'iface-id': '29ec01c6-3b25-4dfa-a9de-5474a29d0c5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:ec:d6', 'vm-uuid': '18feef86-7a18-43e3-80cb-fb1d01d34d49'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:35 user nova-compute[73484]: INFO os_vif [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:ec:d6,bridge_name='br-int',has_traffic_filtering=True,id=29ec01c6-3b25-4dfa-a9de-5474a29d0c5e,network=Network(d684c792-0e3b-4523-865c-9a2d4cc25568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ec01c6-3b')
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2091684054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2091684054',id=11,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYASXzOIIlX/renwy9P0bMTWnWqPwOvzELOuBlfAnHxtG8LsZBf1zV7H5dtd1aUubmLnuJxpB35cdMemRlWnH5SWrsXQBfo+vfoJ3yW+4lUfLxww0fOBI3IslW2hj3X2w==',key_name='tempest-keypair-575416246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16a61399aa994f3b890de6ad50d91d6b',ramdisk_id='',reservation_id='r-yn3od48m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2119808848',owner_user_name='tempest-TaggedBootDevicesTest_v242-2119808848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:38:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2355c1d4bfcb475ca72fbc555e38f6f7',uuid=18feef86-7a18-43e3-80cb-fb1d01d34d49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9672687d-4ab3-4b9d-886b-fc73d8f551d6", "address": "fa:16:3e:7f:7d:8d", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9672687d-4a", "ovs_interfaceid": "9672687d-4ab3-4b9d-886b-fc73d8f551d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converting VIF {"id": "9672687d-4ab3-4b9d-886b-fc73d8f551d6", "address": "fa:16:3e:7f:7d:8d", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9672687d-4a", "ovs_interfaceid": "9672687d-4ab3-4b9d-886b-fc73d8f551d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:7d:8d,bridge_name='br-int',has_traffic_filtering=True,id=9672687d-4ab3-4b9d-886b-fc73d8f551d6,network=Network(d684c792-0e3b-4523-865c-9a2d4cc25568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9672687d-4a') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG os_vif [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:7d:8d,bridge_name='br-int',has_traffic_filtering=True,id=9672687d-4ab3-4b9d-886b-fc73d8f551d6,network=Network(d684c792-0e3b-4523-865c-9a2d4cc25568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9672687d-4a') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9672687d-4a, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9672687d-4a, col_values=(('external_ids', {'iface-id': '9672687d-4ab3-4b9d-886b-fc73d8f551d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:7d:8d', 'vm-uuid': '18feef86-7a18-43e3-80cb-fb1d01d34d49'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:35 user nova-compute[73484]: INFO os_vif [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:7d:8d,bridge_name='br-int',has_traffic_filtering=True,id=9672687d-4ab3-4b9d-886b-fc73d8f551d6,network=Network(d684c792-0e3b-4523-865c-9a2d4cc25568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9672687d-4a')
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2091684054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2091684054',id=11,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYASXzOIIlX/renwy9P0bMTWnWqPwOvzELOuBlfAnHxtG8LsZBf1zV7H5dtd1aUubmLnuJxpB35cdMemRlWnH5SWrsXQBfo+vfoJ3yW+4lUfLxww0fOBI3IslW2hj3X2w==',key_name='tempest-keypair-575416246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16a61399aa994f3b890de6ad50d91d6b',ramdisk_id='',reservation_id='r-yn3od48m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2119808848',owner_user_name='tempest-TaggedBootDevicesTest_v242-2119808848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:38:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2355c1d4bfcb475ca72fbc555e38f6f7',uuid=18feef86-7a18-43e3-80cb-fb1d01d34d49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "489a48ce-8925-499b-a234-c92c2d760375", "address": "fa:16:3e:b9:d7:ad", "network": {"id": "6811ba1b-eff5-4665-8046-cfb393845d13", "bridge": "br-int", "label": "tempest-device-tagging-net2-585065546", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap489a48ce-89", "ovs_interfaceid": "489a48ce-8925-499b-a234-c92c2d760375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converting VIF {"id": "489a48ce-8925-499b-a234-c92c2d760375", "address": "fa:16:3e:b9:d7:ad", "network": {"id": "6811ba1b-eff5-4665-8046-cfb393845d13", "bridge": "br-int", "label": "tempest-device-tagging-net2-585065546", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap489a48ce-89", "ovs_interfaceid": "489a48ce-8925-499b-a234-c92c2d760375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d7:ad,bridge_name='br-int',has_traffic_filtering=True,id=489a48ce-8925-499b-a234-c92c2d760375,network=Network(6811ba1b-eff5-4665-8046-cfb393845d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap489a48ce-89') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG os_vif [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d7:ad,bridge_name='br-int',has_traffic_filtering=True,id=489a48ce-8925-499b-a234-c92c2d760375,network=Network(6811ba1b-eff5-4665-8046-cfb393845d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap489a48ce-89') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap489a48ce-89, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap489a48ce-89, col_values=(('external_ids', {'iface-id': '489a48ce-8925-499b-a234-c92c2d760375', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:d7:ad', 'vm-uuid': '18feef86-7a18-43e3-80cb-fb1d01d34d49'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:35 user nova-compute[73484]: INFO os_vif [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d7:ad,bridge_name='br-int',has_traffic_filtering=True,id=489a48ce-8925-499b-a234-c92c2d760375,network=Network(6811ba1b-eff5-4665-8046-cfb393845d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap489a48ce-89')
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2091684054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2091684054',id=11,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYASXzOIIlX/renwy9P0bMTWnWqPwOvzELOuBlfAnHxtG8LsZBf1zV7H5dtd1aUubmLnuJxpB35cdMemRlWnH5SWrsXQBfo+vfoJ3yW+4lUfLxww0fOBI3IslW2hj3X2w==',key_name='tempest-keypair-575416246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16a61399aa994f3b890de6ad50d91d6b',ramdisk_id='',reservation_id='r-yn3od48m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2119808848',owner_user_name='tempest-TaggedBootDevicesTest_v242-2119808848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:38:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2355c1d4bfcb475ca72fbc555e38f6f7',uuid=18feef86-7a18-43e3-80cb-fb1d01d34d49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d", "address": "fa:16:3e:5d:7d:d6", "network": {"id": "6811ba1b-eff5-4665-8046-cfb393845d13", "bridge": "br-int", "label": "tempest-device-tagging-net2-585065546", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e1d6f8-1c", "ovs_interfaceid": "a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converting VIF {"id": "a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d", "address": "fa:16:3e:5d:7d:d6", "network": {"id": "6811ba1b-eff5-4665-8046-cfb393845d13", "bridge": "br-int", "label": "tempest-device-tagging-net2-585065546", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e1d6f8-1c", "ovs_interfaceid": "a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:7d:d6,bridge_name='br-int',has_traffic_filtering=True,id=a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d,network=Network(6811ba1b-eff5-4665-8046-cfb393845d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e1d6f8-1c') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG os_vif [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:7d:d6,bridge_name='br-int',has_traffic_filtering=True,id=a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d,network=Network(6811ba1b-eff5-4665-8046-cfb393845d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e1d6f8-1c') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1e1d6f8-1c, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa1e1d6f8-1c, col_values=(('external_ids', {'iface-id': 'a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:7d:d6', 'vm-uuid': '18feef86-7a18-43e3-80cb-fb1d01d34d49'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:35 user nova-compute[73484]: INFO os_vif [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:7d:d6,bridge_name='br-int',has_traffic_filtering=True,id=a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d,network=Network(6811ba1b-eff5-4665-8046-cfb393845d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e1d6f8-1c')
Aug 14 13:38:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] No BDM found with device name hda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] No VIF found with MAC fa:16:3e:66:68:cc, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] No VIF found with MAC fa:16:3e:7f:7d:8d, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:38:35 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Using config drive
Aug 14 13:38:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:35 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Creating config drive at /opt/stack/data/nova/instances/18feef86-7a18-43e3-80cb-fb1d01d34d49/disk.config
Aug 14 13:38:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/18feef86-7a18-43e3-80cb-fb1d01d34d49/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxko5f4yu {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/18feef86-7a18-43e3-80cb-fb1d01d34d49/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxko5f4yu" returned: 0 in 0.051s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:36 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:38:36 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:38:36 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=6751MB free_disk=25.724407196044922GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 13:38:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:38:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:38:36 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance f4f7788c-fcca-47c1-b5b8-72892253982d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:38:36 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:38:36 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:38:36 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 07bac569-8b2c-4555-b4d5-a74f7384630b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:38:36 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance b889688d-13dd-4f7b-bfef-26dc5347fd6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:38:36 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 377257a6-916e-4269-bc53-a81d8bed6bdb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:38:36 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:38:36 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 7ac05f68-a20f-4a57-b990-ef0799aadc58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:38:36 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 7348b004-4d46-4db5-a451-afd3b7476569 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:38:36 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance eaaccbea-d453-4943-9663-949c66029d87 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:38:36 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 18feef86-7a18-43e3-80cb-fb1d01d34d49 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:38:36 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 13:38:36 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 13:38:36 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:38:36 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:38:36 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 13:38:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.531s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:38:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:37 user nova-compute[73484]: DEBUG nova.compute.manager [req-382b699b-4988-4d8d-8dea-0abfd42cd47a req-2eda6ef8-7044-49f4-8881-52aaa57121a6 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-plugged-876f74d5-7991-4068-8fa4-625ac7cc3d22 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:38:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-382b699b-4988-4d8d-8dea-0abfd42cd47a req-2eda6ef8-7044-49f4-8881-52aaa57121a6 service nova] Acquiring lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:38:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-382b699b-4988-4d8d-8dea-0abfd42cd47a req-2eda6ef8-7044-49f4-8881-52aaa57121a6 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:38:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-382b699b-4988-4d8d-8dea-0abfd42cd47a req-2eda6ef8-7044-49f4-8881-52aaa57121a6 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:38:37 user nova-compute[73484]: DEBUG nova.compute.manager [req-382b699b-4988-4d8d-8dea-0abfd42cd47a req-2eda6ef8-7044-49f4-8881-52aaa57121a6 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] No waiting events found dispatching network-vif-plugged-876f74d5-7991-4068-8fa4-625ac7cc3d22 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:38:37 user nova-compute[73484]: WARNING nova.compute.manager [req-382b699b-4988-4d8d-8dea-0abfd42cd47a req-2eda6ef8-7044-49f4-8881-52aaa57121a6 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received unexpected event network-vif-plugged-876f74d5-7991-4068-8fa4-625ac7cc3d22 for instance with vm_state building and task_state spawning.
Aug 14 13:38:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:37 user nova-compute[73484]: DEBUG nova.compute.manager [None req-3c62b75b-7160-4fb9-a69b-d0b3b36ddb07 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:38:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:37 user nova-compute[73484]: INFO nova.compute.manager [None req-3c62b75b-7160-4fb9-a69b-d0b3b36ddb07 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] instance snapshotting
Aug 14 13:38:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:37 user nova-compute[73484]: DEBUG nova.compute.manager [req-1ca1be6a-0d7b-45d6-ae21-a8806e590f40 req-7fbc2636-4a0b-4260-8778-d9789e4e78e9 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-plugged-32ed41f4-a698-4873-98aa-ab0a08e09ad1 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:38:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1ca1be6a-0d7b-45d6-ae21-a8806e590f40 req-7fbc2636-4a0b-4260-8778-d9789e4e78e9 service nova] Acquiring lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:38:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1ca1be6a-0d7b-45d6-ae21-a8806e590f40 req-7fbc2636-4a0b-4260-8778-d9789e4e78e9 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:38:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1ca1be6a-0d7b-45d6-ae21-a8806e590f40 req-7fbc2636-4a0b-4260-8778-d9789e4e78e9 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:38:37 user nova-compute[73484]: DEBUG nova.compute.manager [req-1ca1be6a-0d7b-45d6-ae21-a8806e590f40 req-7fbc2636-4a0b-4260-8778-d9789e4e78e9 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] No waiting events found dispatching network-vif-plugged-32ed41f4-a698-4873-98aa-ab0a08e09ad1 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:38:37 user nova-compute[73484]: WARNING nova.compute.manager [req-1ca1be6a-0d7b-45d6-ae21-a8806e590f40 req-7fbc2636-4a0b-4260-8778-d9789e4e78e9 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received unexpected event network-vif-plugged-32ed41f4-a698-4873-98aa-ab0a08e09ad1 for instance with vm_state building and task_state spawning.
Aug 14 13:38:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:38 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-3c62b75b-7160-4fb9-a69b-d0b3b36ddb07 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Beginning live snapshot process
Aug 14 13:38:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3c62b75b-7160-4fb9-a69b-d0b3b36ddb07 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json -f qcow2 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3c62b75b-7160-4fb9-a69b-d0b3b36ddb07 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json -f qcow2" returned: 0 in 0.171s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3c62b75b-7160-4fb9-a69b-d0b3b36ddb07 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json -f qcow2 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:38 user nova-compute[73484]: DEBUG nova.compute.manager [req-9a817641-cc7f-4bd6-be68-4e935ccca49d req-b1100552-5e30-438f-94e7-4fce420eaa08 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-plugged-29ec01c6-3b25-4dfa-a9de-5474a29d0c5e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:38:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-9a817641-cc7f-4bd6-be68-4e935ccca49d req-b1100552-5e30-438f-94e7-4fce420eaa08 service nova] Acquiring lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:38:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-9a817641-cc7f-4bd6-be68-4e935ccca49d req-b1100552-5e30-438f-94e7-4fce420eaa08 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:38:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-9a817641-cc7f-4bd6-be68-4e935ccca49d req-b1100552-5e30-438f-94e7-4fce420eaa08 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:38:38 user nova-compute[73484]: DEBUG nova.compute.manager [req-9a817641-cc7f-4bd6-be68-4e935ccca49d req-b1100552-5e30-438f-94e7-4fce420eaa08 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] No waiting events found dispatching network-vif-plugged-29ec01c6-3b25-4dfa-a9de-5474a29d0c5e {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:38:38 user nova-compute[73484]: WARNING nova.compute.manager [req-9a817641-cc7f-4bd6-be68-4e935ccca49d req-b1100552-5e30-438f-94e7-4fce420eaa08 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received unexpected event network-vif-plugged-29ec01c6-3b25-4dfa-a9de-5474a29d0c5e for instance with vm_state building and task_state spawning.
Aug 14 13:38:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3c62b75b-7160-4fb9-a69b-d0b3b36ddb07 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json -f qcow2" returned: 0 in 0.213s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3c62b75b-7160-4fb9-a69b-d0b3b36ddb07 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3c62b75b-7160-4fb9-a69b-d0b3b36ddb07 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.196s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3c62b75b-7160-4fb9-a69b-d0b3b36ddb07 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqiekzl98/b49196a130904930a2d0352fd030bfa7.delta 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3c62b75b-7160-4fb9-a69b-d0b3b36ddb07 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqiekzl98/b49196a130904930a2d0352fd030bfa7.delta 1073741824" returned: 0 in 0.055s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:38 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-3c62b75b-7160-4fb9-a69b-d0b3b36ddb07 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 13:38:38 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-3c62b75b-7160-4fb9-a69b-d0b3b36ddb07 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73484) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 14 13:38:38 user nova-compute[73484]: INFO nova.virt.libvirt.host [None req-3c62b75b-7160-4fb9-a69b-d0b3b36ddb07 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] UEFI support detected
Aug 14 13:38:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:39 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:38:39 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:38:39 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:38:39 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:38:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-38ea6609-0eb1-43b8-8c91-af66f5679d65 req-9485cfd2-dba7-475f-a51b-d128984a4374 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-plugged-876f74d5-7991-4068-8fa4-625ac7cc3d22 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:38:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-38ea6609-0eb1-43b8-8c91-af66f5679d65 req-9485cfd2-dba7-475f-a51b-d128984a4374 service nova] Acquiring lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:38:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-38ea6609-0eb1-43b8-8c91-af66f5679d65 req-9485cfd2-dba7-475f-a51b-d128984a4374 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:38:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-38ea6609-0eb1-43b8-8c91-af66f5679d65 req-9485cfd2-dba7-475f-a51b-d128984a4374 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:38:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-38ea6609-0eb1-43b8-8c91-af66f5679d65 req-9485cfd2-dba7-475f-a51b-d128984a4374 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] No waiting events found dispatching network-vif-plugged-876f74d5-7991-4068-8fa4-625ac7cc3d22 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:38:39 user nova-compute[73484]: WARNING nova.compute.manager [req-38ea6609-0eb1-43b8-8c91-af66f5679d65 req-9485cfd2-dba7-475f-a51b-d128984a4374 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received unexpected event network-vif-plugged-876f74d5-7991-4068-8fa4-625ac7cc3d22 for instance with vm_state building and task_state spawning.
Aug 14 13:38:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:39 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-3c62b75b-7160-4fb9-a69b-d0b3b36ddb07 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73484) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-44bb60bd-3ff7-4b04-8b24-620f451831fa req-76e066dd-61a8-45d7-b08a-aedc769e6c82 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-plugged-32ed41f4-a698-4873-98aa-ab0a08e09ad1 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-44bb60bd-3ff7-4b04-8b24-620f451831fa req-76e066dd-61a8-45d7-b08a-aedc769e6c82 service nova] Acquiring lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-44bb60bd-3ff7-4b04-8b24-620f451831fa req-76e066dd-61a8-45d7-b08a-aedc769e6c82 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-44bb60bd-3ff7-4b04-8b24-620f451831fa req-76e066dd-61a8-45d7-b08a-aedc769e6c82 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-44bb60bd-3ff7-4b04-8b24-620f451831fa req-76e066dd-61a8-45d7-b08a-aedc769e6c82 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] No waiting events found dispatching network-vif-plugged-32ed41f4-a698-4873-98aa-ab0a08e09ad1 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:38:40 user nova-compute[73484]: WARNING nova.compute.manager [req-44bb60bd-3ff7-4b04-8b24-620f451831fa req-76e066dd-61a8-45d7-b08a-aedc769e6c82 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received unexpected event network-vif-plugged-32ed41f4-a698-4873-98aa-ab0a08e09ad1 for instance with vm_state building and task_state spawning.
Aug 14 13:38:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-44bb60bd-3ff7-4b04-8b24-620f451831fa req-76e066dd-61a8-45d7-b08a-aedc769e6c82 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-plugged-44be0321-53ca-43af-9af4-35ed291d2695 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-44bb60bd-3ff7-4b04-8b24-620f451831fa req-76e066dd-61a8-45d7-b08a-aedc769e6c82 service nova] Acquiring lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-44bb60bd-3ff7-4b04-8b24-620f451831fa req-76e066dd-61a8-45d7-b08a-aedc769e6c82 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-44bb60bd-3ff7-4b04-8b24-620f451831fa req-76e066dd-61a8-45d7-b08a-aedc769e6c82 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-44bb60bd-3ff7-4b04-8b24-620f451831fa req-76e066dd-61a8-45d7-b08a-aedc769e6c82 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] No waiting events found dispatching network-vif-plugged-44be0321-53ca-43af-9af4-35ed291d2695 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:38:40 user nova-compute[73484]: WARNING nova.compute.manager [req-44bb60bd-3ff7-4b04-8b24-620f451831fa req-76e066dd-61a8-45d7-b08a-aedc769e6c82 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received unexpected event network-vif-plugged-44be0321-53ca-43af-9af4-35ed291d2695 for instance with vm_state building and task_state spawning.
Aug 14 13:38:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-44bb60bd-3ff7-4b04-8b24-620f451831fa req-76e066dd-61a8-45d7-b08a-aedc769e6c82 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-plugged-44be0321-53ca-43af-9af4-35ed291d2695 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-44bb60bd-3ff7-4b04-8b24-620f451831fa req-76e066dd-61a8-45d7-b08a-aedc769e6c82 service nova] Acquiring lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-44bb60bd-3ff7-4b04-8b24-620f451831fa req-76e066dd-61a8-45d7-b08a-aedc769e6c82 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-44bb60bd-3ff7-4b04-8b24-620f451831fa req-76e066dd-61a8-45d7-b08a-aedc769e6c82 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-44bb60bd-3ff7-4b04-8b24-620f451831fa req-76e066dd-61a8-45d7-b08a-aedc769e6c82 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] No waiting events found dispatching network-vif-plugged-44be0321-53ca-43af-9af4-35ed291d2695 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:38:40 user nova-compute[73484]: WARNING nova.compute.manager [req-44bb60bd-3ff7-4b04-8b24-620f451831fa req-76e066dd-61a8-45d7-b08a-aedc769e6c82 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received unexpected event network-vif-plugged-44be0321-53ca-43af-9af4-35ed291d2695 for instance with vm_state building and task_state spawning.
Aug 14 13:38:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-44bb60bd-3ff7-4b04-8b24-620f451831fa req-76e066dd-61a8-45d7-b08a-aedc769e6c82 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-plugged-489a48ce-8925-499b-a234-c92c2d760375 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-44bb60bd-3ff7-4b04-8b24-620f451831fa req-76e066dd-61a8-45d7-b08a-aedc769e6c82 service nova] Acquiring lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-44bb60bd-3ff7-4b04-8b24-620f451831fa req-76e066dd-61a8-45d7-b08a-aedc769e6c82 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-44bb60bd-3ff7-4b04-8b24-620f451831fa req-76e066dd-61a8-45d7-b08a-aedc769e6c82 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-44bb60bd-3ff7-4b04-8b24-620f451831fa req-76e066dd-61a8-45d7-b08a-aedc769e6c82 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] No waiting events found dispatching network-vif-plugged-489a48ce-8925-499b-a234-c92c2d760375 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:38:40 user nova-compute[73484]: WARNING nova.compute.manager [req-44bb60bd-3ff7-4b04-8b24-620f451831fa req-76e066dd-61a8-45d7-b08a-aedc769e6c82 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received unexpected event network-vif-plugged-489a48ce-8925-499b-a234-c92c2d760375 for instance with vm_state building and task_state spawning.
Aug 14 13:38:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-44bb60bd-3ff7-4b04-8b24-620f451831fa req-76e066dd-61a8-45d7-b08a-aedc769e6c82 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-plugged-489a48ce-8925-499b-a234-c92c2d760375 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-44bb60bd-3ff7-4b04-8b24-620f451831fa req-76e066dd-61a8-45d7-b08a-aedc769e6c82 service nova] Acquiring lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-44bb60bd-3ff7-4b04-8b24-620f451831fa req-76e066dd-61a8-45d7-b08a-aedc769e6c82 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-44bb60bd-3ff7-4b04-8b24-620f451831fa req-76e066dd-61a8-45d7-b08a-aedc769e6c82 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-44bb60bd-3ff7-4b04-8b24-620f451831fa req-76e066dd-61a8-45d7-b08a-aedc769e6c82 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] No waiting events found dispatching network-vif-plugged-489a48ce-8925-499b-a234-c92c2d760375 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:38:40 user nova-compute[73484]: WARNING nova.compute.manager [req-44bb60bd-3ff7-4b04-8b24-620f451831fa req-76e066dd-61a8-45d7-b08a-aedc769e6c82 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received unexpected event network-vif-plugged-489a48ce-8925-499b-a234-c92c2d760375 for instance with vm_state building and task_state spawning.
Aug 14 13:38:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-3c62b75b-7160-4fb9-a69b-d0b3b36ddb07 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] COPY block job progress, current cursor: 47972352 final cursor: 75497472 {{(pid=73484) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-c9543fb0-d122-48f5-bb57-409151704653 req-84d59963-0335-4c8c-9a6e-b0b91cfc0983 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-plugged-29ec01c6-3b25-4dfa-a9de-5474a29d0c5e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c9543fb0-d122-48f5-bb57-409151704653 req-84d59963-0335-4c8c-9a6e-b0b91cfc0983 service nova] Acquiring lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c9543fb0-d122-48f5-bb57-409151704653 req-84d59963-0335-4c8c-9a6e-b0b91cfc0983 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c9543fb0-d122-48f5-bb57-409151704653 req-84d59963-0335-4c8c-9a6e-b0b91cfc0983 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-c9543fb0-d122-48f5-bb57-409151704653 req-84d59963-0335-4c8c-9a6e-b0b91cfc0983 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] No waiting events found dispatching network-vif-plugged-29ec01c6-3b25-4dfa-a9de-5474a29d0c5e {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:38:40 user nova-compute[73484]: WARNING nova.compute.manager [req-c9543fb0-d122-48f5-bb57-409151704653 req-84d59963-0335-4c8c-9a6e-b0b91cfc0983 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received unexpected event network-vif-plugged-29ec01c6-3b25-4dfa-a9de-5474a29d0c5e for instance with vm_state building and task_state spawning.
Aug 14 13:38:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-c9543fb0-d122-48f5-bb57-409151704653 req-84d59963-0335-4c8c-9a6e-b0b91cfc0983 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-plugged-9672687d-4ab3-4b9d-886b-fc73d8f551d6 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c9543fb0-d122-48f5-bb57-409151704653 req-84d59963-0335-4c8c-9a6e-b0b91cfc0983 service nova] Acquiring lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c9543fb0-d122-48f5-bb57-409151704653 req-84d59963-0335-4c8c-9a6e-b0b91cfc0983 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c9543fb0-d122-48f5-bb57-409151704653 req-84d59963-0335-4c8c-9a6e-b0b91cfc0983 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-c9543fb0-d122-48f5-bb57-409151704653 req-84d59963-0335-4c8c-9a6e-b0b91cfc0983 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] No waiting events found dispatching network-vif-plugged-9672687d-4ab3-4b9d-886b-fc73d8f551d6 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:38:40 user nova-compute[73484]: WARNING nova.compute.manager [req-c9543fb0-d122-48f5-bb57-409151704653 req-84d59963-0335-4c8c-9a6e-b0b91cfc0983 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received unexpected event network-vif-plugged-9672687d-4ab3-4b9d-886b-fc73d8f551d6 for instance with vm_state building and task_state spawning.
Aug 14 13:38:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-c9543fb0-d122-48f5-bb57-409151704653 req-84d59963-0335-4c8c-9a6e-b0b91cfc0983 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-plugged-9672687d-4ab3-4b9d-886b-fc73d8f551d6 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c9543fb0-d122-48f5-bb57-409151704653 req-84d59963-0335-4c8c-9a6e-b0b91cfc0983 service nova] Acquiring lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c9543fb0-d122-48f5-bb57-409151704653 req-84d59963-0335-4c8c-9a6e-b0b91cfc0983 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c9543fb0-d122-48f5-bb57-409151704653 req-84d59963-0335-4c8c-9a6e-b0b91cfc0983 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-c9543fb0-d122-48f5-bb57-409151704653 req-84d59963-0335-4c8c-9a6e-b0b91cfc0983 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] No waiting events found dispatching network-vif-plugged-9672687d-4ab3-4b9d-886b-fc73d8f551d6 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:38:40 user nova-compute[73484]: WARNING nova.compute.manager [req-c9543fb0-d122-48f5-bb57-409151704653 req-84d59963-0335-4c8c-9a6e-b0b91cfc0983 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received unexpected event network-vif-plugged-9672687d-4ab3-4b9d-886b-fc73d8f551d6 for instance with vm_state building and task_state spawning.
Aug 14 13:38:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-c9543fb0-d122-48f5-bb57-409151704653 req-84d59963-0335-4c8c-9a6e-b0b91cfc0983 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-plugged-a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c9543fb0-d122-48f5-bb57-409151704653 req-84d59963-0335-4c8c-9a6e-b0b91cfc0983 service nova] Acquiring lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c9543fb0-d122-48f5-bb57-409151704653 req-84d59963-0335-4c8c-9a6e-b0b91cfc0983 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c9543fb0-d122-48f5-bb57-409151704653 req-84d59963-0335-4c8c-9a6e-b0b91cfc0983 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-c9543fb0-d122-48f5-bb57-409151704653 req-84d59963-0335-4c8c-9a6e-b0b91cfc0983 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] No waiting events found dispatching network-vif-plugged-a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:38:40 user nova-compute[73484]: WARNING nova.compute.manager [req-c9543fb0-d122-48f5-bb57-409151704653 req-84d59963-0335-4c8c-9a6e-b0b91cfc0983 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received unexpected event network-vif-plugged-a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d for instance with vm_state building and task_state spawning.
Aug 14 13:38:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-c9543fb0-d122-48f5-bb57-409151704653 req-84d59963-0335-4c8c-9a6e-b0b91cfc0983 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-plugged-a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c9543fb0-d122-48f5-bb57-409151704653 req-84d59963-0335-4c8c-9a6e-b0b91cfc0983 service nova] Acquiring lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c9543fb0-d122-48f5-bb57-409151704653 req-84d59963-0335-4c8c-9a6e-b0b91cfc0983 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c9543fb0-d122-48f5-bb57-409151704653 req-84d59963-0335-4c8c-9a6e-b0b91cfc0983 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-c9543fb0-d122-48f5-bb57-409151704653 req-84d59963-0335-4c8c-9a6e-b0b91cfc0983 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] No waiting events found dispatching network-vif-plugged-a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:38:40 user nova-compute[73484]: WARNING nova.compute.manager [req-c9543fb0-d122-48f5-bb57-409151704653 req-84d59963-0335-4c8c-9a6e-b0b91cfc0983 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received unexpected event network-vif-plugged-a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d for instance with vm_state building and task_state spawning.
Aug 14 13:38:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-3c62b75b-7160-4fb9-a69b-d0b3b36ddb07 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73484) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 13:38:40 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-3c62b75b-7160-4fb9-a69b-d0b3b36ddb07 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 13:38:41 user nova-compute[73484]: DEBUG nova.privsep.utils [None req-3c62b75b-7160-4fb9-a69b-d0b3b36ddb07 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73484) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 13:38:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3c62b75b-7160-4fb9-a69b-d0b3b36ddb07 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqiekzl98/b49196a130904930a2d0352fd030bfa7.delta /opt/stack/data/nova/instances/snapshots/tmpqiekzl98/b49196a130904930a2d0352fd030bfa7 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3c62b75b-7160-4fb9-a69b-d0b3b36ddb07 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqiekzl98/b49196a130904930a2d0352fd030bfa7.delta /opt/stack/data/nova/instances/snapshots/tmpqiekzl98/b49196a130904930a2d0352fd030bfa7" returned: 0 in 0.678s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:41 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-3c62b75b-7160-4fb9-a69b-d0b3b36ddb07 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Snapshot extracted, beginning image upload
Aug 14 13:38:42 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020322.3665497, 18feef86-7a18-43e3-80cb-fb1d01d34d49 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:38:42 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] VM Resumed (Lifecycle Event)
Aug 14 13:38:42 user nova-compute[73484]: DEBUG nova.compute.manager [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:38:42 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:38:42 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Instance spawned successfully.
Aug 14 13:38:42 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:38:42 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:38:42 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:38:42 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:38:42 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:38:42 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:38:42 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:38:42 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:38:42 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:38:42 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:38:42 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020322.368131, 18feef86-7a18-43e3-80cb-fb1d01d34d49 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:38:42 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] VM Started (Lifecycle Event)
Aug 14 13:38:42 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:38:42 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:38:42 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:38:42 user nova-compute[73484]: INFO nova.compute.manager [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Took 11.63 seconds to spawn the instance on the hypervisor.
Aug 14 13:38:42 user nova-compute[73484]: DEBUG nova.compute.manager [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:38:42 user nova-compute[73484]: INFO nova.compute.manager [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Took 40.69 seconds to build instance.
Aug 14 13:38:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-576df238-8121-4ea7-b6c8-6c55222eb664 tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 40.785s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:38:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:44 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-3c62b75b-7160-4fb9-a69b-d0b3b36ddb07 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Snapshot image upload complete
Aug 14 13:38:44 user nova-compute[73484]: INFO nova.compute.manager [None req-3c62b75b-7160-4fb9-a69b-d0b3b36ddb07 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Took 6.54 seconds to snapshot the instance on the hypervisor.
Aug 14 13:38:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:46 user nova-compute[73484]: DEBUG nova.compute.manager [req-a3877050-9345-4039-a3e2-1aa0b3639229 req-fe7dfba6-91d5-488d-a3e2-d050d5718f4f service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received event network-changed-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:38:46 user nova-compute[73484]: DEBUG nova.compute.manager [req-a3877050-9345-4039-a3e2-1aa0b3639229 req-fe7dfba6-91d5-488d-a3e2-d050d5718f4f service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Refreshing instance network info cache due to event network-changed-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:38:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a3877050-9345-4039-a3e2-1aa0b3639229 req-fe7dfba6-91d5-488d-a3e2-d050d5718f4f service nova] Acquiring lock "refresh_cache-0a3a174b-d870-4164-891e-a2fa8cc8c8b8" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:38:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a3877050-9345-4039-a3e2-1aa0b3639229 req-fe7dfba6-91d5-488d-a3e2-d050d5718f4f service nova] Acquired lock "refresh_cache-0a3a174b-d870-4164-891e-a2fa8cc8c8b8" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:38:46 user nova-compute[73484]: DEBUG nova.network.neutron [req-a3877050-9345-4039-a3e2-1aa0b3639229 req-fe7dfba6-91d5-488d-a3e2-d050d5718f4f service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Refreshing network info cache for port 511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:38:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:48 user nova-compute[73484]: DEBUG nova.network.neutron [req-a3877050-9345-4039-a3e2-1aa0b3639229 req-fe7dfba6-91d5-488d-a3e2-d050d5718f4f service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Updated VIF entry in instance network info cache for port 511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:38:48 user nova-compute[73484]: DEBUG nova.network.neutron [req-a3877050-9345-4039-a3e2-1aa0b3639229 req-fe7dfba6-91d5-488d-a3e2-d050d5718f4f service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Updating instance_info_cache with network_info: [{"id": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "address": "fa:16:3e:b8:35:a4", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511cc5ad-6f", "ovs_interfaceid": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:38:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a3877050-9345-4039-a3e2-1aa0b3639229 req-fe7dfba6-91d5-488d-a3e2-d050d5718f4f service nova] Releasing lock "refresh_cache-0a3a174b-d870-4164-891e-a2fa8cc8c8b8" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:38:48 user nova-compute[73484]: DEBUG nova.compute.manager [req-4442c26b-1515-4e71-b46d-2fa852062c0c req-eb95aa30-f77d-4dfc-8241-edb86ea694c1 service nova] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Received event network-changed-cb7f3901-875e-489a-87f8-5642b9fded9c {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:38:48 user nova-compute[73484]: DEBUG nova.compute.manager [req-4442c26b-1515-4e71-b46d-2fa852062c0c req-eb95aa30-f77d-4dfc-8241-edb86ea694c1 service nova] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Refreshing instance network info cache due to event network-changed-cb7f3901-875e-489a-87f8-5642b9fded9c. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:38:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4442c26b-1515-4e71-b46d-2fa852062c0c req-eb95aa30-f77d-4dfc-8241-edb86ea694c1 service nova] Acquiring lock "refresh_cache-07bac569-8b2c-4555-b4d5-a74f7384630b" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:38:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4442c26b-1515-4e71-b46d-2fa852062c0c req-eb95aa30-f77d-4dfc-8241-edb86ea694c1 service nova] Acquired lock "refresh_cache-07bac569-8b2c-4555-b4d5-a74f7384630b" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:38:48 user nova-compute[73484]: DEBUG nova.network.neutron [req-4442c26b-1515-4e71-b46d-2fa852062c0c req-eb95aa30-f77d-4dfc-8241-edb86ea694c1 service nova] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Refreshing network info cache for port cb7f3901-875e-489a-87f8-5642b9fded9c {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:38:48 user nova-compute[73484]: DEBUG nova.compute.manager [req-9ffa410e-b278-4094-82fa-43a24352f23e req-023b8ff8-9919-4fe1-b713-76d70131749c service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Received event network-changed-290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:38:48 user nova-compute[73484]: DEBUG nova.compute.manager [req-9ffa410e-b278-4094-82fa-43a24352f23e req-023b8ff8-9919-4fe1-b713-76d70131749c service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Refreshing instance network info cache due to event network-changed-290c0b61-ba11-4074-a7f2-cb172a576a19. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:38:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-9ffa410e-b278-4094-82fa-43a24352f23e req-023b8ff8-9919-4fe1-b713-76d70131749c service nova] Acquiring lock "refresh_cache-66e161f1-2f3b-4777-9a0d-5f4d62e850d5" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:38:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-9ffa410e-b278-4094-82fa-43a24352f23e req-023b8ff8-9919-4fe1-b713-76d70131749c service nova] Acquired lock "refresh_cache-66e161f1-2f3b-4777-9a0d-5f4d62e850d5" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:38:48 user nova-compute[73484]: DEBUG nova.network.neutron [req-9ffa410e-b278-4094-82fa-43a24352f23e req-023b8ff8-9919-4fe1-b713-76d70131749c service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Refreshing network info cache for port 290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:38:49 user nova-compute[73484]: DEBUG nova.network.neutron [req-4442c26b-1515-4e71-b46d-2fa852062c0c req-eb95aa30-f77d-4dfc-8241-edb86ea694c1 service nova] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Updated VIF entry in instance network info cache for port cb7f3901-875e-489a-87f8-5642b9fded9c. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:38:49 user nova-compute[73484]: DEBUG nova.network.neutron [req-4442c26b-1515-4e71-b46d-2fa852062c0c req-eb95aa30-f77d-4dfc-8241-edb86ea694c1 service nova] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Updating instance_info_cache with network_info: [{"id": "cb7f3901-875e-489a-87f8-5642b9fded9c", "address": "fa:16:3e:6c:13:9e", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7f3901-87", "ovs_interfaceid": "cb7f3901-875e-489a-87f8-5642b9fded9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:38:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4442c26b-1515-4e71-b46d-2fa852062c0c req-eb95aa30-f77d-4dfc-8241-edb86ea694c1 service nova] Releasing lock "refresh_cache-07bac569-8b2c-4555-b4d5-a74f7384630b" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:38:49 user nova-compute[73484]: DEBUG nova.network.neutron [req-9ffa410e-b278-4094-82fa-43a24352f23e req-023b8ff8-9919-4fe1-b713-76d70131749c service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Updated VIF entry in instance network info cache for port 290c0b61-ba11-4074-a7f2-cb172a576a19. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:38:49 user nova-compute[73484]: DEBUG nova.network.neutron [req-9ffa410e-b278-4094-82fa-43a24352f23e req-023b8ff8-9919-4fe1-b713-76d70131749c service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Updating instance_info_cache with network_info: [{"id": "290c0b61-ba11-4074-a7f2-cb172a576a19", "address": "fa:16:3e:69:2f:ce", "network": {"id": "2306cc91-8443-4c0e-b5a6-3883766b686a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-577320480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ea5214248845418e322d18d298c449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap290c0b61-ba", "ovs_interfaceid": "290c0b61-ba11-4074-a7f2-cb172a576a19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:38:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-9ffa410e-b278-4094-82fa-43a24352f23e req-023b8ff8-9919-4fe1-b713-76d70131749c service nova] Releasing lock "refresh_cache-66e161f1-2f3b-4777-9a0d-5f4d62e850d5" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:38:49 user nova-compute[73484]: DEBUG nova.compute.manager [None req-c313114c-0bb7-4bc9-8924-c13a178f2868 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:38:49 user nova-compute[73484]: INFO nova.compute.manager [None req-c313114c-0bb7-4bc9-8924-c13a178f2868 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] instance snapshotting
Aug 14 13:38:50 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-c313114c-0bb7-4bc9-8924-c13a178f2868 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Beginning live snapshot process
Aug 14 13:38:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-c313114c-0bb7-4bc9-8924-c13a178f2868 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json -f qcow2 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-c313114c-0bb7-4bc9-8924-c13a178f2868 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-c313114c-0bb7-4bc9-8924-c13a178f2868 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json -f qcow2 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-c313114c-0bb7-4bc9-8924-c13a178f2868 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json -f qcow2" returned: 0 in 0.193s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-c313114c-0bb7-4bc9-8924-c13a178f2868 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-c313114c-0bb7-4bc9-8924-c13a178f2868 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.192s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-c313114c-0bb7-4bc9-8924-c13a178f2868 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprmts7xd1/e68e70305ae145c6848fcc06a0e767f1.delta 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-c313114c-0bb7-4bc9-8924-c13a178f2868 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprmts7xd1/e68e70305ae145c6848fcc06a0e767f1.delta 1073741824" returned: 0 in 0.053s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:50 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-c313114c-0bb7-4bc9-8924-c13a178f2868 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 13:38:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:38:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:38:51 user nova-compute[73484]: DEBUG nova.objects.instance [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'flavor' on Instance uuid 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:38:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.113s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:38:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:38:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:38:51 user nova-compute[73484]: INFO nova.compute.manager [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Attaching volume a9a47272-145b-4612-b657-2ff1d153dcbd to /dev/vdb
Aug 14 13:38:51 user nova-compute[73484]: DEBUG os_brick.utils [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:38:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:51 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[da082387-9859-4597-a886-c6c477f923b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:51 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[180d2bee-1379-41f7-bba6-4164b04cec3e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:51 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a241f8-5e74-4617-ae2f-3d452618c13b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:51 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4ee6af-ffa4-4e18-94ac-088944831400]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:38:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:38:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:38:51 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:38:51 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b471354-ce0d-406b-bb67-ed782a0dfd5b]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:38:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:38:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:38:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:38:51 user nova-compute[73484]: DEBUG os_brick.utils [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:38:51 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Updating existing volume attachment record: 62e66b9b-68ea-4feb-a29f-c4404ccff1c6 {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:38:51 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-c313114c-0bb7-4bc9-8924-c13a178f2868 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=73484) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 13:38:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-c313114c-0bb7-4bc9-8924-c13a178f2868 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73484) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 13:38:52 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-c313114c-0bb7-4bc9-8924-c13a178f2868 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 13:38:52 user nova-compute[73484]: DEBUG nova.privsep.utils [None req-c313114c-0bb7-4bc9-8924-c13a178f2868 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73484) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 13:38:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-c313114c-0bb7-4bc9-8924-c13a178f2868 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprmts7xd1/e68e70305ae145c6848fcc06a0e767f1.delta /opt/stack/data/nova/instances/snapshots/tmprmts7xd1/e68e70305ae145c6848fcc06a0e767f1 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:38:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-c313114c-0bb7-4bc9-8924-c13a178f2868 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprmts7xd1/e68e70305ae145c6848fcc06a0e767f1.delta /opt/stack/data/nova/instances/snapshots/tmprmts7xd1/e68e70305ae145c6848fcc06a0e767f1" returned: 0 in 0.321s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:38:52 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-c313114c-0bb7-4bc9-8924-c13a178f2868 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Snapshot extracted, beginning image upload
Aug 14 13:38:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:55 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-c313114c-0bb7-4bc9-8924-c13a178f2868 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Snapshot image upload complete
Aug 14 13:38:55 user nova-compute[73484]: INFO nova.compute.manager [None req-c313114c-0bb7-4bc9-8924-c13a178f2868 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Took 5.39 seconds to snapshot the instance on the hypervisor.
Aug 14 13:38:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:38:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:00 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:39:00 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IbnmokSX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:39:00 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:39:00 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:39:00 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:39:00 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:39:00 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:39:00 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:39:00 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:39:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:00 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6948efee-ca5e-4538-990a-f1cecf325813]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:00 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:39:00 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:00 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb04266-f2bf-4053-980a-5bdd723c6b47]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:00 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd] added
Aug 14 13:39:00 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:00 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d01d185-a394-47a5-a187-dbae6abb5a47]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:00 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a133ad46-054e-4705-bdae-3ac68bdc3e7f]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IbnmokSX {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IbnmokSX" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[162332ce-77b3-43d4-b4bc-d2cee49be92a]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IbnmokSX'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c734bfa-172e-4085-98e9-97b48773dad1]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbab23f6-68c7-41c1-be73-4ca39fd23d99]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:39:01 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:01 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:01 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:01 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:39:01 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:01 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:01 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:01 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4689c338-67ce-4747-b1d6-e627abac8498]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd, portal: 172.16.0.220,3260]
Aug 14 13:39:01 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd, portal: 172.16.0.220,3260] successful.
Aug 14 13:39:01 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20d600e-3a04-4a2c-b2bf-ad37d3e434e1]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a31b74b-fee5-4e2e-aab7-683e1ad3b791]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:39:01 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:01 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:01 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:01 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:01 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:39:01 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:01 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:01 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:01 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:01 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[712c2a02-c4f3-4147-a980-f22f306460df]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:39:01 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IbnmokSX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:39:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:39:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23961353662623138', 'path': '/dev/sdf'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:39:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961353662623138', 'path': '/dev/sdf'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:39:02 user nova-compute[73484]: DEBUG nova.objects.instance [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'flavor' on Instance uuid 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:39:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 13:39:02 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:39:02 user nova-compute[73484]:   <source dev="/dev/sdf"/>
Aug 14 13:39:02 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:39:02 user nova-compute[73484]:   <serial>a9a47272-145b-4612-b657-2ff1d153dcbd</serial>
Aug 14 13:39:02 user nova-compute[73484]: </disk>
Aug 14 13:39:02 user nova-compute[73484]:  {{(pid=73484) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 13:39:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:39:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:39:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] No VIF found with MAC fa:16:3e:b8:35:a4, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:39:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fc947440-f5b5-4943-a094-08cc513b11f4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.367s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-21429402-a7c1-4bc3-a2a4-9206655573f2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-21429402-a7c1-4bc3-a2a4-9206655573f2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:03 user nova-compute[73484]: DEBUG nova.compute.manager [None req-21429402-a7c1-4bc3-a2a4-9206655573f2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:39:03 user nova-compute[73484]: DEBUG nova.compute.manager [None req-21429402-a7c1-4bc3-a2a4-9206655573f2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73484) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 14 13:39:03 user nova-compute[73484]: DEBUG nova.objects.instance [None req-21429402-a7c1-4bc3-a2a4-9206655573f2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'flavor' on Instance uuid 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:39:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:04 user nova-compute[73484]: DEBUG nova.compute.manager [req-b48ee3d2-7f2e-4636-a710-21fd952c409b req-6a7fb467-5b12-4e3c-806a-5824cb2af166 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received event network-vif-unplugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b48ee3d2-7f2e-4636-a710-21fd952c409b req-6a7fb467-5b12-4e3c-806a-5824cb2af166 service nova] Acquiring lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b48ee3d2-7f2e-4636-a710-21fd952c409b req-6a7fb467-5b12-4e3c-806a-5824cb2af166 service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b48ee3d2-7f2e-4636-a710-21fd952c409b req-6a7fb467-5b12-4e3c-806a-5824cb2af166 service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:04 user nova-compute[73484]: DEBUG nova.compute.manager [req-b48ee3d2-7f2e-4636-a710-21fd952c409b req-6a7fb467-5b12-4e3c-806a-5824cb2af166 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] No waiting events found dispatching network-vif-unplugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:39:04 user nova-compute[73484]: WARNING nova.compute.manager [req-b48ee3d2-7f2e-4636-a710-21fd952c409b req-6a7fb467-5b12-4e3c-806a-5824cb2af166 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received unexpected event network-vif-unplugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a for instance with vm_state active and task_state powering-off.
Aug 14 13:39:04 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Instance destroyed successfully.
Aug 14 13:39:04 user nova-compute[73484]: DEBUG nova.compute.manager [None req-21429402-a7c1-4bc3-a2a4-9206655573f2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:39:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-21429402-a7c1-4bc3-a2a4-9206655573f2 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.007s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:04 user nova-compute[73484]: DEBUG nova.compute.manager [req-5c6ca99a-46be-4c2e-9045-657fe8d3b7c3 req-d2bad610-db6e-459b-9d83-53717fd02b84 service nova] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Received event network-changed-cd94675b-f6af-48b1-a32f-0a39549f404d {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:04 user nova-compute[73484]: DEBUG nova.compute.manager [req-5c6ca99a-46be-4c2e-9045-657fe8d3b7c3 req-d2bad610-db6e-459b-9d83-53717fd02b84 service nova] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Refreshing instance network info cache due to event network-changed-cd94675b-f6af-48b1-a32f-0a39549f404d. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:39:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5c6ca99a-46be-4c2e-9045-657fe8d3b7c3 req-d2bad610-db6e-459b-9d83-53717fd02b84 service nova] Acquiring lock "refresh_cache-b889688d-13dd-4f7b-bfef-26dc5347fd6e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:39:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5c6ca99a-46be-4c2e-9045-657fe8d3b7c3 req-d2bad610-db6e-459b-9d83-53717fd02b84 service nova] Acquired lock "refresh_cache-b889688d-13dd-4f7b-bfef-26dc5347fd6e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:39:04 user nova-compute[73484]: DEBUG nova.network.neutron [req-5c6ca99a-46be-4c2e-9045-657fe8d3b7c3 req-d2bad610-db6e-459b-9d83-53717fd02b84 service nova] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Refreshing network info cache for port cd94675b-f6af-48b1-a32f-0a39549f404d {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:39:05 user nova-compute[73484]: DEBUG nova.network.neutron [req-5c6ca99a-46be-4c2e-9045-657fe8d3b7c3 req-d2bad610-db6e-459b-9d83-53717fd02b84 service nova] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Updated VIF entry in instance network info cache for port cd94675b-f6af-48b1-a32f-0a39549f404d. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:39:05 user nova-compute[73484]: DEBUG nova.network.neutron [req-5c6ca99a-46be-4c2e-9045-657fe8d3b7c3 req-d2bad610-db6e-459b-9d83-53717fd02b84 service nova] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Updating instance_info_cache with network_info: [{"id": "cd94675b-f6af-48b1-a32f-0a39549f404d", "address": "fa:16:3e:7d:02:29", "network": {"id": "988c9059-476e-4558-8e68-3cfe68a53a09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1683768593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a95ec66f3424934bdff0335e262cc9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd94675b-f6", "ovs_interfaceid": "cd94675b-f6af-48b1-a32f-0a39549f404d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:39:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5c6ca99a-46be-4c2e-9045-657fe8d3b7c3 req-d2bad610-db6e-459b-9d83-53717fd02b84 service nova] Releasing lock "refresh_cache-b889688d-13dd-4f7b-bfef-26dc5347fd6e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:39:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:06 user nova-compute[73484]: DEBUG nova.compute.manager [req-baeede64-3bc0-4273-81eb-f05501ff3ddc req-407b7dee-044f-4311-9d33-c218f13763ac service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received event network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-baeede64-3bc0-4273-81eb-f05501ff3ddc req-407b7dee-044f-4311-9d33-c218f13763ac service nova] Acquiring lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-baeede64-3bc0-4273-81eb-f05501ff3ddc req-407b7dee-044f-4311-9d33-c218f13763ac service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-baeede64-3bc0-4273-81eb-f05501ff3ddc req-407b7dee-044f-4311-9d33-c218f13763ac service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:06 user nova-compute[73484]: DEBUG nova.compute.manager [req-baeede64-3bc0-4273-81eb-f05501ff3ddc req-407b7dee-044f-4311-9d33-c218f13763ac service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] No waiting events found dispatching network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:39:06 user nova-compute[73484]: WARNING nova.compute.manager [req-baeede64-3bc0-4273-81eb-f05501ff3ddc req-407b7dee-044f-4311-9d33-c218f13763ac service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received unexpected event network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a for instance with vm_state stopped and task_state None.
Aug 14 13:39:08 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Acquiring lock "b889688d-13dd-4f7b-bfef-26dc5347fd6e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "b889688d-13dd-4f7b-bfef-26dc5347fd6e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:08 user nova-compute[73484]: DEBUG nova.objects.instance [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lazy-loading 'flavor' on Instance uuid b889688d-13dd-4f7b-bfef-26dc5347fd6e {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:39:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "b889688d-13dd-4f7b-bfef-26dc5347fd6e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Acquiring lock "b889688d-13dd-4f7b-bfef-26dc5347fd6e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "b889688d-13dd-4f7b-bfef-26dc5347fd6e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:09 user nova-compute[73484]: INFO nova.compute.manager [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Attaching volume 49e82429-76fe-4e04-a353-1bbf0b75a1ae to /dev/vdb
Aug 14 13:39:09 user nova-compute[73484]: DEBUG os_brick.utils [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:39:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad2f5a0-e061-4492-9ddf-202c26f2d49e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3a487e-7b30-4f94-b229-2f3fe0b9ec60]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[286665a7-f915-4afd-9477-099f777af385]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7f6164-5d37-45ce-ab62-c1add7ee91c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:39:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:39:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:39:09 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:39:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2954053-7589-413e-92b4-d5b4786e406f]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:39:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:39:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:39:09 user nova-compute[73484]: DEBUG os_brick.utils [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:39:09 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Updating existing volume attachment record: 545f915a-22bd-4b57-b331-8747b2e4e80b {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:39:09 user nova-compute[73484]: DEBUG nova.compute.manager [req-ac96f5a5-5069-4f66-aca5-2ce85b01ad0c req-05e688ae-958a-40fc-8863-502195149683 service nova] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Received event network-changed-16674c9f-fc44-461d-ac6b-1a7239360f06 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:09 user nova-compute[73484]: DEBUG nova.compute.manager [req-ac96f5a5-5069-4f66-aca5-2ce85b01ad0c req-05e688ae-958a-40fc-8863-502195149683 service nova] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Refreshing instance network info cache due to event network-changed-16674c9f-fc44-461d-ac6b-1a7239360f06. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:39:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ac96f5a5-5069-4f66-aca5-2ce85b01ad0c req-05e688ae-958a-40fc-8863-502195149683 service nova] Acquiring lock "refresh_cache-377257a6-916e-4269-bc53-a81d8bed6bdb" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:39:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ac96f5a5-5069-4f66-aca5-2ce85b01ad0c req-05e688ae-958a-40fc-8863-502195149683 service nova] Acquired lock "refresh_cache-377257a6-916e-4269-bc53-a81d8bed6bdb" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:39:09 user nova-compute[73484]: DEBUG nova.network.neutron [req-ac96f5a5-5069-4f66-aca5-2ce85b01ad0c req-05e688ae-958a-40fc-8863-502195149683 service nova] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Refreshing network info cache for port 16674c9f-fc44-461d-ac6b-1a7239360f06 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Acquiring lock "377257a6-916e-4269-bc53-a81d8bed6bdb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Lock "377257a6-916e-4269-bc53-a81d8bed6bdb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG nova.objects.instance [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Lazy-loading 'flavor' on Instance uuid 377257a6-916e-4269-bc53-a81d8bed6bdb {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Lock "377257a6-916e-4269-bc53-a81d8bed6bdb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Acquiring lock "377257a6-916e-4269-bc53-a81d8bed6bdb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Lock "377257a6-916e-4269-bc53-a81d8bed6bdb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:10 user nova-compute[73484]: INFO nova.compute.manager [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Attaching volume 427d4d6d-5b8b-468b-8424-602e15790676 to /dev/vdb
Aug 14 13:39:10 user nova-compute[73484]: DEBUG nova.network.neutron [req-ac96f5a5-5069-4f66-aca5-2ce85b01ad0c req-05e688ae-958a-40fc-8863-502195149683 service nova] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Updated VIF entry in instance network info cache for port 16674c9f-fc44-461d-ac6b-1a7239360f06. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG nova.network.neutron [req-ac96f5a5-5069-4f66-aca5-2ce85b01ad0c req-05e688ae-958a-40fc-8863-502195149683 service nova] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Updating instance_info_cache with network_info: [{"id": "16674c9f-fc44-461d-ac6b-1a7239360f06", "address": "fa:16:3e:3e:15:05", "network": {"id": "4d15ff21-bb7f-4f6f-a5cb-7a77b1fd50a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-471876759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd28ddec1473427ca368b92bb6fbd1df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16674c9f-fc", "ovs_interfaceid": "16674c9f-fc44-461d-ac6b-1a7239360f06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ac96f5a5-5069-4f66-aca5-2ce85b01ad0c req-05e688ae-958a-40fc-8863-502195149683 service nova] Releasing lock "refresh_cache-377257a6-916e-4269-bc53-a81d8bed6bdb" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG os_brick.utils [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24c2834-9e85-4e2d-9680-ea4074f1036d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0467d7-fc3c-41d9-a792-7d20d3164625]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[09197c44-78d2-447a-b60f-18d3327cf5e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a19719-e07e-4536-bd67-5395252fbbc1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:39:10 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:39:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[004335a4-3b0e-4b5d-bf36-84b0e397ea04]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG os_brick.utils [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Updating existing volume attachment record: 3fae9730-d316-4180-ad6c-00decf15851a {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG nova.compute.manager [req-05909531-347c-4f6f-bf0f-3a40d55672d4 req-a80c4e45-e334-4749-b7e4-2dabf8cc328e service nova] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Received event network-changed-de0da088-b53c-4792-b764-b6c6cd9dc5a3 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG nova.compute.manager [req-05909531-347c-4f6f-bf0f-3a40d55672d4 req-a80c4e45-e334-4749-b7e4-2dabf8cc328e service nova] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Refreshing instance network info cache due to event network-changed-de0da088-b53c-4792-b764-b6c6cd9dc5a3. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-05909531-347c-4f6f-bf0f-3a40d55672d4 req-a80c4e45-e334-4749-b7e4-2dabf8cc328e service nova] Acquiring lock "refresh_cache-96025e5d-7c98-4ed4-8180-7c2cdb1d65bf" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-05909531-347c-4f6f-bf0f-3a40d55672d4 req-a80c4e45-e334-4749-b7e4-2dabf8cc328e service nova] Acquired lock "refresh_cache-96025e5d-7c98-4ed4-8180-7c2cdb1d65bf" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:39:10 user nova-compute[73484]: DEBUG nova.network.neutron [req-05909531-347c-4f6f-bf0f-3a40d55672d4 req-a80c4e45-e334-4749-b7e4-2dabf8cc328e service nova] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Refreshing network info cache for port de0da088-b53c-4792-b764-b6c6cd9dc5a3 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:39:11 user nova-compute[73484]: DEBUG nova.network.neutron [req-05909531-347c-4f6f-bf0f-3a40d55672d4 req-a80c4e45-e334-4749-b7e4-2dabf8cc328e service nova] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Updated VIF entry in instance network info cache for port de0da088-b53c-4792-b764-b6c6cd9dc5a3. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:39:11 user nova-compute[73484]: DEBUG nova.network.neutron [req-05909531-347c-4f6f-bf0f-3a40d55672d4 req-a80c4e45-e334-4749-b7e4-2dabf8cc328e service nova] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Updating instance_info_cache with network_info: [{"id": "de0da088-b53c-4792-b764-b6c6cd9dc5a3", "address": "fa:16:3e:76:d0:d2", "network": {"id": "e557c45b-1bcb-487b-8510-0d3d31efb70e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-254555588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55f538430f3b45b9905698823d51c054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0da088-b5", "ovs_interfaceid": "de0da088-b53c-4792-b764-b6c6cd9dc5a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:39:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-05909531-347c-4f6f-bf0f-3a40d55672d4 req-a80c4e45-e334-4749-b7e4-2dabf8cc328e service nova] Releasing lock "refresh_cache-96025e5d-7c98-4ed4-8180-7c2cdb1d65bf" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:39:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:14 user nova-compute[73484]: DEBUG nova.compute.manager [req-15d60563-cafa-44be-a9d4-ea2bbc7f73a7 req-54fd86fe-e83f-4a42-a971-bed7aa382bec service nova] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Received event network-changed-81a13981-b50f-4f1b-ac18-d4eea5f141fd {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:14 user nova-compute[73484]: DEBUG nova.compute.manager [req-15d60563-cafa-44be-a9d4-ea2bbc7f73a7 req-54fd86fe-e83f-4a42-a971-bed7aa382bec service nova] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Refreshing instance network info cache due to event network-changed-81a13981-b50f-4f1b-ac18-d4eea5f141fd. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:39:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-15d60563-cafa-44be-a9d4-ea2bbc7f73a7 req-54fd86fe-e83f-4a42-a971-bed7aa382bec service nova] Acquiring lock "refresh_cache-7ac05f68-a20f-4a57-b990-ef0799aadc58" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:39:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-15d60563-cafa-44be-a9d4-ea2bbc7f73a7 req-54fd86fe-e83f-4a42-a971-bed7aa382bec service nova] Acquired lock "refresh_cache-7ac05f68-a20f-4a57-b990-ef0799aadc58" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:39:14 user nova-compute[73484]: DEBUG nova.network.neutron [req-15d60563-cafa-44be-a9d4-ea2bbc7f73a7 req-54fd86fe-e83f-4a42-a971-bed7aa382bec service nova] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Refreshing network info cache for port 81a13981-b50f-4f1b-ac18-d4eea5f141fd {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:39:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Acquiring lock "7ac05f68-a20f-4a57-b990-ef0799aadc58" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lock "7ac05f68-a20f-4a57-b990-ef0799aadc58" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:14 user nova-compute[73484]: DEBUG nova.objects.instance [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lazy-loading 'flavor' on Instance uuid 7ac05f68-a20f-4a57-b990-ef0799aadc58 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:39:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lock "7ac05f68-a20f-4a57-b990-ef0799aadc58" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Acquiring lock "7ac05f68-a20f-4a57-b990-ef0799aadc58" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lock "7ac05f68-a20f-4a57-b990-ef0799aadc58" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:14 user nova-compute[73484]: INFO nova.compute.manager [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Attaching volume b74c54bf-81bc-4b2a-9dc3-c7186d64df0e to /dev/vdb
Aug 14 13:39:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Acquiring lock "96025e5d-7c98-4ed4-8180-7c2cdb1d65bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lock "96025e5d-7c98-4ed4-8180-7c2cdb1d65bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:14 user nova-compute[73484]: DEBUG nova.network.neutron [req-15d60563-cafa-44be-a9d4-ea2bbc7f73a7 req-54fd86fe-e83f-4a42-a971-bed7aa382bec service nova] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Updated VIF entry in instance network info cache for port 81a13981-b50f-4f1b-ac18-d4eea5f141fd. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:39:14 user nova-compute[73484]: DEBUG nova.network.neutron [req-15d60563-cafa-44be-a9d4-ea2bbc7f73a7 req-54fd86fe-e83f-4a42-a971-bed7aa382bec service nova] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Updating instance_info_cache with network_info: [{"id": "81a13981-b50f-4f1b-ac18-d4eea5f141fd", "address": "fa:16:3e:6e:d0:0c", "network": {"id": "27abd91d-84d4-4660-8708-088648dcf2fd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-847318959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02feed89293147398ae749494502ca78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a13981-b5", "ovs_interfaceid": "81a13981-b50f-4f1b-ac18-d4eea5f141fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:39:14 user nova-compute[73484]: DEBUG nova.objects.instance [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lazy-loading 'flavor' on Instance uuid 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:39:14 user nova-compute[73484]: DEBUG nova.compute.manager [req-679638d6-3b45-41bc-9c2b-6814cd4af3f3 req-8f32f126-0d1f-451a-bd7d-7b7b32c4732d service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Received event network-changed-2eb5bc00-16a1-43cd-ac1f-db1d191fba75 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:14 user nova-compute[73484]: DEBUG nova.compute.manager [req-679638d6-3b45-41bc-9c2b-6814cd4af3f3 req-8f32f126-0d1f-451a-bd7d-7b7b32c4732d service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Refreshing instance network info cache due to event network-changed-2eb5bc00-16a1-43cd-ac1f-db1d191fba75. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:39:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-679638d6-3b45-41bc-9c2b-6814cd4af3f3 req-8f32f126-0d1f-451a-bd7d-7b7b32c4732d service nova] Acquiring lock "refresh_cache-7348b004-4d46-4db5-a451-afd3b7476569" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:39:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-679638d6-3b45-41bc-9c2b-6814cd4af3f3 req-8f32f126-0d1f-451a-bd7d-7b7b32c4732d service nova] Acquired lock "refresh_cache-7348b004-4d46-4db5-a451-afd3b7476569" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:39:14 user nova-compute[73484]: DEBUG nova.network.neutron [req-679638d6-3b45-41bc-9c2b-6814cd4af3f3 req-8f32f126-0d1f-451a-bd7d-7b7b32c4732d service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Refreshing network info cache for port 2eb5bc00-16a1-43cd-ac1f-db1d191fba75 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:39:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-15d60563-cafa-44be-a9d4-ea2bbc7f73a7 req-54fd86fe-e83f-4a42-a971-bed7aa382bec service nova] Releasing lock "refresh_cache-7ac05f68-a20f-4a57-b990-ef0799aadc58" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:39:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lock "96025e5d-7c98-4ed4-8180-7c2cdb1d65bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:14 user nova-compute[73484]: DEBUG os_brick.utils [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:39:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:14 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d64daf-c34f-47ec-b45b-bed11d05d027]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.030s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:15 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f087a2-ef6d-41df-9026-3ae330fa4d32]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:15 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6419be99-8c57-4489-baa7-1070e6ed8908]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:15 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fae92cc-0f7a-4dea-a415-7d52df7b674e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:39:15 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:39:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:39:15 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:39:15 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11ccc05-d4f9-49a9-aef2-742323429c26]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:15 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:39:15 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:39:15 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:39:15 user nova-compute[73484]: DEBUG os_brick.utils [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:39:15 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Updating existing volume attachment record: 6996002b-9205-4fc8-8944-b5bd96386af3 {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:39:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Acquiring lock "96025e5d-7c98-4ed4-8180-7c2cdb1d65bf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lock "96025e5d-7c98-4ed4-8180-7c2cdb1d65bf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:15 user nova-compute[73484]: INFO nova.compute.manager [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Attaching volume 45599018-8480-4b94-a396-e74b5832ee9d to /dev/sdc
Aug 14 13:39:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-4d96bf2e-d5f0-4a12-9a37-51204229dcca tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Acquiring lock "interface-7348b004-4d46-4db5-a451-afd3b7476569-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-4d96bf2e-d5f0-4a12-9a37-51204229dcca tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "interface-7348b004-4d46-4db5-a451-afd3b7476569-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:15 user nova-compute[73484]: DEBUG nova.objects.instance [None req-4d96bf2e-d5f0-4a12-9a37-51204229dcca tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lazy-loading 'flavor' on Instance uuid 7348b004-4d46-4db5-a451-afd3b7476569 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:39:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:15 user nova-compute[73484]: DEBUG nova.network.neutron [req-679638d6-3b45-41bc-9c2b-6814cd4af3f3 req-8f32f126-0d1f-451a-bd7d-7b7b32c4732d service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Updated VIF entry in instance network info cache for port 2eb5bc00-16a1-43cd-ac1f-db1d191fba75. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:39:15 user nova-compute[73484]: DEBUG nova.network.neutron [req-679638d6-3b45-41bc-9c2b-6814cd4af3f3 req-8f32f126-0d1f-451a-bd7d-7b7b32c4732d service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Updating instance_info_cache with network_info: [{"id": "2eb5bc00-16a1-43cd-ac1f-db1d191fba75", "address": "fa:16:3e:a3:34:4e", "network": {"id": "06967e28-4529-4bb4-913e-406da0cbf817", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-360793833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "900fe242d672495d832feee598acf991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb5bc00-16", "ovs_interfaceid": "2eb5bc00-16a1-43cd-ac1f-db1d191fba75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:39:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-679638d6-3b45-41bc-9c2b-6814cd4af3f3 req-8f32f126-0d1f-451a-bd7d-7b7b32c4732d service nova] Releasing lock "refresh_cache-7348b004-4d46-4db5-a451-afd3b7476569" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:39:15 user nova-compute[73484]: DEBUG nova.objects.instance [None req-4d96bf2e-d5f0-4a12-9a37-51204229dcca tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lazy-loading 'pci_requests' on Instance uuid 7348b004-4d46-4db5-a451-afd3b7476569 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:39:15 user nova-compute[73484]: DEBUG nova.network.neutron [None req-4d96bf2e-d5f0-4a12-9a37-51204229dcca tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:39:15 user nova-compute[73484]: DEBUG nova.policy [None req-4d96bf2e-d5f0-4a12-9a37-51204229dcca tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '602233ac777c42ac8f97536c706d5fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '900fe242d672495d832feee598acf991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:39:16 user nova-compute[73484]: DEBUG nova.network.neutron [None req-4d96bf2e-d5f0-4a12-9a37-51204229dcca tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Successfully created port: ca4312d6-790c-49f6-b6e5-dc3033d0d93f {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:39:17 user nova-compute[73484]: DEBUG nova.network.neutron [None req-4d96bf2e-d5f0-4a12-9a37-51204229dcca tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Successfully updated port: ca4312d6-790c-49f6-b6e5-dc3033d0d93f {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:39:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-4d96bf2e-d5f0-4a12-9a37-51204229dcca tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Acquiring lock "refresh_cache-7348b004-4d46-4db5-a451-afd3b7476569" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:39:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-4d96bf2e-d5f0-4a12-9a37-51204229dcca tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Acquired lock "refresh_cache-7348b004-4d46-4db5-a451-afd3b7476569" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:39:17 user nova-compute[73484]: DEBUG nova.network.neutron [None req-4d96bf2e-d5f0-4a12-9a37-51204229dcca tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:39:17 user nova-compute[73484]: DEBUG nova.compute.manager [req-43db65b3-5fad-403d-bdfa-2a297b705b38 req-57e8e50c-621b-47cd-a706-e003db0af0fc service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Received event network-changed-ca4312d6-790c-49f6-b6e5-dc3033d0d93f {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:17 user nova-compute[73484]: DEBUG nova.compute.manager [req-43db65b3-5fad-403d-bdfa-2a297b705b38 req-57e8e50c-621b-47cd-a706-e003db0af0fc service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Refreshing instance network info cache due to event network-changed-ca4312d6-790c-49f6-b6e5-dc3033d0d93f. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:39:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-43db65b3-5fad-403d-bdfa-2a297b705b38 req-57e8e50c-621b-47cd-a706-e003db0af0fc service nova] Acquiring lock "refresh_cache-7348b004-4d46-4db5-a451-afd3b7476569" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:39:17 user nova-compute[73484]: DEBUG nova.network.neutron [None req-4d96bf2e-d5f0-4a12-9a37-51204229dcca tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Updating instance_info_cache with network_info: [{"id": "2eb5bc00-16a1-43cd-ac1f-db1d191fba75", "address": "fa:16:3e:a3:34:4e", "network": {"id": "06967e28-4529-4bb4-913e-406da0cbf817", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-360793833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "900fe242d672495d832feee598acf991", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb5bc00-16", "ovs_interfaceid": "2eb5bc00-16a1-43cd-ac1f-db1d191fba75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca4312d6-790c-49f6-b6e5-dc3033d0d93f", "address": "fa:16:3e:25:ae:d6", "network": {"id": "710aecff-babe-436a-97ee-fdb206a5a73b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1050503830", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "900fe242d672495d832feee598acf991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4312d6-79", "ovs_interfaceid": "ca4312d6-790c-49f6-b6e5-dc3033d0d93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:39:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-4d96bf2e-d5f0-4a12-9a37-51204229dcca tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Releasing lock "refresh_cache-7348b004-4d46-4db5-a451-afd3b7476569" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:39:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-43db65b3-5fad-403d-bdfa-2a297b705b38 req-57e8e50c-621b-47cd-a706-e003db0af0fc service nova] Acquired lock "refresh_cache-7348b004-4d46-4db5-a451-afd3b7476569" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:39:17 user nova-compute[73484]: DEBUG nova.network.neutron [req-43db65b3-5fad-403d-bdfa-2a297b705b38 req-57e8e50c-621b-47cd-a706-e003db0af0fc service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Refreshing network info cache for port ca4312d6-790c-49f6-b6e5-dc3033d0d93f {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:39:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-4d96bf2e-d5f0-4a12-9a37-51204229dcca tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:37:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-522186817',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-522186817',id=9,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiK6LkV4LYXJ9k8WiSdM3r6iHP8qN1XXbA8EbfSGkzqKZ1oy8APH01wj6TnPRn+92njmmJyEDjXb8n2RsiEiMAkKvCvz4+a7zm6gB5yZrCVjYB/hhRdrNwSW43XY6YGlg==',key_name='tempest-keypair-2063229418',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:37:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='900fe242d672495d832feee598acf991',ramdisk_id='',reservation_id='r-smdsx10g',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-696464863',owner_user_name='tempest-TaggedAttachmentsTest-696464863-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:37:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='602233ac777c42ac8f97536c706d5fd8',uuid=7348b004-4d46-4db5-a451-afd3b7476569,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca4312d6-790c-49f6-b6e5-dc3033d0d93f", "address": "fa:16:3e:25:ae:d6", "network": {"id": "710aecff-babe-436a-97ee-fdb206a5a73b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1050503830", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "900fe242d672495d832feee598acf991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4312d6-79", "ovs_interfaceid": "ca4312d6-790c-49f6-b6e5-dc3033d0d93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:39:17 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-4d96bf2e-d5f0-4a12-9a37-51204229dcca tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Converting VIF {"id": "ca4312d6-790c-49f6-b6e5-dc3033d0d93f", "address": "fa:16:3e:25:ae:d6", "network": {"id": "710aecff-babe-436a-97ee-fdb206a5a73b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1050503830", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "900fe242d672495d832feee598acf991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4312d6-79", "ovs_interfaceid": "ca4312d6-790c-49f6-b6e5-dc3033d0d93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:39:17 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-4d96bf2e-d5f0-4a12-9a37-51204229dcca tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=ca4312d6-790c-49f6-b6e5-dc3033d0d93f,network=Network(710aecff-babe-436a-97ee-fdb206a5a73b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4312d6-79') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:39:17 user nova-compute[73484]: DEBUG os_vif [None req-4d96bf2e-d5f0-4a12-9a37-51204229dcca tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=ca4312d6-790c-49f6-b6e5-dc3033d0d93f,network=Network(710aecff-babe-436a-97ee-fdb206a5a73b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4312d6-79') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:39:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:39:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:39:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca4312d6-79, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:39:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapca4312d6-79, col_values=(('external_ids', {'iface-id': 'ca4312d6-790c-49f6-b6e5-dc3033d0d93f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:ae:d6', 'vm-uuid': '7348b004-4d46-4db5-a451-afd3b7476569'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:39:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:39:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:17 user nova-compute[73484]: INFO os_vif [None req-4d96bf2e-d5f0-4a12-9a37-51204229dcca tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=ca4312d6-790c-49f6-b6e5-dc3033d0d93f,network=Network(710aecff-babe-436a-97ee-fdb206a5a73b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4312d6-79')
Aug 14 13:39:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-4d96bf2e-d5f0-4a12-9a37-51204229dcca tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:37:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-522186817',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-522186817',id=9,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiK6LkV4LYXJ9k8WiSdM3r6iHP8qN1XXbA8EbfSGkzqKZ1oy8APH01wj6TnPRn+92njmmJyEDjXb8n2RsiEiMAkKvCvz4+a7zm6gB5yZrCVjYB/hhRdrNwSW43XY6YGlg==',key_name='tempest-keypair-2063229418',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:37:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='900fe242d672495d832feee598acf991',ramdisk_id='',reservation_id='r-smdsx10g',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-696464863',owner_user_name='tempest-TaggedAttachmentsTest-696464863-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:37:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='602233ac777c42ac8f97536c706d5fd8',uuid=7348b004-4d46-4db5-a451-afd3b7476569,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca4312d6-790c-49f6-b6e5-dc3033d0d93f", "address": "fa:16:3e:25:ae:d6", "network": {"id": "710aecff-babe-436a-97ee-fdb206a5a73b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1050503830", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "900fe242d672495d832feee598acf991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4312d6-79", "ovs_interfaceid": "ca4312d6-790c-49f6-b6e5-dc3033d0d93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:39:17 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-4d96bf2e-d5f0-4a12-9a37-51204229dcca tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Converting VIF {"id": "ca4312d6-790c-49f6-b6e5-dc3033d0d93f", "address": "fa:16:3e:25:ae:d6", "network": {"id": "710aecff-babe-436a-97ee-fdb206a5a73b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1050503830", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "900fe242d672495d832feee598acf991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4312d6-79", "ovs_interfaceid": "ca4312d6-790c-49f6-b6e5-dc3033d0d93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:39:17 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-4d96bf2e-d5f0-4a12-9a37-51204229dcca tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=ca4312d6-790c-49f6-b6e5-dc3033d0d93f,network=Network(710aecff-babe-436a-97ee-fdb206a5a73b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4312d6-79') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:39:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-4d96bf2e-d5f0-4a12-9a37-51204229dcca tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] attach device xml: <interface type="ethernet">
Aug 14 13:39:17 user nova-compute[73484]:   <mac address="fa:16:3e:25:ae:d6"/>
Aug 14 13:39:17 user nova-compute[73484]:   <model type="virtio"/>
Aug 14 13:39:17 user nova-compute[73484]:   <mtu size="1442"/>
Aug 14 13:39:17 user nova-compute[73484]:   <target dev="tapca4312d6-79"/>
Aug 14 13:39:17 user nova-compute[73484]: </interface>
Aug 14 13:39:17 user nova-compute[73484]:  {{(pid=73484) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 13:39:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:18 user nova-compute[73484]: DEBUG nova.network.neutron [req-43db65b3-5fad-403d-bdfa-2a297b705b38 req-57e8e50c-621b-47cd-a706-e003db0af0fc service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Updated VIF entry in instance network info cache for port ca4312d6-790c-49f6-b6e5-dc3033d0d93f. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:39:18 user nova-compute[73484]: DEBUG nova.network.neutron [req-43db65b3-5fad-403d-bdfa-2a297b705b38 req-57e8e50c-621b-47cd-a706-e003db0af0fc service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Updating instance_info_cache with network_info: [{"id": "2eb5bc00-16a1-43cd-ac1f-db1d191fba75", "address": "fa:16:3e:a3:34:4e", "network": {"id": "06967e28-4529-4bb4-913e-406da0cbf817", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-360793833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "900fe242d672495d832feee598acf991", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb5bc00-16", "ovs_interfaceid": "2eb5bc00-16a1-43cd-ac1f-db1d191fba75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca4312d6-790c-49f6-b6e5-dc3033d0d93f", "address": "fa:16:3e:25:ae:d6", "network": {"id": "710aecff-babe-436a-97ee-fdb206a5a73b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1050503830", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "900fe242d672495d832feee598acf991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4312d6-79", "ovs_interfaceid": "ca4312d6-790c-49f6-b6e5-dc3033d0d93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:39:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-aa2b8985-270a-4dda-8ce2-c1053db817f4 req-41799177-6e7a-439d-ab8c-621942d29f74 service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Received event network-vif-plugged-ca4312d6-790c-49f6-b6e5-dc3033d0d93f {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-aa2b8985-270a-4dda-8ce2-c1053db817f4 req-41799177-6e7a-439d-ab8c-621942d29f74 service nova] Acquiring lock "7348b004-4d46-4db5-a451-afd3b7476569-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-aa2b8985-270a-4dda-8ce2-c1053db817f4 req-41799177-6e7a-439d-ab8c-621942d29f74 service nova] Lock "7348b004-4d46-4db5-a451-afd3b7476569-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-aa2b8985-270a-4dda-8ce2-c1053db817f4 req-41799177-6e7a-439d-ab8c-621942d29f74 service nova] Lock "7348b004-4d46-4db5-a451-afd3b7476569-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-aa2b8985-270a-4dda-8ce2-c1053db817f4 req-41799177-6e7a-439d-ab8c-621942d29f74 service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] No waiting events found dispatching network-vif-plugged-ca4312d6-790c-49f6-b6e5-dc3033d0d93f {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:39:18 user nova-compute[73484]: WARNING nova.compute.manager [req-aa2b8985-270a-4dda-8ce2-c1053db817f4 req-41799177-6e7a-439d-ab8c-621942d29f74 service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Received unexpected event network-vif-plugged-ca4312d6-790c-49f6-b6e5-dc3033d0d93f for instance with vm_state active and task_state None.
Aug 14 13:39:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-43db65b3-5fad-403d-bdfa-2a297b705b38 req-57e8e50c-621b-47cd-a706-e003db0af0fc service nova] Releasing lock "refresh_cache-7348b004-4d46-4db5-a451-afd3b7476569" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:39:18 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-4d96bf2e-d5f0-4a12-9a37-51204229dcca tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:39:18 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-4d96bf2e-d5f0-4a12-9a37-51204229dcca tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] No BDM found with device name hda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:39:18 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-4d96bf2e-d5f0-4a12-9a37-51204229dcca tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] No VIF found with MAC fa:16:3e:a3:34:4e, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:39:18 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-4d96bf2e-d5f0-4a12-9a37-51204229dcca tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:39:18 user nova-compute[73484]:   <nova:package version="0.0.0"/>
Aug 14 13:39:18 user nova-compute[73484]:   <nova:name>tempest-device-tagging-server-522186817</nova:name>
Aug 14 13:39:18 user nova-compute[73484]:   <nova:creationTime>2023-08-14 13:39:18</nova:creationTime>
Aug 14 13:39:18 user nova-compute[73484]:   <nova:flavor name="m1.tiny">
Aug 14 13:39:18 user nova-compute[73484]:     <nova:memory>512</nova:memory>
Aug 14 13:39:18 user nova-compute[73484]:     <nova:disk>1</nova:disk>
Aug 14 13:39:18 user nova-compute[73484]:     <nova:swap>0</nova:swap>
Aug 14 13:39:18 user nova-compute[73484]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:39:18 user nova-compute[73484]:     <nova:vcpus>1</nova:vcpus>
Aug 14 13:39:18 user nova-compute[73484]:   </nova:flavor>
Aug 14 13:39:18 user nova-compute[73484]:   <nova:owner>
Aug 14 13:39:18 user nova-compute[73484]:     <nova:user uuid="602233ac777c42ac8f97536c706d5fd8">tempest-TaggedAttachmentsTest-696464863-project-member</nova:user>
Aug 14 13:39:18 user nova-compute[73484]:     <nova:project uuid="900fe242d672495d832feee598acf991">tempest-TaggedAttachmentsTest-696464863</nova:project>
Aug 14 13:39:18 user nova-compute[73484]:   </nova:owner>
Aug 14 13:39:18 user nova-compute[73484]:   <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:39:18 user nova-compute[73484]:   <nova:ports>
Aug 14 13:39:18 user nova-compute[73484]:     <nova:port uuid="2eb5bc00-16a1-43cd-ac1f-db1d191fba75">
Aug 14 13:39:18 user nova-compute[73484]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 13:39:18 user nova-compute[73484]:     </nova:port>
Aug 14 13:39:18 user nova-compute[73484]:     <nova:port uuid="ca4312d6-790c-49f6-b6e5-dc3033d0d93f">
Aug 14 13:39:18 user nova-compute[73484]:       <nova:ip type="fixed" address="10.10.10.205" ipVersion="4"/>
Aug 14 13:39:18 user nova-compute[73484]:     </nova:port>
Aug 14 13:39:18 user nova-compute[73484]:   </nova:ports>
Aug 14 13:39:18 user nova-compute[73484]: </nova:instance>
Aug 14 13:39:18 user nova-compute[73484]:  {{(pid=73484) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 14 13:39:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-4d96bf2e-d5f0-4a12-9a37-51204229dcca tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "interface-7348b004-4d46-4db5-a451-afd3b7476569-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.886s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:18 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:39:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VAsPtOQj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:39:18 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:39:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:39:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:39:18 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:39:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:39:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:39:18 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[17de3c8c-aa2a-4448-b37e-c72036161f41]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:39:19 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b1391d-7c42-4cb6-be57-61c292e709c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae] added
Aug 14 13:39:19 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e040e717-58ab-45b4-ab00-e253d5db2b4f]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1df9e1e-57f8-42e1-bb23-5c2eb8edd547]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VAsPtOQj {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VAsPtOQj" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ccc50f-eaad-4cb6-9720-fee0f5e6bf99]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VAsPtOQj'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7027929d-a1da-40c9-a0a7-4e339921c2b3]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f61df2-8ae9-4470-bcb7-90a792be8af6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:39:19 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:19 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:19 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:19 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:19 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:39:19 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:19 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:19 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:19 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:19 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3696917-1d4a-4b7c-ae3c-178d500b3331]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae, portal: 172.16.0.220,3260]
Aug 14 13:39:19 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae, portal: 172.16.0.220,3260] successful.
Aug 14 13:39:19 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Acquiring lock "7348b004-4d46-4db5-a451-afd3b7476569" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "7348b004-4d46-4db5-a451-afd3b7476569" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG nova.objects.instance [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lazy-loading 'flavor' on Instance uuid 7348b004-4d46-4db5-a451-afd3b7476569 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c519543-f7b7-459b-a25d-a1602ad9216e]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG os_brick.utils [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b68ab2-1128-4427-9724-212302783084]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "7348b004-4d46-4db5-a451-afd3b7476569" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adf8d85-cdd1-4430-a026-553e3f9c67cd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:39:19 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:19 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:19 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:19 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:19 user nova-compute[73484]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae (non-flash)
Aug 14 13:39:19 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:39:19 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:19 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:19 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:19 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:19 user nova-compute[73484]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae (non-flash)
Aug 14 13:39:19 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c559d80-6ac6-4b14-8caa-682fc3f1313d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[92df53fc-2ff0-4cf0-be04-9fa170baf255]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VAsPtOQj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f856dd-3734-4775-9e22-b4326df780fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e716a571-ac54-4cf1-82e0-1112b63b21a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:39:19 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e15a801-132d-40fb-9440-13246a41d8a9]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG os_brick.utils [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Updating existing volume attachment record: 931b0703-a298-44c2-b57e-8f7b05b30fb4 {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Acquiring lock "7348b004-4d46-4db5-a451-afd3b7476569" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "7348b004-4d46-4db5-a451-afd3b7476569" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:19 user nova-compute[73484]: INFO nova.compute.manager [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Attaching volume 75981986-1084-4221-83c9-4bf4503267d7 to /dev/vdb
Aug 14 13:39:19 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692020344.7256007, 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:39:19 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] VM Stopped (Lifecycle Event)
Aug 14 13:39:19 user nova-compute[73484]: DEBUG nova.compute.manager [None req-38eea967-eed4-4981-a927-110929b1b4b4 None None] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:39:19 user nova-compute[73484]: DEBUG nova.compute.manager [None req-38eea967-eed4-4981-a927-110929b1b4b4 None None] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG nova.compute.manager [req-5ade8197-1c4b-4c96-8564-d61e08375bf0 req-1be9f899-9834-4c18-b04b-ee2585007d38 service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Received event network-vif-plugged-ca4312d6-790c-49f6-b6e5-dc3033d0d93f {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5ade8197-1c4b-4c96-8564-d61e08375bf0 req-1be9f899-9834-4c18-b04b-ee2585007d38 service nova] Acquiring lock "7348b004-4d46-4db5-a451-afd3b7476569-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5ade8197-1c4b-4c96-8564-d61e08375bf0 req-1be9f899-9834-4c18-b04b-ee2585007d38 service nova] Lock "7348b004-4d46-4db5-a451-afd3b7476569-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5ade8197-1c4b-4c96-8564-d61e08375bf0 req-1be9f899-9834-4c18-b04b-ee2585007d38 service nova] Lock "7348b004-4d46-4db5-a451-afd3b7476569-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG nova.compute.manager [req-5ade8197-1c4b-4c96-8564-d61e08375bf0 req-1be9f899-9834-4c18-b04b-ee2585007d38 service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] No waiting events found dispatching network-vif-plugged-ca4312d6-790c-49f6-b6e5-dc3033d0d93f {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:39:20 user nova-compute[73484]: WARNING nova.compute.manager [req-5ade8197-1c4b-4c96-8564-d61e08375bf0 req-1be9f899-9834-4c18-b04b-ee2585007d38 service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Received unexpected event network-vif-plugged-ca4312d6-790c-49f6-b6e5-dc3033d0d93f for instance with vm_state active and task_state None.
Aug 14 13:39:20 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26136316265623738', 'path': '/dev/sdg'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136316265623738', 'path': '/dev/sdg'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG nova.objects.instance [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lazy-loading 'flavor' on Instance uuid b889688d-13dd-4f7b-bfef-26dc5347fd6e {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 13:39:20 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:39:20 user nova-compute[73484]:   <source dev="/dev/sdg"/>
Aug 14 13:39:20 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:39:20 user nova-compute[73484]:   <serial>49e82429-76fe-4e04-a353-1bbf0b75a1ae</serial>
Aug 14 13:39:20 user nova-compute[73484]: </disk>
Aug 14 13:39:20 user nova-compute[73484]:  {{(pid=73484) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] No VIF found with MAC fa:16:3e:7d:02:29, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YSFuXioQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:39:20 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:39:20 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:39:20 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:39:20 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:39:20 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:39:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7239dc52-3b3a-445a-a662-1ecf4f993c30]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:39:20 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85c712a-986c-467b-ac86-aa5427d23799]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676] added
Aug 14 13:39:20 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbabed7-7a3c-408a-af0f-9834e28fed2b]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e72d56c-e9be-497b-aa0a-99d612a4aae6]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YSFuXioQ {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YSFuXioQ" returned: 0 in 0.034s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9965a754-2044-4638-b20f-a90b048f45d8]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YSFuXioQ'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3803e026-7d27-41ed-b22b-8d5f2fe57027]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64b0bae-f570-4995-b642-7fdd5e54fba9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:39:21 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:21 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:21 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:21 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:21 user nova-compute[73484]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae (non-flash)
Aug 14 13:39:21 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:39:21 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:21 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:21 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:21 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:21 user nova-compute[73484]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae (non-flash)
Aug 14 13:39:21 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a254da0-c08d-44fa-9c9c-dd55a67b7d32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676, portal: 172.16.0.220,3260]
Aug 14 13:39:21 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676, portal: 172.16.0.220,3260] successful.
Aug 14 13:39:21 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[649ac92e-6fb5-4cae-9e30-ef6e1ae86560]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6339d5-abb0-45ed-8c48-819a14cd7fb7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:39:21 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:21 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:21 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:21 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:21 user nova-compute[73484]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae (non-flash)
Aug 14 13:39:21 user nova-compute[73484]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 (non-flash)
Aug 14 13:39:21 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:39:21 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:21 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:21 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:21 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:21 user nova-compute[73484]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae (non-flash)
Aug 14 13:39:21 user nova-compute[73484]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 (non-flash)
Aug 14 13:39:21 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-01be91ea-1b75-4e43-b298-04466e56d954 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "b889688d-13dd-4f7b-bfef-26dc5347fd6e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.232s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a282d3-0d59-4f72-a0e9-a7e42d9b9f6b]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YSFuXioQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG os_brick.utils [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa56b23a-105b-4f67-adb1-b236d5dd2e6d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd029661-69c7-4f4d-aaa0-34f71299da57]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bdc99b-2309-40d3-86e4-d4b2f47ef0dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06a762b-cad4-4664-a044-5190808b3b3d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:39:21 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:39:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bed854-11f0-4270-a0c9-d811cc51ca3e]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG os_brick.utils [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:39:21 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Updating existing volume attachment record: a78380db-c6e8-420c-a77c-a9752f3a440f {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:39:22 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:39:22 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23339643463323038', 'path': '/dev/sdh'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:39:22 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339643463323038', 'path': '/dev/sdh'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:39:22 user nova-compute[73484]: DEBUG nova.objects.instance [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Lazy-loading 'flavor' on Instance uuid 377257a6-916e-4269-bc53-a81d8bed6bdb {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:39:22 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] attach device xml: <disk type="block" device="disk">
Aug 14 13:39:22 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:39:22 user nova-compute[73484]:   <source dev="/dev/sdh"/>
Aug 14 13:39:22 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:39:22 user nova-compute[73484]:   <serial>427d4d6d-5b8b-468b-8424-602e15790676</serial>
Aug 14 13:39:22 user nova-compute[73484]: </disk>
Aug 14 13:39:22 user nova-compute[73484]:  {{(pid=73484) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 13:39:22 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:22 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:39:22 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:39:22 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] No VIF found with MAC fa:16:3e:3e:15:05, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:39:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:26 user nova-compute[73484]: DEBUG nova.compute.manager [req-8b01a370-13c2-458f-9ac0-aa5b269d7541 req-5186899b-a0c5-4a2e-95da-681d4154fadb service nova] [instance: eaaccbea-d453-4943-9663-949c66029d87] Received event network-changed-244b7f94-a32e-4724-858e-ae9be93a8003 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:26 user nova-compute[73484]: DEBUG nova.compute.manager [req-8b01a370-13c2-458f-9ac0-aa5b269d7541 req-5186899b-a0c5-4a2e-95da-681d4154fadb service nova] [instance: eaaccbea-d453-4943-9663-949c66029d87] Refreshing instance network info cache due to event network-changed-244b7f94-a32e-4724-858e-ae9be93a8003. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:39:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8b01a370-13c2-458f-9ac0-aa5b269d7541 req-5186899b-a0c5-4a2e-95da-681d4154fadb service nova] Acquiring lock "refresh_cache-eaaccbea-d453-4943-9663-949c66029d87" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:39:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8b01a370-13c2-458f-9ac0-aa5b269d7541 req-5186899b-a0c5-4a2e-95da-681d4154fadb service nova] Acquired lock "refresh_cache-eaaccbea-d453-4943-9663-949c66029d87" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:39:26 user nova-compute[73484]: DEBUG nova.network.neutron [req-8b01a370-13c2-458f-9ac0-aa5b269d7541 req-5186899b-a0c5-4a2e-95da-681d4154fadb service nova] [instance: eaaccbea-d453-4943-9663-949c66029d87] Refreshing network info cache for port 244b7f94-a32e-4724-858e-ae9be93a8003 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:39:27 user nova-compute[73484]: DEBUG nova.network.neutron [req-8b01a370-13c2-458f-9ac0-aa5b269d7541 req-5186899b-a0c5-4a2e-95da-681d4154fadb service nova] [instance: eaaccbea-d453-4943-9663-949c66029d87] Updated VIF entry in instance network info cache for port 244b7f94-a32e-4724-858e-ae9be93a8003. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:39:27 user nova-compute[73484]: DEBUG nova.network.neutron [req-8b01a370-13c2-458f-9ac0-aa5b269d7541 req-5186899b-a0c5-4a2e-95da-681d4154fadb service nova] [instance: eaaccbea-d453-4943-9663-949c66029d87] Updating instance_info_cache with network_info: [{"id": "244b7f94-a32e-4724-858e-ae9be93a8003", "address": "fa:16:3e:4e:e1:a7", "network": {"id": "6480ad45-783a-4c79-adac-e661111d3cc8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1304007088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01c04593677842fc9bed43bb42776176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244b7f94-a3", "ovs_interfaceid": "244b7f94-a32e-4724-858e-ae9be93a8003", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:39:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8b01a370-13c2-458f-9ac0-aa5b269d7541 req-5186899b-a0c5-4a2e-95da-681d4154fadb service nova] Releasing lock "refresh_cache-eaaccbea-d453-4943-9663-949c66029d87" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:39:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:28 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'matSGeRK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:39:29 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:39:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:39:29 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:39:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:39:29 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6726375-d3ac-4080-b169-33e27831bfeb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:39:29 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fcf0ef-a3cd-42f4-8224-4d51a9e6fda3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e] added
Aug 14 13:39:29 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8a496e-b999-4a5a-8a97-d4401c3b4512]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[da33cb48-1600-46b0-84c9-cda66679fca4]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v matSGeRK {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v matSGeRK" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c153ccc5-edf2-4587-8b3e-82f1dc8e73d2]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'matSGeRK'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[156df542-c014-49a0-aa3c-90387b873ca5]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0083e20-eee8-4e7f-b2a7-66d2b6980c4a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:39:29 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:29 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:29 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:29 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:29 user nova-compute[73484]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae (non-flash)
Aug 14 13:39:29 user nova-compute[73484]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 (non-flash)
Aug 14 13:39:29 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:39:29 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:29 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:29 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:29 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:29 user nova-compute[73484]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae (non-flash)
Aug 14 13:39:29 user nova-compute[73484]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 (non-flash)
Aug 14 13:39:29 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jlILvGNM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:39:29 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:39:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbb5431-b44d-42a7-b5d2-0a3f9d45840d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e, portal: 172.16.0.220,3260]
Aug 14 13:39:29 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e, portal: 172.16.0.220,3260] successful.
Aug 14 13:39:29 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6098d785-4034-4382-9b8a-d1a57f764fef tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Lock "377257a6-916e-4269-bc53-a81d8bed6bdb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.269s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[059d8ca6-d902-47b6-9416-ee0f2e25405d]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[381ccf2c-09a6-4545-ba6e-6ba272419998]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:39:29 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:29 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:29 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:29 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:29 user nova-compute[73484]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae (non-flash)
Aug 14 13:39:29 user nova-compute[73484]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 (non-flash)
Aug 14 13:39:29 user nova-compute[73484]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:39:29 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:39:29 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:29 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:29 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:29 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:29 user nova-compute[73484]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae (non-flash)
Aug 14 13:39:29 user nova-compute[73484]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 (non-flash)
Aug 14 13:39:29 user nova-compute[73484]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:39:29 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac291bd-8427-4972-b48c-f7c62268c762]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:29 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: None {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:39:30 user nova-compute[73484]: INFO nova.compute.manager [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Rebuilding instance
Aug 14 13:39:30 user nova-compute[73484]: DEBUG nova.objects.instance [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lazy-loading 'trusted_certs' on Instance uuid eaaccbea-d453-4943-9663-949c66029d87 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG nova.compute.manager [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG nova.objects.instance [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lazy-loading 'pci_requests' on Instance uuid eaaccbea-d453-4943-9663-949c66029d87 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Acquiring lock "b889688d-13dd-4f7b-bfef-26dc5347fd6e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "b889688d-13dd-4f7b-bfef-26dc5347fd6e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG nova.objects.instance [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lazy-loading 'pci_devices' on Instance uuid eaaccbea-d453-4943-9663-949c66029d87 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:39:30 user nova-compute[73484]: INFO nova.compute.manager [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Detaching volume 49e82429-76fe-4e04-a353-1bbf0b75a1ae
Aug 14 13:39:30 user nova-compute[73484]: DEBUG nova.objects.instance [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lazy-loading 'resources' on Instance uuid eaaccbea-d453-4943-9663-949c66029d87 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG nova.objects.instance [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lazy-loading 'migration_context' on Instance uuid eaaccbea-d453-4943-9663-949c66029d87 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG nova.objects.instance [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73484) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 14 13:39:30 user nova-compute[73484]: INFO nova.virt.block_device [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Attempting to driver detach volume 49e82429-76fe-4e04-a353-1bbf0b75a1ae from mountpoint /dev/vdb
Aug 14 13:39:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Attempting to detach device vdb from instance b889688d-13dd-4f7b-bfef-26dc5347fd6e from the persistent domain config. {{(pid=73484) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:39:30 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:39:30 user nova-compute[73484]:   <source dev="/dev/sdg"/>
Aug 14 13:39:30 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:39:30 user nova-compute[73484]:   <serial>49e82429-76fe-4e04-a353-1bbf0b75a1ae</serial>
Aug 14 13:39:30 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 13:39:30 user nova-compute[73484]: </disk>
Aug 14 13:39:30 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:39:30 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Successfully detached device vdb from instance b889688d-13dd-4f7b-bfef-26dc5347fd6e from the persistent domain config.
Aug 14 13:39:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b889688d-13dd-4f7b-bfef-26dc5347fd6e from the live domain config. {{(pid=73484) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:39:30 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:39:30 user nova-compute[73484]:   <source dev="/dev/sdg"/>
Aug 14 13:39:30 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:39:30 user nova-compute[73484]:   <serial>49e82429-76fe-4e04-a353-1bbf0b75a1ae</serial>
Aug 14 13:39:30 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 13:39:30 user nova-compute[73484]: </disk>
Aug 14 13:39:30 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'matSGeRK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23837663562373765', 'path': '/dev/sdi'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837663562373765', 'path': '/dev/sdi'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.189s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:39:30 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:39:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:39:30 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:39:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-09a95dc3-f6f4-464d-8eab-b1dd177efde6 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] volume_snapshot_create: create_info: {'snapshot_id': '75981a19-aca0-428c-b6fd-e98908cf3c29', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73484) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG nova.objects.instance [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lazy-loading 'flavor' on Instance uuid 7ac05f68-a20f-4a57-b990-ef0799aadc58 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-09a95dc3-f6f4-464d-8eab-b1dd177efde6 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] snap xml: <domainsnapshot>
Aug 14 13:39:30 user nova-compute[73484]:   <disks>
Aug 14 13:39:30 user nova-compute[73484]:     <disk name="/dev/sdh" snapshot="external" type="file">
Aug 14 13:39:30 user nova-compute[73484]:       <source file="/dev/new_file"/>
Aug 14 13:39:30 user nova-compute[73484]:     </disk>
Aug 14 13:39:30 user nova-compute[73484]:     <disk name="vda" snapshot="no"/>
Aug 14 13:39:30 user nova-compute[73484]:   </disks>
Aug 14 13:39:30 user nova-compute[73484]: </domainsnapshot>
Aug 14 13:39:30 user nova-compute[73484]:  {{(pid=73484) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG nova.objects.instance [None req-09a95dc3-f6f4-464d-8eab-b1dd177efde6 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Lazy-loading 'system_metadata' on Instance uuid 377257a6-916e-4269-bc53-a81d8bed6bdb {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d12228a-1281-4c4f-b51f-07f7d19b1cd7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:39:30 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 13:39:30 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:39:30 user nova-compute[73484]:   <source dev="/dev/sdi"/>
Aug 14 13:39:30 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:39:30 user nova-compute[73484]:   <serial>b74c54bf-81bc-4b2a-9dc3-c7186d64df0e</serial>
Aug 14 13:39:30 user nova-compute[73484]: </disk>
Aug 14 13:39:30 user nova-compute[73484]:  {{(pid=73484) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c85ed3-fbf5-4950-be99-126960325e46]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d] added
Aug 14 13:39:30 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:30 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-09a95dc3-f6f4-464d-8eab-b1dd177efde6 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 13:39:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[606c33a6-a9bb-44a3-95ba-c046a97d8d59]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [None req-09a95dc3-f6f4-464d-8eab-b1dd177efde6 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Traceback (most recent call last):
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]     rv = execute(f, *args, **kwargs)
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]     six.reraise(c, e, tb)
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]     raise value
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]     rv = meth(*args, **kwargs)
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] 
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [None req-09a95dc3-f6f4-464d-8eab-b1dd177efde6 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Traceback (most recent call last):
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]     self._volume_snapshot_create(context, instance, guest,
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]     rv = execute(f, *args, **kwargs)
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]     six.reraise(c, e, tb)
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]     raise value
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]     rv = meth(*args, **kwargs)
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] 
Aug 14 13:39:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[65760cc7-04f2-42a0-9de1-ecedd0705403]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-679d9d4c-b1a5-46f0-bebe-c776617a03db tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] volume_snapshot_delete: delete_info: {'volume_id': '427d4d6d-5b8b-468b-8424-602e15790676'} {{(pid=73484) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [None req-679d9d4c-b1a5-46f0-bebe-c776617a03db tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Traceback (most recent call last):
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb]     if delete_info['type'] != 'qcow2':
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] KeyError: 'type'
Aug 14 13:39:30 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] 
Aug 14 13:39:30 user nova-compute[73484]: DEBUG nova.compute.manager [req-5b737a62-c0af-4315-aa11-a8ffe4a84202 req-41be4fd6-a491-44e6-82fe-d74ae29de100 service nova] [instance: eaaccbea-d453-4943-9663-949c66029d87] Received event network-vif-unplugged-244b7f94-a32e-4724-858e-ae9be93a8003 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5b737a62-c0af-4315-aa11-a8ffe4a84202 req-41be4fd6-a491-44e6-82fe-d74ae29de100 service nova] Acquiring lock "eaaccbea-d453-4943-9663-949c66029d87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5b737a62-c0af-4315-aa11-a8ffe4a84202 req-41be4fd6-a491-44e6-82fe-d74ae29de100 service nova] Lock "eaaccbea-d453-4943-9663-949c66029d87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5b737a62-c0af-4315-aa11-a8ffe4a84202 req-41be4fd6-a491-44e6-82fe-d74ae29de100 service nova] Lock "eaaccbea-d453-4943-9663-949c66029d87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG nova.compute.manager [req-5b737a62-c0af-4315-aa11-a8ffe4a84202 req-41be4fd6-a491-44e6-82fe-d74ae29de100 service nova] [instance: eaaccbea-d453-4943-9663-949c66029d87] No waiting events found dispatching network-vif-unplugged-244b7f94-a32e-4724-858e-ae9be93a8003 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:39:30 user nova-compute[73484]: WARNING nova.compute.manager [req-5b737a62-c0af-4315-aa11-a8ffe4a84202 req-41be4fd6-a491-44e6-82fe-d74ae29de100 service nova] [instance: eaaccbea-d453-4943-9663-949c66029d87] Received unexpected event network-vif-unplugged-244b7f94-a32e-4724-858e-ae9be93a8003 for instance with vm_state active and task_state rebuilding.
Aug 14 13:39:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jlILvGNM {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jlILvGNM" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[42adafc2-f5a4-41f5-87b6-b1866d1a7c38]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jlILvGNM'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [None req-09a95dc3-f6f4-464d-8eab-b1dd177efde6 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 75981a19-aca0-428c-b6fd-e98908cf3c29 could not be found.
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     raise value
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver 
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver 
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 75981a19-aca0-428c-b6fd-e98908cf3c29 could not be found. (HTTP 404) (Request-ID: req-d0efb8cf-399d-49fd-ad02-bd6fe2b4d0fb)
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver 
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver 
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 75981a19-aca0-428c-b6fd-e98908cf3c29 could not be found.
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver 
Aug 14 13:39:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver [None req-679d9d4c-b1a5-46f0-bebe-c776617a03db tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver 
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver 
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-3f9373a8-f689-4c52-a507-d6276d0762e7)
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver 
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver 
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 14 13:39:31 user nova-compute[73484]: ERROR nova.virt.libvirt.driver 
Aug 14 13:39:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0fa667-eba4-4fcc-b96b-b1397e5edb11]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server [None req-09a95dc3-f6f4-464d-8eab-b1dd177efde6 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     raise value
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server 
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server [None req-679d9d4c-b1a5-46f0-bebe-c776617a03db tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Exception during message handling: KeyError: 'type'
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 14 13:39:31 user nova-compute[73484]: ERROR oslo_messaging.rpc.server 
Aug 14 13:39:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[45016c9c-cd20-4dbb-bf49-8498acef97e1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:39:31 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:31 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:31 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:31 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:31 user nova-compute[73484]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae (non-flash)
Aug 14 13:39:31 user nova-compute[73484]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 (non-flash)
Aug 14 13:39:31 user nova-compute[73484]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:39:31 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:39:31 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:31 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:31 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:31 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:31 user nova-compute[73484]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae (non-flash)
Aug 14 13:39:31 user nova-compute[73484]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 (non-flash)
Aug 14 13:39:31 user nova-compute[73484]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:39:31 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ec7c32-964a-4de6-a005-f42b3f7e240b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d, portal: 172.16.0.220,3260]
Aug 14 13:39:31 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d, portal: 172.16.0.220,3260] successful.
Aug 14 13:39:31 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec05d0b-ba56-4336-81b8-82653aa2ced9]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Received event <DeviceRemovedEvent: 1692020371.226964, b889688d-13dd-4f7b-bfef-26dc5347fd6e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73484) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b889688d-13dd-4f7b-bfef-26dc5347fd6e {{(pid=73484) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 13:39:31 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Successfully detached device vdb from instance b889688d-13dd-4f7b-bfef-26dc5347fd6e from the live domain config.
Aug 14 13:39:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VAsPtOQj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:39:31 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:39:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f5ce28-35f9-403f-a858-b2e5eb3093c3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d (non-flash)
Aug 14 13:39:31 user nova-compute[73484]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:39:31 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:31 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:31 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:31 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:31 user nova-compute[73484]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae (non-flash)
Aug 14 13:39:31 user nova-compute[73484]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 (non-flash)
Aug 14 13:39:31 user nova-compute[73484]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:39:31 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d (non-flash)
Aug 14 13:39:31 user nova-compute[73484]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:39:31 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:31 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:31 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:31 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:31 user nova-compute[73484]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae (non-flash)
Aug 14 13:39:31 user nova-compute[73484]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 (non-flash)
Aug 14 13:39:31 user nova-compute[73484]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:39:31 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.425s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1329e3b1-edbc-42a4-8356-f377bdd3516b]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jlILvGNM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Acquiring lock "377257a6-916e-4269-bc53-a81d8bed6bdb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Lock "377257a6-916e-4269-bc53-a81d8bed6bdb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:31 user nova-compute[73484]: INFO nova.compute.manager [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Detaching volume 427d4d6d-5b8b-468b-8424-602e15790676
Aug 14 13:39:31 user nova-compute[73484]: INFO nova.virt.block_device [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Attempting to driver detach volume 427d4d6d-5b8b-468b-8424-602e15790676 from mountpoint /dev/vdb
Aug 14 13:39:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Attempting to detach device vdb from instance 377257a6-916e-4269-bc53-a81d8bed6bdb from the persistent domain config. {{(pid=73484) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] detach device xml: <disk type="block" device="disk">
Aug 14 13:39:31 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:39:31 user nova-compute[73484]:   <source dev="/dev/sdh"/>
Aug 14 13:39:31 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:39:31 user nova-compute[73484]:   <serial>427d4d6d-5b8b-468b-8424-602e15790676</serial>
Aug 14 13:39:31 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 13:39:31 user nova-compute[73484]: </disk>
Aug 14 13:39:31 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:39:31 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Successfully detached device vdb from instance 377257a6-916e-4269-bc53-a81d8bed6bdb from the persistent domain config.
Aug 14 13:39:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 377257a6-916e-4269-bc53-a81d8bed6bdb from the live domain config. {{(pid=73484) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] detach device xml: <disk type="block" device="disk">
Aug 14 13:39:31 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:39:31 user nova-compute[73484]:   <source dev="/dev/sdh"/>
Aug 14 13:39:31 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:39:31 user nova-compute[73484]:   <serial>427d4d6d-5b8b-468b-8424-602e15790676</serial>
Aug 14 13:39:31 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 13:39:31 user nova-compute[73484]: </disk>
Aug 14 13:39:31 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YMRCeZba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:39:31 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:39:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-07bac569-8b2c-4555-b4d5-a74f7384630b" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-07bac569-8b2c-4555-b4d5-a74f7384630b" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:39:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] No VIF found with MAC fa:16:3e:6e:d0:0c, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d7482d90-9d29-4da5-bdc9-3afd0f06890b tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lock "7ac05f68-a20f-4a57-b990-ef0799aadc58" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.250s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Received event <DeviceRemovedEvent: 1692020372.1690068, 377257a6-916e-4269-bc53-a81d8bed6bdb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73484) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 377257a6-916e-4269-bc53-a81d8bed6bdb {{(pid=73484) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 13:39:32 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Successfully detached device vdb from instance 377257a6-916e-4269-bc53-a81d8bed6bdb from the live domain config.
Aug 14 13:39:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YSFuXioQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:39:32 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:39:32 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: eaaccbea-d453-4943-9663-949c66029d87] Instance destroyed successfully.
Aug 14 13:39:32 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: eaaccbea-d453-4943-9663-949c66029d87] Instance destroyed successfully.
Aug 14 13:39:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:37:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-234172834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-412988099',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFj55/WSoxVS+Xy6UzME66O9FkMNrLin49xsiiA9z2iZT/1AKyfBBvPmClJSW2lvgg3Efp7L3zaMlvT135pSEqSZY+yrqXu3bGJndgNG3BKvJ92BRB7yHbpzJf2DGwaP3Q==',key_name='tempest-keypair-1536016686',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:37:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='01c04593677842fc9bed43bb42776176',ramdisk_id='',reservation_id='r-cew2mp2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-38074168',owner_user_name='tempest-ServerActionsV293TestJSON-38074168-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:39:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f609a87c04f40b68af1b78f8503c45c',uuid=eaaccbea-d453-4943-9663-949c66029d87,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "244b7f94-a32e-4724-858e-ae9be93a8003", "address": "fa:16:3e:4e:e1:a7", "network": {"id": "6480ad45-783a-4c79-adac-e661111d3cc8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1304007088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01c04593677842fc9bed43bb42776176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244b7f94-a3", "ovs_interfaceid": "244b7f94-a32e-4724-858e-ae9be93a8003", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Converting VIF {"id": "244b7f94-a32e-4724-858e-ae9be93a8003", "address": "fa:16:3e:4e:e1:a7", "network": {"id": "6480ad45-783a-4c79-adac-e661111d3cc8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1304007088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01c04593677842fc9bed43bb42776176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244b7f94-a3", "ovs_interfaceid": "244b7f94-a32e-4724-858e-ae9be93a8003", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:e1:a7,bridge_name='br-int',has_traffic_filtering=True,id=244b7f94-a32e-4724-858e-ae9be93a8003,network=Network(6480ad45-783a-4c79-adac-e661111d3cc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244b7f94-a3') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_vif [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:e1:a7,bridge_name='br-int',has_traffic_filtering=True,id=244b7f94-a32e-4724-858e-ae9be93a8003,network=Network(6480ad45-783a-4c79-adac-e661111d3cc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244b7f94-a3') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap244b7f94-a3, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:32 user nova-compute[73484]: INFO os_vif [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:e1:a7,bridge_name='br-int',has_traffic_filtering=True,id=244b7f94-a32e-4724-858e-ae9be93a8003,network=Network(6480ad45-783a-4c79-adac-e661111d3cc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244b7f94-a3')
Aug 14 13:39:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NlzXhUZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:39:32 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.466s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] <== connect_volume: return (2655ms) {'type': 'block', 'scsi_wwn': '23330353965316436', 'path': '/dev/sdj'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330353965316436', 'path': '/dev/sdj'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.045s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG nova.objects.instance [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lazy-loading 'flavor' on Instance uuid 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[496b7315-3182-4206-81bb-6c450afada63]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 13:39:32 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:39:32 user nova-compute[73484]:   <source dev="/dev/sdj"/>
Aug 14 13:39:32 user nova-compute[73484]:   <target dev="sdc" bus="scsi"/>
Aug 14 13:39:32 user nova-compute[73484]:   <serial>45599018-8480-4b94-a396-e74b5832ee9d</serial>
Aug 14 13:39:32 user nova-compute[73484]:   <address type="drive" controller="0" unit="2"/>
Aug 14 13:39:32 user nova-compute[73484]: </disk>
Aug 14 13:39:32 user nova-compute[73484]:  {{(pid=73484) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9e2505-1c34-4e16-998d-2952d012c3ae]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d (non-flash)
Aug 14 13:39:32 user nova-compute[73484]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:39:32 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:32 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:32 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:32 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:32 user nova-compute[73484]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae (non-flash)
Aug 14 13:39:32 user nova-compute[73484]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 (non-flash)
Aug 14 13:39:32 user nova-compute[73484]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:39:32 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d (non-flash)
Aug 14 13:39:32 user nova-compute[73484]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:39:32 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:32 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:32 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:32 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:32 user nova-compute[73484]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae (non-flash)
Aug 14 13:39:32 user nova-compute[73484]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 (non-flash)
Aug 14 13:39:32 user nova-compute[73484]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:39:32 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4786b44c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae'): ({'sdg'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Removing single pathed devices sdg {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7674338-d47f-41d3-81c1-c465dfbe6304]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6374e3d-c73a-45a7-8ec9-821965874b43]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Flushing IO for device /dev/sdg {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c098909-7bfa-43d4-8dcb-f7bcb00127fa]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.051s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30057c2-3074-480b-b882-e35ef212f964]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] SCSI volumes sdg have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec225b3-e310-4b97-9113-372f5c04f0e1]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccaae29b-9a11-4590-817b-78854662f72a]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae, portal: 172.16.0.220,3260]
Aug 14 13:39:32 user nova-compute[73484]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae, portal: 172.16.0.220,3260] successful.
Aug 14 13:39:32 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49e82429-76fe-4e04-a353-1bbf0b75a1ae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[486d824c-f82d-4361-b346-1d0d0e093847]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] <== disconnect_volume: return (1409ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Updating instance_info_cache with network_info: [{"id": "cb7f3901-875e-489a-87f8-5642b9fded9c", "address": "fa:16:3e:6c:13:9e", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7f3901-87", "ovs_interfaceid": "cb7f3901-875e-489a-87f8-5642b9fded9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.824s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:39:32 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:39:32 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-07bac569-8b2c-4555-b4d5-a74f7384630b" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a787e561-3476-4944-b761-fadb05786e54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:39:32 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f865e68-108b-4f85-849f-3c844aae6e61]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7] added
Aug 14 13:39:32 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[303fc1c5-15df-403a-9c38-b4a7c6fb7a1b]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e59f87-603f-44ac-b2d6-5872796c8a3d]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YMRCeZba {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] No BDM found with device name sda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] No VIF found with MAC fa:16:3e:76:d0:d2, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YMRCeZba" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9428ac2f-f14e-4d22-b375-a54c5d0c7b8f]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YMRCeZba'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[46590421-c875-4499-94cc-115cc56732d2]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7507b5ba-2592-4586-a85d-233b3a440dc1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d (non-flash)
Aug 14 13:39:32 user nova-compute[73484]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:39:32 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:32 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:32 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:32 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:32 user nova-compute[73484]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 (non-flash)
Aug 14 13:39:32 user nova-compute[73484]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:39:32 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d (non-flash)
Aug 14 13:39:32 user nova-compute[73484]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:39:32 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:32 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:32 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:32 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:32 user nova-compute[73484]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 (non-flash)
Aug 14 13:39:32 user nova-compute[73484]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:39:32 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f22380bd-d482-48d4-990c-9ea046e5e631 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lock "96025e5d-7c98-4ed4-8180-7c2cdb1d65bf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.762s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[156a95a5-3a7d-4d98-af45-a5ddb80d9b39]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7, portal: 172.16.0.220,3260]
Aug 14 13:39:32 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7, portal: 172.16.0.220,3260] successful.
Aug 14 13:39:32 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[65673ad8-f903-4eb2-8517-ccb41257ca19]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG nova.compute.manager [req-f4087b28-f2cc-4aa2-b8f6-0f4e63411ef9 req-5e83e749-830d-44e3-aafc-c95aea20666f service nova] [instance: eaaccbea-d453-4943-9663-949c66029d87] Received event network-vif-plugged-244b7f94-a32e-4724-858e-ae9be93a8003 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f4087b28-f2cc-4aa2-b8f6-0f4e63411ef9 req-5e83e749-830d-44e3-aafc-c95aea20666f service nova] Acquiring lock "eaaccbea-d453-4943-9663-949c66029d87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f4087b28-f2cc-4aa2-b8f6-0f4e63411ef9 req-5e83e749-830d-44e3-aafc-c95aea20666f service nova] Lock "eaaccbea-d453-4943-9663-949c66029d87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f4087b28-f2cc-4aa2-b8f6-0f4e63411ef9 req-5e83e749-830d-44e3-aafc-c95aea20666f service nova] Lock "eaaccbea-d453-4943-9663-949c66029d87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG nova.compute.manager [req-f4087b28-f2cc-4aa2-b8f6-0f4e63411ef9 req-5e83e749-830d-44e3-aafc-c95aea20666f service nova] [instance: eaaccbea-d453-4943-9663-949c66029d87] No waiting events found dispatching network-vif-plugged-244b7f94-a32e-4724-858e-ae9be93a8003 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:39:33 user nova-compute[73484]: WARNING nova.compute.manager [req-f4087b28-f2cc-4aa2-b8f6-0f4e63411ef9 req-5e83e749-830d-44e3-aafc-c95aea20666f service nova] [instance: eaaccbea-d453-4943-9663-949c66029d87] Received unexpected event network-vif-plugged-244b7f94-a32e-4724-858e-ae9be93a8003 for instance with vm_state active and task_state rebuilding.
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8d9509-6c89-49d4-94e7-46f20be29397]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d (non-flash)
Aug 14 13:39:33 user nova-compute[73484]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 (non-flash)
Aug 14 13:39:33 user nova-compute[73484]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:39:33 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:33 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:33 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:33 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:33 user nova-compute[73484]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 (non-flash)
Aug 14 13:39:33 user nova-compute[73484]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:39:33 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d (non-flash)
Aug 14 13:39:33 user nova-compute[73484]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 (non-flash)
Aug 14 13:39:33 user nova-compute[73484]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:39:33 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:33 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:33 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:33 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:33 user nova-compute[73484]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 (non-flash)
Aug 14 13:39:33 user nova-compute[73484]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:39:33 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] HCTL ('38', '-', '-', 0) found on session 11 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ceb632-254e-453c-8595-8aed3f74cb8d]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Searching for a device in session 11 and hctl ['38', '*', '*', 0] yield: None {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Acquiring lock "96025e5d-7c98-4ed4-8180-7c2cdb1d65bf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lock "96025e5d-7c98-4ed4-8180-7c2cdb1d65bf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:33 user nova-compute[73484]: INFO nova.compute.manager [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Detaching volume 45599018-8480-4b94-a396-e74b5832ee9d
Aug 14 13:39:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG nova.objects.instance [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lazy-loading 'flavor' on Instance uuid b889688d-13dd-4f7b-bfef-26dc5347fd6e {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Acquiring lock "7ac05f68-a20f-4a57-b990-ef0799aadc58" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Lock "7ac05f68-a20f-4a57-b990-ef0799aadc58" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:33 user nova-compute[73484]: INFO nova.virt.block_device [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Attempting to driver detach volume 45599018-8480-4b94-a396-e74b5832ee9d from mountpoint /dev/sdc
Aug 14 13:39:33 user nova-compute[73484]: DEBUG os_brick.utils [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Attempting to detach device sdc from instance 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf from the persistent domain config. {{(pid=73484) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:39:33 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:39:33 user nova-compute[73484]:   <source dev="/dev/sdj"/>
Aug 14 13:39:33 user nova-compute[73484]:   <target dev="sdc" bus="scsi"/>
Aug 14 13:39:33 user nova-compute[73484]:   <serial>45599018-8480-4b94-a396-e74b5832ee9d</serial>
Aug 14 13:39:33 user nova-compute[73484]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 14 13:39:33 user nova-compute[73484]: </disk>
Aug 14 13:39:33 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-226a5f08-ad3f-42d6-80bb-c956901871f3 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "b889688d-13dd-4f7b-bfef-26dc5347fd6e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.950s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:33 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Successfully detached device sdc from instance 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf from the persistent domain config.
Aug 14 13:39:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf from the live domain config. {{(pid=73484) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:39:33 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:39:33 user nova-compute[73484]:   <source dev="/dev/sdj"/>
Aug 14 13:39:33 user nova-compute[73484]:   <target dev="sdc" bus="scsi"/>
Aug 14 13:39:33 user nova-compute[73484]:   <serial>45599018-8480-4b94-a396-e74b5832ee9d</serial>
Aug 14 13:39:33 user nova-compute[73484]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 14 13:39:33 user nova-compute[73484]: </disk>
Aug 14 13:39:33 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ee20d1-21da-4e08-8770-59b995506338]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad0345c-62f6-42bd-8e53-57fdb306a85e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c1830b-896d-4758-8e11-18f6518ca0cf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea525cb-814c-4b65-8bd4-79b9a0f0567f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:39:33 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d56529a-72ad-40c0-ac0b-d78028eb1f6a]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG os_brick.utils [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:39:33 user nova-compute[73484]: INFO nova.compute.manager [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Swapping volume b74c54bf-81bc-4b2a-9dc3-c7186d64df0e for 3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Received event <DeviceRemovedEvent: 1692020373.9173484, 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73484) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf {{(pid=73484) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 13:39:33 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Successfully detached device sdc from instance 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf from the live domain config.
Aug 14 13:39:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:39:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jlILvGNM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:39:33 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:39:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Searching for a device in session 11 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YMRCeZba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] <== connect_volume: return (2224ms) {'type': 'block', 'scsi_wwn': '23134376463663465', 'path': '/dev/sdg'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134376463663465', 'path': '/dev/sdg'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.880s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG nova.objects.instance [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lazy-loading 'flavor' on Instance uuid 7348b004-4d46-4db5-a451-afd3b7476569 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bc5b1b-2a4a-42f0-a5b7-6fd1ca18a89b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 13:39:34 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:39:34 user nova-compute[73484]:   <source dev="/dev/sdg"/>
Aug 14 13:39:34 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:39:34 user nova-compute[73484]:   <serial>75981986-1084-4221-83c9-4bf4503267d7</serial>
Aug 14 13:39:34 user nova-compute[73484]: </disk>
Aug 14 13:39:34 user nova-compute[73484]:  {{(pid=73484) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96025e5d-7c98-4ed4-8180-7c2cdb1d65bf/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8e38c7-2332-4352-8813-581f0a9b7621]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d (non-flash)
Aug 14 13:39:34 user nova-compute[73484]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 (non-flash)
Aug 14 13:39:34 user nova-compute[73484]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:39:34 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:34 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:34 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:34 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:34 user nova-compute[73484]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 (non-flash)
Aug 14 13:39:34 user nova-compute[73484]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:39:34 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d (non-flash)
Aug 14 13:39:34 user nova-compute[73484]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 (non-flash)
Aug 14 13:39:34 user nova-compute[73484]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:39:34 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:34 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:34 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:34 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:34 user nova-compute[73484]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 (non-flash)
Aug 14 13:39:34 user nova-compute[73484]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:39:34 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4951ca950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676'): ({'sdh'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Removing single pathed devices sdh {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdff14b-da79-4bf7-b84a-69869f0b380d]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a797d862-10b7-48ad-8728-9da05f466695]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Flushing IO for device /dev/sdh {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[71614547-0b62-400d-84c8-91e86483cac9]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.034s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b54209-c598-4baa-9b3f-34492ef66d97]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] SCSI volumes sdh have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96025e5d-7c98-4ed4-8180-7c2cdb1d65bf/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96025e5d-7c98-4ed4-8180-7c2cdb1d65bf/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ad8dae-82e5-4bf2-9549-b1ad5c473d00]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d24123-e701-48ff-83e1-b5571f56f1e6]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676, portal: 172.16.0.220,3260]
Aug 14 13:39:34 user nova-compute[73484]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676, portal: 172.16.0.220,3260] successful.
Aug 14 13:39:34 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:427d4d6d-5b8b-468b-8424-602e15790676 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e1b499-2a8e-41fa-827f-658e83a95a00]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] <== disconnect_volume: return (2267ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.229s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ecc28b-dee2-43b7-96b1-531ed8f3af97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96025e5d-7c98-4ed4-8180-7c2cdb1d65bf/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/377257a6-916e-4269-bc53-a81d8bed6bdb/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d36663-5a69-43e1-b0e6-e5752e713548]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d (non-flash)
Aug 14 13:39:34 user nova-compute[73484]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 (non-flash)
Aug 14 13:39:34 user nova-compute[73484]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:39:34 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:34 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:34 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:34 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:34 user nova-compute[73484]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:39:34 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d (non-flash)
Aug 14 13:39:34 user nova-compute[73484]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 (non-flash)
Aug 14 13:39:34 user nova-compute[73484]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 (non-flash)
Aug 14 13:39:34 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:34 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:34 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:34 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:34 user nova-compute[73484]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:39:34 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4953aaa70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567'): ({'sdb'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Removing single pathed devices sdb {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] No BDM found with device name hda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] No VIF found with MAC fa:16:3e:a3:34:4e, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f765404-1f52-4cc0-be0c-ae4406e6b546]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d7751e-dcfb-4a90-a66d-b80eb456c3ec]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Flushing IO for device /dev/sdb {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c37aba4-0a0d-4163-998e-01dd24b6397c]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/377257a6-916e-4269-bc53-a81d8bed6bdb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/377257a6-916e-4269-bc53-a81d8bed6bdb/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ceb417-d717-429d-908b-19d6feb65a6f]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] SCSI volumes sdb have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2967ac76-2200-475f-97b6-94296f69a8cf]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-30888dae-3e69-49ad-8ab2-522265156cce tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "7348b004-4d46-4db5-a451-afd3b7476569" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.294s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 -p 172.16.0.220:3260 --logout" returned: 0 in 0.099s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c6ad13-b072-4d25-ab1d-5d3748795c2c]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567, portal: 172.16.0.220,3260]
Aug 14 13:39:34 user nova-compute[73484]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567, portal: 172.16.0.220,3260] successful.
Aug 14 13:39:34 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/377257a6-916e-4269-bc53-a81d8bed6bdb/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb76caf7-3867-4cc2-824f-86e45acf8fc1]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.467s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] <== disconnect_volume: return (2696ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:39:34 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Deleting instance files /opt/stack/data/nova/instances/eaaccbea-d453-4943-9663-949c66029d87_del
Aug 14 13:39:34 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Deletion of /opt/stack/data/nova/instances/eaaccbea-d453-4943-9663-949c66029d87_del complete
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.008s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06277e4-6085-4f13-8f84-4d38e04767ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c311a2-dea4-4213-baeb-1722b23cc76f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d (non-flash)
Aug 14 13:39:35 user nova-compute[73484]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 (non-flash)
Aug 14 13:39:35 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:35 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:35 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:35 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:35 user nova-compute[73484]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:39:35 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d (non-flash)
Aug 14 13:39:35 user nova-compute[73484]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 (non-flash)
Aug 14 13:39:35 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:35 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:35 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:35 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:35 user nova-compute[73484]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:39:35 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc458652680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d'): ({'sdj'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Removing single pathed devices sdj {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f3609b-1f98-4fc3-ab03-13d2fdb0e42c]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fce8cb-3276-49cf-bb0e-418407b1246e]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Flushing IO for device /dev/sdj {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[19136a85-d940-4aba-8a93-ac974a8a00a1]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.056s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3e7bf5-a971-48b5-a3e8-f1256f26ce32]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] SCSI volumes sdj have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:35 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance eaaccbea-d453-4943-9663-949c66029d87 could not be found.
Aug 14 13:39:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NlzXhUZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:39:35 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 13:39:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b087093-4d82-4c41-a494-744aa5dad434]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b4dc5a-2871-4e99-8737-f3a25acf668c]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d, portal: 172.16.0.220,3260]
Aug 14 13:39:35 user nova-compute[73484]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d, portal: 172.16.0.220,3260] successful.
Aug 14 13:39:35 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45599018-8480-4b94-a396-e74b5832ee9d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce37c89-f04b-448a-92f8-cc15eb348f83]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] <== disconnect_volume: return (1400ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.139s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e598b662-a85f-4f07-ac23-a55e1cbe7076]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2006512e-cae6-4651-9664-ef0740c90913]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 (non-flash)
Aug 14 13:39:35 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:35 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:35 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:35 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:35 user nova-compute[73484]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:39:35 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 (non-flash)
Aug 14 13:39:35 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:35 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:35 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:35 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:35 user nova-compute[73484]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:39:35 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4586525f0>, {}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Disconnecting from: [] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.087s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] <== disconnect_volume: return (226ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:36 user nova-compute[73484]: DEBUG nova.objects.instance [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lazy-loading 'flavor' on Instance uuid 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:39:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fce8a37d-323c-4822-839e-6d1e57687db6 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lock "96025e5d-7c98-4ed4-8180-7c2cdb1d65bf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.881s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:36 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Error from libvirt while getting description of instance-0000000a: [Error Code 42] Domain not found: no domain with matching uuid 'eaaccbea-d453-4943-9663-949c66029d87' (instance-0000000a): libvirt.libvirtError: Domain not found: no domain with matching uuid 'eaaccbea-d453-4943-9663-949c66029d87' (instance-0000000a)
Aug 14 13:39:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac05f68-a20f-4a57-b990-ef0799aadc58/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac05f68-a20f-4a57-b990-ef0799aadc58/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac05f68-a20f-4a57-b990-ef0799aadc58/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac05f68-a20f-4a57-b990-ef0799aadc58/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:39:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:39:37 user nova-compute[73484]: DEBUG nova.compute.manager [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Preparing to wait for external event volume-reimaged-abbda33a-ae60-404c-85b3-9df266cc1567 {{(pid=73484) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 14 13:39:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Acquiring lock "eaaccbea-d453-4943-9663-949c66029d87-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lock "eaaccbea-d453-4943-9663-949c66029d87-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lock "eaaccbea-d453-4943-9663-949c66029d87-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Acquiring lock "7348b004-4d46-4db5-a451-afd3b7476569" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "7348b004-4d46-4db5-a451-afd3b7476569" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:37 user nova-compute[73484]: INFO nova.compute.manager [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Detaching volume 75981986-1084-4221-83c9-4bf4503267d7
Aug 14 13:39:37 user nova-compute[73484]: DEBUG nova.objects.instance [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Lazy-loading 'flavor' on Instance uuid 377257a6-916e-4269-bc53-a81d8bed6bdb {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:39:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-634eca7f-7213-40e8-af7a-f095e7f77092 tempest-VolumesAssistedSnapshotsTest-492290778 tempest-VolumesAssistedSnapshotsTest-492290778-project-admin] Lock "377257a6-916e-4269-bc53-a81d8bed6bdb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.261s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:39:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:39:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:39:38 user nova-compute[73484]: INFO nova.virt.block_device [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Attempting to driver detach volume 75981986-1084-4221-83c9-4bf4503267d7 from mountpoint /dev/vdb
Aug 14 13:39:38 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:39:38 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:39:38 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=6953MB free_disk=25.611881256103516GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-27ea6202-9b1d-4928-955a-abd9aa8cf596 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Acquiring lock "96025e5d-7c98-4ed4-8180-7c2cdb1d65bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-27ea6202-9b1d-4928-955a-abd9aa8cf596 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lock "96025e5d-7c98-4ed4-8180-7c2cdb1d65bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-27ea6202-9b1d-4928-955a-abd9aa8cf596 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Acquiring lock "96025e5d-7c98-4ed4-8180-7c2cdb1d65bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-27ea6202-9b1d-4928-955a-abd9aa8cf596 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lock "96025e5d-7c98-4ed4-8180-7c2cdb1d65bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-27ea6202-9b1d-4928-955a-abd9aa8cf596 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lock "96025e5d-7c98-4ed4-8180-7c2cdb1d65bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:38 user nova-compute[73484]: INFO nova.compute.manager [None req-27ea6202-9b1d-4928-955a-abd9aa8cf596 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Terminating instance
Aug 14 13:39:38 user nova-compute[73484]: DEBUG nova.compute.manager [None req-27ea6202-9b1d-4928-955a-abd9aa8cf596 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Attempting to detach device vdb from instance 7348b004-4d46-4db5-a451-afd3b7476569 from the persistent domain config. {{(pid=73484) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:39:38 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:39:38 user nova-compute[73484]:   <source dev="/dev/sdg"/>
Aug 14 13:39:38 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:39:38 user nova-compute[73484]:   <serial>75981986-1084-4221-83c9-4bf4503267d7</serial>
Aug 14 13:39:38 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 13:39:38 user nova-compute[73484]: </disk>
Aug 14 13:39:38 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:39:38 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Successfully detached device vdb from instance 7348b004-4d46-4db5-a451-afd3b7476569 from the persistent domain config.
Aug 14 13:39:38 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7348b004-4d46-4db5-a451-afd3b7476569 from the live domain config. {{(pid=73484) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:39:38 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:39:38 user nova-compute[73484]:   <source dev="/dev/sdg"/>
Aug 14 13:39:38 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:39:38 user nova-compute[73484]:   <serial>75981986-1084-4221-83c9-4bf4503267d7</serial>
Aug 14 13:39:38 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 13:39:38 user nova-compute[73484]: </disk>
Aug 14 13:39:38 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance f4f7788c-fcca-47c1-b5b8-72892253982d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 07bac569-8b2c-4555-b4d5-a74f7384630b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance b889688d-13dd-4f7b-bfef-26dc5347fd6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 377257a6-916e-4269-bc53-a81d8bed6bdb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 7ac05f68-a20f-4a57-b990-ef0799aadc58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 7348b004-4d46-4db5-a451-afd3b7476569 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance eaaccbea-d453-4943-9663-949c66029d87 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 18feef86-7a18-43e3-80cb-fb1d01d34d49 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG nova.compute.manager [req-d1f878a9-9796-46e5-bb77-da2d5633d3b4 req-81101c8a-03d0-4ed4-a6d4-f4c4d9162614 service nova] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Received event network-vif-unplugged-de0da088-b53c-4792-b764-b6c6cd9dc5a3 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d1f878a9-9796-46e5-bb77-da2d5633d3b4 req-81101c8a-03d0-4ed4-a6d4-f4c4d9162614 service nova] Acquiring lock "96025e5d-7c98-4ed4-8180-7c2cdb1d65bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d1f878a9-9796-46e5-bb77-da2d5633d3b4 req-81101c8a-03d0-4ed4-a6d4-f4c4d9162614 service nova] Lock "96025e5d-7c98-4ed4-8180-7c2cdb1d65bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d1f878a9-9796-46e5-bb77-da2d5633d3b4 req-81101c8a-03d0-4ed4-a6d4-f4c4d9162614 service nova] Lock "96025e5d-7c98-4ed4-8180-7c2cdb1d65bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG nova.compute.manager [req-d1f878a9-9796-46e5-bb77-da2d5633d3b4 req-81101c8a-03d0-4ed4-a6d4-f4c4d9162614 service nova] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] No waiting events found dispatching network-vif-unplugged-de0da088-b53c-4792-b764-b6c6cd9dc5a3 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG nova.compute.manager [req-d1f878a9-9796-46e5-bb77-da2d5633d3b4 req-81101c8a-03d0-4ed4-a6d4-f4c4d9162614 service nova] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Received event network-vif-unplugged-de0da088-b53c-4792-b764-b6c6cd9dc5a3 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Received event <DeviceRemovedEvent: 1692020378.65198, 7348b004-4d46-4db5-a451-afd3b7476569 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73484) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7348b004-4d46-4db5-a451-afd3b7476569 {{(pid=73484) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 13:39:38 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Successfully detached device vdb from instance 7348b004-4d46-4db5-a451-afd3b7476569 from the live domain config.
Aug 14 13:39:38 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YMRCeZba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:39:38 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:39:38 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcb431d-4ec1-41b1-b494-bb90be47b553]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.574s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[708ad94e-631b-4a9c-970b-cdcd5a08ce4d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 (non-flash)
Aug 14 13:39:38 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:38 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:38 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:38 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:38 user nova-compute[73484]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:39:38 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 (non-flash)
Aug 14 13:39:38 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:38 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:38 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:38 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:38 user nova-compute[73484]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:39:38 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc491fb9750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7'): ({'sdg'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Removing single pathed devices sdg {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d410c078-5be2-4524-b8a9-bd70277fe7ca]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3391c170-6dcf-4a59-bfee-21eb94c04873]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Flushing IO for device /dev/sdg {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3285b0e4-a755-4afd-a7dc-c46b2d864ead]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.036s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8bb387-7258-4154-a96f-6c203aca649b]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] SCSI volumes sdg have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba75791d-a91a-4981-a4a9-6afbfdff65de]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafe5c39-4e03-4ff5-b609-2921e46cd963]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7, portal: 172.16.0.220,3260]
Aug 14 13:39:38 user nova-compute[73484]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7, portal: 172.16.0.220,3260] successful.
Aug 14 13:39:38 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75981986-1084-4221-83c9-4bf4503267d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab4a3d5-13ca-49b5-87ed-6badf4df64c2]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] <== disconnect_volume: return (324ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:39:38 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:39:39 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Instance destroyed successfully.
Aug 14 13:39:39 user nova-compute[73484]: DEBUG nova.objects.instance [None req-27ea6202-9b1d-4928-955a-abd9aa8cf596 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lazy-loading 'resources' on Instance uuid 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:39:39 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-27ea6202-9b1d-4928-955a-abd9aa8cf596 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2123277952',display_name='tempest-AttachSCSIVolumeTestJSON-server-2123277952',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2123277952',id=7,image_ref='3c91a38b-3e53-488d-af95-8276da600614',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCj17lJFfTjChU76wO5GKKieC0+TjWqX5UXQQDjKpMcf2sUOv584odaKkPi5/WM6bD/S4zNn9sG5UdZ4kXUsAA1miIvrxVXM19Gwczuk8QDucOZelKZUC+AVurpLMXkhQ==',key_name='tempest-keypair-1488820723',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:37:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='55f538430f3b45b9905698823d51c054',ramdisk_id='',reservation_id='r-bkvfl88l',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3c91a38b-3e53-488d-af95-8276da600614',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-558500768',owner_user_name='tempest-AttachSCSIVolumeTestJSON-558500768-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:37:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70f1240cf6d545f7b5b99cd8a7ddb9d1',uuid=96025e5d-7c98-4ed4-8180-7c2cdb1d65bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de0da088-b53c-4792-b764-b6c6cd9dc5a3", "address": "fa:16:3e:76:d0:d2", "network": {"id": "e557c45b-1bcb-487b-8510-0d3d31efb70e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-254555588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55f538430f3b45b9905698823d51c054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0da088-b5", "ovs_interfaceid": "de0da088-b53c-4792-b764-b6c6cd9dc5a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:39:39 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-27ea6202-9b1d-4928-955a-abd9aa8cf596 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Converting VIF {"id": "de0da088-b53c-4792-b764-b6c6cd9dc5a3", "address": "fa:16:3e:76:d0:d2", "network": {"id": "e557c45b-1bcb-487b-8510-0d3d31efb70e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-254555588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55f538430f3b45b9905698823d51c054", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde0da088-b5", "ovs_interfaceid": "de0da088-b53c-4792-b764-b6c6cd9dc5a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:39:39 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-27ea6202-9b1d-4928-955a-abd9aa8cf596 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:d0:d2,bridge_name='br-int',has_traffic_filtering=True,id=de0da088-b53c-4792-b764-b6c6cd9dc5a3,network=Network(e557c45b-1bcb-487b-8510-0d3d31efb70e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0da088-b5') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:39:39 user nova-compute[73484]: DEBUG os_vif [None req-27ea6202-9b1d-4928-955a-abd9aa8cf596 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:d0:d2,bridge_name='br-int',has_traffic_filtering=True,id=de0da088-b53c-4792-b764-b6c6cd9dc5a3,network=Network(e557c45b-1bcb-487b-8510-0d3d31efb70e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0da088-b5') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:39:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde0da088-b5, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:39:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:39:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:39 user nova-compute[73484]: INFO os_vif [None req-27ea6202-9b1d-4928-955a-abd9aa8cf596 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:d0:d2,bridge_name='br-int',has_traffic_filtering=True,id=de0da088-b53c-4792-b764-b6c6cd9dc5a3,network=Network(e557c45b-1bcb-487b-8510-0d3d31efb70e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde0da088-b5')
Aug 14 13:39:39 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-27ea6202-9b1d-4928-955a-abd9aa8cf596 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Deleting instance files /opt/stack/data/nova/instances/96025e5d-7c98-4ed4-8180-7c2cdb1d65bf_del
Aug 14 13:39:39 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-27ea6202-9b1d-4928-955a-abd9aa8cf596 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Deletion of /opt/stack/data/nova/instances/96025e5d-7c98-4ed4-8180-7c2cdb1d65bf_del complete
Aug 14 13:39:39 user nova-compute[73484]: INFO nova.compute.manager [None req-27ea6202-9b1d-4928-955a-abd9aa8cf596 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 14 13:39:39 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-27ea6202-9b1d-4928-955a-abd9aa8cf596 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:39:39 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:39:39 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:39:39 user nova-compute[73484]: DEBUG nova.objects.instance [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lazy-loading 'flavor' on Instance uuid 7348b004-4d46-4db5-a451-afd3b7476569 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:39:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-aa3b5851-f9b2-482b-ad00-49a516830fff tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "7348b004-4d46-4db5-a451-afd3b7476569" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.335s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Acquiring lock "interface-7348b004-4d46-4db5-a451-afd3b7476569-ca4312d6-790c-49f6-b6e5-dc3033d0d93f" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "interface-7348b004-4d46-4db5-a451-afd3b7476569-ca4312d6-790c-49f6-b6e5-dc3033d0d93f" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG nova.objects.instance [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lazy-loading 'flavor' on Instance uuid 7348b004-4d46-4db5-a451-afd3b7476569 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:37:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-522186817',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-522186817',id=9,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiK6LkV4LYXJ9k8WiSdM3r6iHP8qN1XXbA8EbfSGkzqKZ1oy8APH01wj6TnPRn+92njmmJyEDjXb8n2RsiEiMAkKvCvz4+a7zm6gB5yZrCVjYB/hhRdrNwSW43XY6YGlg==',key_name='tempest-keypair-2063229418',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:37:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='900fe242d672495d832feee598acf991',ramdisk_id='',reservation_id='r-smdsx10g',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-696464863',owner_user_name='tempest-TaggedAttachmentsTest-696464863-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:37:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='602233ac777c42ac8f97536c706d5fd8',uuid=7348b004-4d46-4db5-a451-afd3b7476569,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca4312d6-790c-49f6-b6e5-dc3033d0d93f", "address": "fa:16:3e:25:ae:d6", "network": {"id": "710aecff-babe-436a-97ee-fdb206a5a73b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1050503830", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "900fe242d672495d832feee598acf991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4312d6-79", "ovs_interfaceid": "ca4312d6-790c-49f6-b6e5-dc3033d0d93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Converting VIF {"id": "ca4312d6-790c-49f6-b6e5-dc3033d0d93f", "address": "fa:16:3e:25:ae:d6", "network": {"id": "710aecff-babe-436a-97ee-fdb206a5a73b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1050503830", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "900fe242d672495d832feee598acf991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4312d6-79", "ovs_interfaceid": "ca4312d6-790c-49f6-b6e5-dc3033d0d93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=ca4312d6-790c-49f6-b6e5-dc3033d0d93f,network=Network(710aecff-babe-436a-97ee-fdb206a5a73b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4312d6-79') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:25:ae:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tapca4312d6-79"/></interface> {{(pid=73484) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:25:ae:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tapca4312d6-79"/></interface> {{(pid=73484) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Attempting to detach device tapca4312d6-79 from instance 7348b004-4d46-4db5-a451-afd3b7476569 from the persistent domain config. {{(pid=73484) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] detach device xml: <interface type="ethernet">
Aug 14 13:39:40 user nova-compute[73484]:   <mac address="fa:16:3e:25:ae:d6"/>
Aug 14 13:39:40 user nova-compute[73484]:   <model type="virtio"/>
Aug 14 13:39:40 user nova-compute[73484]:   <mtu size="1442"/>
Aug 14 13:39:40 user nova-compute[73484]:   <target dev="tapca4312d6-79"/>
Aug 14 13:39:40 user nova-compute[73484]: </interface>
Aug 14 13:39:40 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:25:ae:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tapca4312d6-79"/></interface> {{(pid=73484) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:25:ae:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tapca4312d6-79"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 14 13:39:40 user nova-compute[73484]:   <name>instance-00000009</name>
Aug 14 13:39:40 user nova-compute[73484]:   <uuid>7348b004-4d46-4db5-a451-afd3b7476569</uuid>
Aug 14 13:39:40 user nova-compute[73484]:   <metadata>
Aug 14 13:39:40 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:39:40 user nova-compute[73484]:   <nova:package version="0.0.0"/>
Aug 14 13:39:40 user nova-compute[73484]:   <nova:name>tempest-device-tagging-server-522186817</nova:name>
Aug 14 13:39:40 user nova-compute[73484]:   <nova:creationTime>2023-08-14 13:39:18</nova:creationTime>
Aug 14 13:39:40 user nova-compute[73484]:   <nova:flavor name="m1.tiny">
Aug 14 13:39:40 user nova-compute[73484]:     <nova:memory>512</nova:memory>
Aug 14 13:39:40 user nova-compute[73484]:     <nova:disk>1</nova:disk>
Aug 14 13:39:40 user nova-compute[73484]:     <nova:swap>0</nova:swap>
Aug 14 13:39:40 user nova-compute[73484]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:39:40 user nova-compute[73484]:     <nova:vcpus>1</nova:vcpus>
Aug 14 13:39:40 user nova-compute[73484]:   </nova:flavor>
Aug 14 13:39:40 user nova-compute[73484]:   <nova:owner>
Aug 14 13:39:40 user nova-compute[73484]:     <nova:user uuid="602233ac777c42ac8f97536c706d5fd8">tempest-TaggedAttachmentsTest-696464863-project-member</nova:user>
Aug 14 13:39:40 user nova-compute[73484]:     <nova:project uuid="900fe242d672495d832feee598acf991">tempest-TaggedAttachmentsTest-696464863</nova:project>
Aug 14 13:39:40 user nova-compute[73484]:   </nova:owner>
Aug 14 13:39:40 user nova-compute[73484]:   <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:39:40 user nova-compute[73484]:   <nova:ports>
Aug 14 13:39:40 user nova-compute[73484]:     <nova:port uuid="2eb5bc00-16a1-43cd-ac1f-db1d191fba75">
Aug 14 13:39:40 user nova-compute[73484]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 13:39:40 user nova-compute[73484]:     </nova:port>
Aug 14 13:39:40 user nova-compute[73484]:     <nova:port uuid="ca4312d6-790c-49f6-b6e5-dc3033d0d93f">
Aug 14 13:39:40 user nova-compute[73484]:       <nova:ip type="fixed" address="10.10.10.205" ipVersion="4"/>
Aug 14 13:39:40 user nova-compute[73484]:     </nova:port>
Aug 14 13:39:40 user nova-compute[73484]:   </nova:ports>
Aug 14 13:39:40 user nova-compute[73484]: </nova:instance>
Aug 14 13:39:40 user nova-compute[73484]:   </metadata>
Aug 14 13:39:40 user nova-compute[73484]:   <memory unit='KiB'>524288</memory>
Aug 14 13:39:40 user nova-compute[73484]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 14 13:39:40 user nova-compute[73484]:   <vcpu placement='static'>1</vcpu>
Aug 14 13:39:40 user nova-compute[73484]:   <resource>
Aug 14 13:39:40 user nova-compute[73484]:     <partition>/machine</partition>
Aug 14 13:39:40 user nova-compute[73484]:   </resource>
Aug 14 13:39:40 user nova-compute[73484]:   <sysinfo type='smbios'>
Aug 14 13:39:40 user nova-compute[73484]:     <system>
Aug 14 13:39:40 user nova-compute[73484]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 14 13:39:40 user nova-compute[73484]:       <entry name='product'>OpenStack Nova</entry>
Aug 14 13:39:40 user nova-compute[73484]:       <entry name='version'>0.0.0</entry>
Aug 14 13:39:40 user nova-compute[73484]:       <entry name='serial'>7348b004-4d46-4db5-a451-afd3b7476569</entry>
Aug 14 13:39:40 user nova-compute[73484]:       <entry name='uuid'>7348b004-4d46-4db5-a451-afd3b7476569</entry>
Aug 14 13:39:40 user nova-compute[73484]:       <entry name='family'>Virtual Machine</entry>
Aug 14 13:39:40 user nova-compute[73484]:     </system>
Aug 14 13:39:40 user nova-compute[73484]:   </sysinfo>
Aug 14 13:39:40 user nova-compute[73484]:   <os>
Aug 14 13:39:40 user nova-compute[73484]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 14 13:39:40 user nova-compute[73484]:     <boot dev='hd'/>
Aug 14 13:39:40 user nova-compute[73484]:     <smbios mode='sysinfo'/>
Aug 14 13:39:40 user nova-compute[73484]:   </os>
Aug 14 13:39:40 user nova-compute[73484]:   <features>
Aug 14 13:39:40 user nova-compute[73484]:     <acpi/>
Aug 14 13:39:40 user nova-compute[73484]:     <apic/>
Aug 14 13:39:40 user nova-compute[73484]:     <vmcoreinfo state='on'/>
Aug 14 13:39:40 user nova-compute[73484]:   </features>
Aug 14 13:39:40 user nova-compute[73484]:   <cpu mode='custom' match='exact' check='full'>
Aug 14 13:39:40 user nova-compute[73484]:     <model fallback='forbid'>Nehalem</model>
Aug 14 13:39:40 user nova-compute[73484]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 14 13:39:40 user nova-compute[73484]:     <feature policy='require' name='vme'/>
Aug 14 13:39:40 user nova-compute[73484]:     <feature policy='require' name='x2apic'/>
Aug 14 13:39:40 user nova-compute[73484]:     <feature policy='require' name='hypervisor'/>
Aug 14 13:39:40 user nova-compute[73484]:   </cpu>
Aug 14 13:39:40 user nova-compute[73484]:   <clock offset='utc'>
Aug 14 13:39:40 user nova-compute[73484]:     <timer name='pit' tickpolicy='delay'/>
Aug 14 13:39:40 user nova-compute[73484]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 14 13:39:40 user nova-compute[73484]:     <timer name='hpet' present='no'/>
Aug 14 13:39:40 user nova-compute[73484]:   </clock>
Aug 14 13:39:40 user nova-compute[73484]:   <on_poweroff>destroy</on_poweroff>
Aug 14 13:39:40 user nova-compute[73484]:   <on_reboot>restart</on_reboot>
Aug 14 13:39:40 user nova-compute[73484]:   <on_crash>destroy</on_crash>
Aug 14 13:39:40 user nova-compute[73484]:   <devices>
Aug 14 13:39:40 user nova-compute[73484]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 14 13:39:40 user nova-compute[73484]:     <disk type='file' device='disk'>
Aug 14 13:39:40 user nova-compute[73484]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 14 13:39:40 user nova-compute[73484]:       <source file='/opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/disk' index='2'/>
Aug 14 13:39:40 user nova-compute[73484]:       <backingStore type='file' index='3'>
Aug 14 13:39:40 user nova-compute[73484]:         <format type='raw'/>
Aug 14 13:39:40 user nova-compute[73484]:         <source file='/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03'/>
Aug 14 13:39:40 user nova-compute[73484]:         <backingStore/>
Aug 14 13:39:40 user nova-compute[73484]:       </backingStore>
Aug 14 13:39:40 user nova-compute[73484]:       <target dev='vda' bus='virtio'/>
Aug 14 13:39:40 user nova-compute[73484]:       <alias name='virtio-disk0'/>
Aug 14 13:39:40 user nova-compute[73484]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 14 13:39:40 user nova-compute[73484]:     </disk>
Aug 14 13:39:40 user nova-compute[73484]:     <disk type='file' device='cdrom'>
Aug 14 13:39:40 user nova-compute[73484]:       <driver name='qemu' type='raw' cache='none'/>
Aug 14 13:39:40 user nova-compute[73484]:       <source file='/opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/disk.config' index='1'/>
Aug 14 13:39:40 user nova-compute[73484]:       <backingStore/>
Aug 14 13:39:40 user nova-compute[73484]:       <target dev='hda' bus='ide'/>
Aug 14 13:39:40 user nova-compute[73484]:       <readonly/>
Aug 14 13:39:40 user nova-compute[73484]:       <alias name='ide0-0-0'/>
Aug 14 13:39:40 user nova-compute[73484]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 14 13:39:40 user nova-compute[73484]:     </disk>
Aug 14 13:39:40 user nova-compute[73484]:     <controller type='usb' index='0' model='none'>
Aug 14 13:39:40 user nova-compute[73484]:       <alias name='usb'/>
Aug 14 13:39:40 user nova-compute[73484]:     </controller>
Aug 14 13:39:40 user nova-compute[73484]:     <controller type='pci' index='0' model='pci-root'>
Aug 14 13:39:40 user nova-compute[73484]:       <alias name='pci.0'/>
Aug 14 13:39:40 user nova-compute[73484]:     </controller>
Aug 14 13:39:40 user nova-compute[73484]:     <controller type='ide' index='0'>
Aug 14 13:39:40 user nova-compute[73484]:       <alias name='ide'/>
Aug 14 13:39:40 user nova-compute[73484]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 14 13:39:40 user nova-compute[73484]:     </controller>
Aug 14 13:39:40 user nova-compute[73484]:     <interface type='ethernet'>
Aug 14 13:39:40 user nova-compute[73484]:       <mac address='fa:16:3e:a3:34:4e'/>
Aug 14 13:39:40 user nova-compute[73484]:       <target dev='tap2eb5bc00-16'/>
Aug 14 13:39:40 user nova-compute[73484]:       <model type='virtio'/>
Aug 14 13:39:40 user nova-compute[73484]:       <mtu size='1442'/>
Aug 14 13:39:40 user nova-compute[73484]:       <alias name='net0'/>
Aug 14 13:39:40 user nova-compute[73484]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 14 13:39:40 user nova-compute[73484]:     </interface>
Aug 14 13:39:40 user nova-compute[73484]:     <interface type='ethernet'>
Aug 14 13:39:40 user nova-compute[73484]:       <mac address='fa:16:3e:25:ae:d6'/>
Aug 14 13:39:40 user nova-compute[73484]:       <target dev='tapca4312d6-79'/>
Aug 14 13:39:40 user nova-compute[73484]:       <model type='virtio'/>
Aug 14 13:39:40 user nova-compute[73484]:       <mtu size='1442'/>
Aug 14 13:39:40 user nova-compute[73484]:       <alias name='net1'/>
Aug 14 13:39:40 user nova-compute[73484]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 14 13:39:40 user nova-compute[73484]:     </interface>
Aug 14 13:39:40 user nova-compute[73484]:     <serial type='pty'>
Aug 14 13:39:40 user nova-compute[73484]:       <source path='/dev/pts/6'/>
Aug 14 13:39:40 user nova-compute[73484]:       <log file='/opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/console.log' append='off'/>
Aug 14 13:39:40 user nova-compute[73484]:       <target type='isa-serial' port='0'>
Aug 14 13:39:40 user nova-compute[73484]:         <model name='isa-serial'/>
Aug 14 13:39:40 user nova-compute[73484]:       </target>
Aug 14 13:39:40 user nova-compute[73484]:       <alias name='serial0'/>
Aug 14 13:39:40 user nova-compute[73484]:     </serial>
Aug 14 13:39:40 user nova-compute[73484]:     <console type='pty' tty='/dev/pts/6'>
Aug 14 13:39:40 user nova-compute[73484]:       <source path='/dev/pts/6'/>
Aug 14 13:39:40 user nova-compute[73484]:       <log file='/opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/console.log' append='off'/>
Aug 14 13:39:40 user nova-compute[73484]:       <target type='serial' port='0'/>
Aug 14 13:39:40 user nova-compute[73484]:       <alias name='serial0'/>
Aug 14 13:39:40 user nova-compute[73484]:     </console>
Aug 14 13:39:40 user nova-compute[73484]:     <input type='mouse' bus='ps2'>
Aug 14 13:39:40 user nova-compute[73484]:       <alias name='input0'/>
Aug 14 13:39:40 user nova-compute[73484]:     </input>
Aug 14 13:39:40 user nova-compute[73484]:     <input type='keyboard' bus='ps2'>
Aug 14 13:39:40 user nova-compute[73484]:       <alias name='input1'/>
Aug 14 13:39:40 user nova-compute[73484]:     </input>
Aug 14 13:39:40 user nova-compute[73484]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 14 13:39:40 user nova-compute[73484]:       <listen type='address' address='0.0.0.0'/>
Aug 14 13:39:40 user nova-compute[73484]:     </graphics>
Aug 14 13:39:40 user nova-compute[73484]:     <audio id='1' type='none'/>
Aug 14 13:39:40 user nova-compute[73484]:     <video>
Aug 14 13:39:40 user nova-compute[73484]:       <model type='virtio' heads='1' primary='yes'/>
Aug 14 13:39:40 user nova-compute[73484]:       <alias name='video0'/>
Aug 14 13:39:40 user nova-compute[73484]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 14 13:39:40 user nova-compute[73484]:     </video>
Aug 14 13:39:40 user nova-compute[73484]:     <memballoon model='virtio'>
Aug 14 13:39:40 user nova-compute[73484]:       <stats period='10'/>
Aug 14 13:39:40 user nova-compute[73484]:       <alias name='balloon0'/>
Aug 14 13:39:40 user nova-compute[73484]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 14 13:39:40 user nova-compute[73484]:     </memballoon>
Aug 14 13:39:40 user nova-compute[73484]:     <rng model='virtio'>
Aug 14 13:39:40 user nova-compute[73484]:       <backend model='random'>/dev/urandom</backend>
Aug 14 13:39:40 user nova-compute[73484]:       <alias name='rng0'/>
Aug 14 13:39:40 user nova-compute[73484]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 14 13:39:40 user nova-compute[73484]:     </rng>
Aug 14 13:39:40 user nova-compute[73484]:   </devices>
Aug 14 13:39:40 user nova-compute[73484]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 14 13:39:40 user nova-compute[73484]:     <label>libvirt-7348b004-4d46-4db5-a451-afd3b7476569</label>
Aug 14 13:39:40 user nova-compute[73484]:     <imagelabel>libvirt-7348b004-4d46-4db5-a451-afd3b7476569</imagelabel>
Aug 14 13:39:40 user nova-compute[73484]:   </seclabel>
Aug 14 13:39:40 user nova-compute[73484]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 14 13:39:40 user nova-compute[73484]:     <label>+64055:+108</label>
Aug 14 13:39:40 user nova-compute[73484]:     <imagelabel>+64055:+108</imagelabel>
Aug 14 13:39:40 user nova-compute[73484]:   </seclabel>
Aug 14 13:39:40 user nova-compute[73484]: </domain>
Aug 14 13:39:40 user nova-compute[73484]:  {{(pid=73484) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 14 13:39:40 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Successfully detached device tapca4312d6-79 from instance 7348b004-4d46-4db5-a451-afd3b7476569 from the persistent domain config.
Aug 14 13:39:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] (1/8): Attempting to detach device tapca4312d6-79 with device alias net1 from instance 7348b004-4d46-4db5-a451-afd3b7476569 from the live domain config. {{(pid=73484) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] detach device xml: <interface type="ethernet">
Aug 14 13:39:40 user nova-compute[73484]:   <mac address="fa:16:3e:25:ae:d6"/>
Aug 14 13:39:40 user nova-compute[73484]:   <model type="virtio"/>
Aug 14 13:39:40 user nova-compute[73484]:   <mtu size="1442"/>
Aug 14 13:39:40 user nova-compute[73484]:   <target dev="tapca4312d6-79"/>
Aug 14 13:39:40 user nova-compute[73484]: </interface>
Aug 14 13:39:40 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:39:40 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Took 1.11 seconds to deallocate network for instance.
Aug 14 13:39:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-27ea6202-9b1d-4928-955a-abd9aa8cf596 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-27ea6202-9b1d-4928-955a-abd9aa8cf596 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Received event <DeviceRemovedEvent: 1692020380.4671626, 7348b004-4d46-4db5-a451-afd3b7476569 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73484) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Start waiting for the detach event from libvirt for device tapca4312d6-79 with device alias net1 for instance 7348b004-4d46-4db5-a451-afd3b7476569 {{(pid=73484) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:25:ae:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tapca4312d6-79"/></interface> {{(pid=73484) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:25:ae:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tapca4312d6-79"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 14 13:39:40 user nova-compute[73484]:   <name>instance-00000009</name>
Aug 14 13:39:40 user nova-compute[73484]:   <uuid>7348b004-4d46-4db5-a451-afd3b7476569</uuid>
Aug 14 13:39:40 user nova-compute[73484]:   <metadata>
Aug 14 13:39:40 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:39:40 user nova-compute[73484]:   <nova:package version="0.0.0"/>
Aug 14 13:39:40 user nova-compute[73484]:   <nova:name>tempest-device-tagging-server-522186817</nova:name>
Aug 14 13:39:40 user nova-compute[73484]:   <nova:creationTime>2023-08-14 13:39:18</nova:creationTime>
Aug 14 13:39:40 user nova-compute[73484]:   <nova:flavor name="m1.tiny">
Aug 14 13:39:40 user nova-compute[73484]:     <nova:memory>512</nova:memory>
Aug 14 13:39:40 user nova-compute[73484]:     <nova:disk>1</nova:disk>
Aug 14 13:39:40 user nova-compute[73484]:     <nova:swap>0</nova:swap>
Aug 14 13:39:40 user nova-compute[73484]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:39:40 user nova-compute[73484]:     <nova:vcpus>1</nova:vcpus>
Aug 14 13:39:40 user nova-compute[73484]:   </nova:flavor>
Aug 14 13:39:40 user nova-compute[73484]:   <nova:owner>
Aug 14 13:39:40 user nova-compute[73484]:     <nova:user uuid="602233ac777c42ac8f97536c706d5fd8">tempest-TaggedAttachmentsTest-696464863-project-member</nova:user>
Aug 14 13:39:40 user nova-compute[73484]:     <nova:project uuid="900fe242d672495d832feee598acf991">tempest-TaggedAttachmentsTest-696464863</nova:project>
Aug 14 13:39:40 user nova-compute[73484]:   </nova:owner>
Aug 14 13:39:40 user nova-compute[73484]:   <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:39:40 user nova-compute[73484]:   <nova:ports>
Aug 14 13:39:40 user nova-compute[73484]:     <nova:port uuid="2eb5bc00-16a1-43cd-ac1f-db1d191fba75">
Aug 14 13:39:40 user nova-compute[73484]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 13:39:40 user nova-compute[73484]:     </nova:port>
Aug 14 13:39:40 user nova-compute[73484]:     <nova:port uuid="ca4312d6-790c-49f6-b6e5-dc3033d0d93f">
Aug 14 13:39:40 user nova-compute[73484]:       <nova:ip type="fixed" address="10.10.10.205" ipVersion="4"/>
Aug 14 13:39:40 user nova-compute[73484]:     </nova:port>
Aug 14 13:39:40 user nova-compute[73484]:   </nova:ports>
Aug 14 13:39:40 user nova-compute[73484]: </nova:instance>
Aug 14 13:39:40 user nova-compute[73484]:   </metadata>
Aug 14 13:39:40 user nova-compute[73484]:   <memory unit='KiB'>524288</memory>
Aug 14 13:39:40 user nova-compute[73484]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 14 13:39:40 user nova-compute[73484]:   <vcpu placement='static'>1</vcpu>
Aug 14 13:39:40 user nova-compute[73484]:   <resource>
Aug 14 13:39:40 user nova-compute[73484]:     <partition>/machine</partition>
Aug 14 13:39:40 user nova-compute[73484]:   </resource>
Aug 14 13:39:40 user nova-compute[73484]:   <sysinfo type='smbios'>
Aug 14 13:39:40 user nova-compute[73484]:     <system>
Aug 14 13:39:40 user nova-compute[73484]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 14 13:39:40 user nova-compute[73484]:       <entry name='product'>OpenStack Nova</entry>
Aug 14 13:39:40 user nova-compute[73484]:       <entry name='version'>0.0.0</entry>
Aug 14 13:39:40 user nova-compute[73484]:       <entry name='serial'>7348b004-4d46-4db5-a451-afd3b7476569</entry>
Aug 14 13:39:40 user nova-compute[73484]:       <entry name='uuid'>7348b004-4d46-4db5-a451-afd3b7476569</entry>
Aug 14 13:39:40 user nova-compute[73484]:       <entry name='family'>Virtual Machine</entry>
Aug 14 13:39:40 user nova-compute[73484]:     </system>
Aug 14 13:39:40 user nova-compute[73484]:   </sysinfo>
Aug 14 13:39:40 user nova-compute[73484]:   <os>
Aug 14 13:39:40 user nova-compute[73484]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 14 13:39:40 user nova-compute[73484]:     <boot dev='hd'/>
Aug 14 13:39:40 user nova-compute[73484]:     <smbios mode='sysinfo'/>
Aug 14 13:39:40 user nova-compute[73484]:   </os>
Aug 14 13:39:40 user nova-compute[73484]:   <features>
Aug 14 13:39:40 user nova-compute[73484]:     <acpi/>
Aug 14 13:39:40 user nova-compute[73484]:     <apic/>
Aug 14 13:39:40 user nova-compute[73484]:     <vmcoreinfo state='on'/>
Aug 14 13:39:40 user nova-compute[73484]:   </features>
Aug 14 13:39:40 user nova-compute[73484]:   <cpu mode='custom' match='exact' check='full'>
Aug 14 13:39:40 user nova-compute[73484]:     <model fallback='forbid'>Nehalem</model>
Aug 14 13:39:40 user nova-compute[73484]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 14 13:39:40 user nova-compute[73484]:     <feature policy='require' name='vme'/>
Aug 14 13:39:40 user nova-compute[73484]:     <feature policy='require' name='x2apic'/>
Aug 14 13:39:40 user nova-compute[73484]:     <feature policy='require' name='hypervisor'/>
Aug 14 13:39:40 user nova-compute[73484]:   </cpu>
Aug 14 13:39:40 user nova-compute[73484]:   <clock offset='utc'>
Aug 14 13:39:40 user nova-compute[73484]:     <timer name='pit' tickpolicy='delay'/>
Aug 14 13:39:40 user nova-compute[73484]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 14 13:39:40 user nova-compute[73484]:     <timer name='hpet' present='no'/>
Aug 14 13:39:40 user nova-compute[73484]:   </clock>
Aug 14 13:39:40 user nova-compute[73484]:   <on_poweroff>destroy</on_poweroff>
Aug 14 13:39:40 user nova-compute[73484]:   <on_reboot>restart</on_reboot>
Aug 14 13:39:40 user nova-compute[73484]:   <on_crash>destroy</on_crash>
Aug 14 13:39:40 user nova-compute[73484]:   <devices>
Aug 14 13:39:40 user nova-compute[73484]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 14 13:39:40 user nova-compute[73484]:     <disk type='file' device='disk'>
Aug 14 13:39:40 user nova-compute[73484]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 14 13:39:40 user nova-compute[73484]:       <source file='/opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/disk' index='2'/>
Aug 14 13:39:40 user nova-compute[73484]:       <backingStore type='file' index='3'>
Aug 14 13:39:40 user nova-compute[73484]:         <format type='raw'/>
Aug 14 13:39:40 user nova-compute[73484]:         <source file='/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03'/>
Aug 14 13:39:40 user nova-compute[73484]:         <backingStore/>
Aug 14 13:39:40 user nova-compute[73484]:       </backingStore>
Aug 14 13:39:40 user nova-compute[73484]:       <target dev='vda' bus='virtio'/>
Aug 14 13:39:40 user nova-compute[73484]:       <alias name='virtio-disk0'/>
Aug 14 13:39:40 user nova-compute[73484]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 14 13:39:40 user nova-compute[73484]:     </disk>
Aug 14 13:39:40 user nova-compute[73484]:     <disk type='file' device='cdrom'>
Aug 14 13:39:40 user nova-compute[73484]:       <driver name='qemu' type='raw' cache='none'/>
Aug 14 13:39:40 user nova-compute[73484]:       <source file='/opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/disk.config' index='1'/>
Aug 14 13:39:40 user nova-compute[73484]:       <backingStore/>
Aug 14 13:39:40 user nova-compute[73484]:       <target dev='hda' bus='ide'/>
Aug 14 13:39:40 user nova-compute[73484]:       <readonly/>
Aug 14 13:39:40 user nova-compute[73484]:       <alias name='ide0-0-0'/>
Aug 14 13:39:40 user nova-compute[73484]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 14 13:39:40 user nova-compute[73484]:     </disk>
Aug 14 13:39:40 user nova-compute[73484]:     <controller type='usb' index='0' model='none'>
Aug 14 13:39:40 user nova-compute[73484]:       <alias name='usb'/>
Aug 14 13:39:40 user nova-compute[73484]:     </controller>
Aug 14 13:39:40 user nova-compute[73484]:     <controller type='pci' index='0' model='pci-root'>
Aug 14 13:39:40 user nova-compute[73484]:       <alias name='pci.0'/>
Aug 14 13:39:40 user nova-compute[73484]:     </controller>
Aug 14 13:39:40 user nova-compute[73484]:     <controller type='ide' index='0'>
Aug 14 13:39:40 user nova-compute[73484]:       <alias name='ide'/>
Aug 14 13:39:40 user nova-compute[73484]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 14 13:39:40 user nova-compute[73484]:     </controller>
Aug 14 13:39:40 user nova-compute[73484]:     <interface type='ethernet'>
Aug 14 13:39:40 user nova-compute[73484]:       <mac address='fa:16:3e:a3:34:4e'/>
Aug 14 13:39:40 user nova-compute[73484]:       <target dev='tap2eb5bc00-16'/>
Aug 14 13:39:40 user nova-compute[73484]:       <model type='virtio'/>
Aug 14 13:39:40 user nova-compute[73484]:       <mtu size='1442'/>
Aug 14 13:39:40 user nova-compute[73484]:       <alias name='net0'/>
Aug 14 13:39:40 user nova-compute[73484]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 14 13:39:40 user nova-compute[73484]:     </interface>
Aug 14 13:39:40 user nova-compute[73484]:     <serial type='pty'>
Aug 14 13:39:40 user nova-compute[73484]:       <source path='/dev/pts/6'/>
Aug 14 13:39:40 user nova-compute[73484]:       <log file='/opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/console.log' append='off'/>
Aug 14 13:39:40 user nova-compute[73484]:       <target type='isa-serial' port='0'>
Aug 14 13:39:40 user nova-compute[73484]:         <model name='isa-serial'/>
Aug 14 13:39:40 user nova-compute[73484]:       </target>
Aug 14 13:39:40 user nova-compute[73484]:       <alias name='serial0'/>
Aug 14 13:39:40 user nova-compute[73484]:     </serial>
Aug 14 13:39:40 user nova-compute[73484]:     <console type='pty' tty='/dev/pts/6'>
Aug 14 13:39:40 user nova-compute[73484]:       <source path='/dev/pts/6'/>
Aug 14 13:39:40 user nova-compute[73484]:       <log file='/opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569/console.log' append='off'/>
Aug 14 13:39:40 user nova-compute[73484]:       <target type='serial' port='0'/>
Aug 14 13:39:40 user nova-compute[73484]:       <alias name='serial0'/>
Aug 14 13:39:40 user nova-compute[73484]:     </console>
Aug 14 13:39:40 user nova-compute[73484]:     <input type='mouse' bus='ps2'>
Aug 14 13:39:40 user nova-compute[73484]:       <alias name='input0'/>
Aug 14 13:39:40 user nova-compute[73484]:     </input>
Aug 14 13:39:40 user nova-compute[73484]:     <input type='keyboard' bus='ps2'>
Aug 14 13:39:40 user nova-compute[73484]:       <alias name='input1'/>
Aug 14 13:39:40 user nova-compute[73484]:     </input>
Aug 14 13:39:40 user nova-compute[73484]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 14 13:39:40 user nova-compute[73484]:       <listen type='address' address='0.0.0.0'/>
Aug 14 13:39:40 user nova-compute[73484]:     </graphics>
Aug 14 13:39:40 user nova-compute[73484]:     <audio id='1' type='none'/>
Aug 14 13:39:40 user nova-compute[73484]:     <video>
Aug 14 13:39:40 user nova-compute[73484]:       <model type='virtio' heads='1' primary='yes'/>
Aug 14 13:39:40 user nova-compute[73484]:       <alias name='video0'/>
Aug 14 13:39:40 user nova-compute[73484]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 14 13:39:40 user nova-compute[73484]:     </video>
Aug 14 13:39:40 user nova-compute[73484]:     <memballoon model='virtio'>
Aug 14 13:39:40 user nova-compute[73484]:       <stats period='10'/>
Aug 14 13:39:40 user nova-compute[73484]:       <alias name='balloon0'/>
Aug 14 13:39:40 user nova-compute[73484]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 14 13:39:40 user nova-compute[73484]:     </memballoon>
Aug 14 13:39:40 user nova-compute[73484]:     <rng model='virtio'>
Aug 14 13:39:40 user nova-compute[73484]:       <backend model='random'>/dev/urandom</backend>
Aug 14 13:39:40 user nova-compute[73484]:       <alias name='rng0'/>
Aug 14 13:39:40 user nova-compute[73484]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 14 13:39:40 user nova-compute[73484]:     </rng>
Aug 14 13:39:40 user nova-compute[73484]:   </devices>
Aug 14 13:39:40 user nova-compute[73484]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 14 13:39:40 user nova-compute[73484]:     <label>libvirt-7348b004-4d46-4db5-a451-afd3b7476569</label>
Aug 14 13:39:40 user nova-compute[73484]:     <imagelabel>libvirt-7348b004-4d46-4db5-a451-afd3b7476569</imagelabel>
Aug 14 13:39:40 user nova-compute[73484]:   </seclabel>
Aug 14 13:39:40 user nova-compute[73484]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 14 13:39:40 user nova-compute[73484]:     <label>+64055:+108</label>
Aug 14 13:39:40 user nova-compute[73484]:     <imagelabel>+64055:+108</imagelabel>
Aug 14 13:39:40 user nova-compute[73484]:   </seclabel>
Aug 14 13:39:40 user nova-compute[73484]: </domain>
Aug 14 13:39:40 user nova-compute[73484]:  {{(pid=73484) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 14 13:39:40 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Successfully detached device tapca4312d6-79 from instance 7348b004-4d46-4db5-a451-afd3b7476569 from the live domain config.
Aug 14 13:39:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:37:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-522186817',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-522186817',id=9,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiK6LkV4LYXJ9k8WiSdM3r6iHP8qN1XXbA8EbfSGkzqKZ1oy8APH01wj6TnPRn+92njmmJyEDjXb8n2RsiEiMAkKvCvz4+a7zm6gB5yZrCVjYB/hhRdrNwSW43XY6YGlg==',key_name='tempest-keypair-2063229418',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:37:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='900fe242d672495d832feee598acf991',ramdisk_id='',reservation_id='r-smdsx10g',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-696464863',owner_user_name='tempest-TaggedAttachmentsTest-696464863-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:37:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='602233ac777c42ac8f97536c706d5fd8',uuid=7348b004-4d46-4db5-a451-afd3b7476569,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca4312d6-790c-49f6-b6e5-dc3033d0d93f", "address": "fa:16:3e:25:ae:d6", "network": {"id": "710aecff-babe-436a-97ee-fdb206a5a73b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1050503830", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "900fe242d672495d832feee598acf991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4312d6-79", "ovs_interfaceid": "ca4312d6-790c-49f6-b6e5-dc3033d0d93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Converting VIF {"id": "ca4312d6-790c-49f6-b6e5-dc3033d0d93f", "address": "fa:16:3e:25:ae:d6", "network": {"id": "710aecff-babe-436a-97ee-fdb206a5a73b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1050503830", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "900fe242d672495d832feee598acf991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4312d6-79", "ovs_interfaceid": "ca4312d6-790c-49f6-b6e5-dc3033d0d93f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=ca4312d6-790c-49f6-b6e5-dc3033d0d93f,network=Network(710aecff-babe-436a-97ee-fdb206a5a73b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4312d6-79') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG os_vif [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=ca4312d6-790c-49f6-b6e5-dc3033d0d93f,network=Network(710aecff-babe-436a-97ee-fdb206a5a73b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4312d6-79') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca4312d6-79, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:40 user nova-compute[73484]: INFO os_vif [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=ca4312d6-790c-49f6-b6e5-dc3033d0d93f,network=Network(710aecff-babe-436a-97ee-fdb206a5a73b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4312d6-79')
Aug 14 13:39:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:39:40 user nova-compute[73484]:   <nova:package version="0.0.0"/>
Aug 14 13:39:40 user nova-compute[73484]:   <nova:name>tempest-device-tagging-server-522186817</nova:name>
Aug 14 13:39:40 user nova-compute[73484]:   <nova:creationTime>2023-08-14 13:39:40</nova:creationTime>
Aug 14 13:39:40 user nova-compute[73484]:   <nova:flavor name="m1.tiny">
Aug 14 13:39:40 user nova-compute[73484]:     <nova:memory>512</nova:memory>
Aug 14 13:39:40 user nova-compute[73484]:     <nova:disk>1</nova:disk>
Aug 14 13:39:40 user nova-compute[73484]:     <nova:swap>0</nova:swap>
Aug 14 13:39:40 user nova-compute[73484]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:39:40 user nova-compute[73484]:     <nova:vcpus>1</nova:vcpus>
Aug 14 13:39:40 user nova-compute[73484]:   </nova:flavor>
Aug 14 13:39:40 user nova-compute[73484]:   <nova:owner>
Aug 14 13:39:40 user nova-compute[73484]:     <nova:user uuid="602233ac777c42ac8f97536c706d5fd8">tempest-TaggedAttachmentsTest-696464863-project-member</nova:user>
Aug 14 13:39:40 user nova-compute[73484]:     <nova:project uuid="900fe242d672495d832feee598acf991">tempest-TaggedAttachmentsTest-696464863</nova:project>
Aug 14 13:39:40 user nova-compute[73484]:   </nova:owner>
Aug 14 13:39:40 user nova-compute[73484]:   <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:39:40 user nova-compute[73484]:   <nova:ports>
Aug 14 13:39:40 user nova-compute[73484]:     <nova:port uuid="2eb5bc00-16a1-43cd-ac1f-db1d191fba75">
Aug 14 13:39:40 user nova-compute[73484]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 13:39:40 user nova-compute[73484]:     </nova:port>
Aug 14 13:39:40 user nova-compute[73484]:   </nova:ports>
Aug 14 13:39:40 user nova-compute[73484]: </nova:instance>
Aug 14 13:39:40 user nova-compute[73484]:  {{(pid=73484) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-3f477fe9-5311-461b-ac12-38f275863dfc req-05551493-acca-4330-b791-a374f4c575d8 service nova] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Received event network-vif-plugged-de0da088-b53c-4792-b764-b6c6cd9dc5a3 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3f477fe9-5311-461b-ac12-38f275863dfc req-05551493-acca-4330-b791-a374f4c575d8 service nova] Acquiring lock "96025e5d-7c98-4ed4-8180-7c2cdb1d65bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3f477fe9-5311-461b-ac12-38f275863dfc req-05551493-acca-4330-b791-a374f4c575d8 service nova] Lock "96025e5d-7c98-4ed4-8180-7c2cdb1d65bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3f477fe9-5311-461b-ac12-38f275863dfc req-05551493-acca-4330-b791-a374f4c575d8 service nova] Lock "96025e5d-7c98-4ed4-8180-7c2cdb1d65bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-3f477fe9-5311-461b-ac12-38f275863dfc req-05551493-acca-4330-b791-a374f4c575d8 service nova] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] No waiting events found dispatching network-vif-plugged-de0da088-b53c-4792-b764-b6c6cd9dc5a3 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:39:40 user nova-compute[73484]: WARNING nova.compute.manager [req-3f477fe9-5311-461b-ac12-38f275863dfc req-05551493-acca-4330-b791-a374f4c575d8 service nova] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Received unexpected event network-vif-plugged-de0da088-b53c-4792-b764-b6c6cd9dc5a3 for instance with vm_state deleted and task_state None.
Aug 14 13:39:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-3f477fe9-5311-461b-ac12-38f275863dfc req-05551493-acca-4330-b791-a374f4c575d8 service nova] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Received event network-vif-deleted-de0da088-b53c-4792-b764-b6c6cd9dc5a3 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-fe4ca69f-0b9d-41b4-aeec-632473a449a1 req-29f4924d-7e8f-4eae-8d0b-d5378efb3aa2 service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Received event network-vif-unplugged-ca4312d6-790c-49f6-b6e5-dc3033d0d93f {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-fe4ca69f-0b9d-41b4-aeec-632473a449a1 req-29f4924d-7e8f-4eae-8d0b-d5378efb3aa2 service nova] Acquiring lock "7348b004-4d46-4db5-a451-afd3b7476569-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-fe4ca69f-0b9d-41b4-aeec-632473a449a1 req-29f4924d-7e8f-4eae-8d0b-d5378efb3aa2 service nova] Lock "7348b004-4d46-4db5-a451-afd3b7476569-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-fe4ca69f-0b9d-41b4-aeec-632473a449a1 req-29f4924d-7e8f-4eae-8d0b-d5378efb3aa2 service nova] Lock "7348b004-4d46-4db5-a451-afd3b7476569-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-fe4ca69f-0b9d-41b4-aeec-632473a449a1 req-29f4924d-7e8f-4eae-8d0b-d5378efb3aa2 service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] No waiting events found dispatching network-vif-unplugged-ca4312d6-790c-49f6-b6e5-dc3033d0d93f {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:39:40 user nova-compute[73484]: WARNING nova.compute.manager [req-fe4ca69f-0b9d-41b4-aeec-632473a449a1 req-29f4924d-7e8f-4eae-8d0b-d5378efb3aa2 service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Received unexpected event network-vif-unplugged-ca4312d6-790c-49f6-b6e5-dc3033d0d93f for instance with vm_state active and task_state None.
Aug 14 13:39:40 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-27ea6202-9b1d-4928-955a-abd9aa8cf596 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-27ea6202-9b1d-4928-955a-abd9aa8cf596 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:39:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-27ea6202-9b1d-4928-955a-abd9aa8cf596 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:40 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-27ea6202-9b1d-4928-955a-abd9aa8cf596 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Deleted allocations for instance 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf
Aug 14 13:39:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-27ea6202-9b1d-4928-955a-abd9aa8cf596 tempest-AttachSCSIVolumeTestJSON-558500768 tempest-AttachSCSIVolumeTestJSON-558500768-project-member] Lock "96025e5d-7c98-4ed4-8180-7c2cdb1d65bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.770s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Acquiring lock "refresh_cache-7348b004-4d46-4db5-a451-afd3b7476569" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:39:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Acquired lock "refresh_cache-7348b004-4d46-4db5-a451-afd3b7476569" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:39:41 user nova-compute[73484]: DEBUG nova.network.neutron [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:39:41 user nova-compute[73484]: INFO nova.network.neutron [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Port ca4312d6-790c-49f6-b6e5-dc3033d0d93f from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 14 13:39:41 user nova-compute[73484]: DEBUG nova.network.neutron [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Updating instance_info_cache with network_info: [{"id": "2eb5bc00-16a1-43cd-ac1f-db1d191fba75", "address": "fa:16:3e:a3:34:4e", "network": {"id": "06967e28-4529-4bb4-913e-406da0cbf817", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-360793833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "900fe242d672495d832feee598acf991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb5bc00-16", "ovs_interfaceid": "2eb5bc00-16a1-43cd-ac1f-db1d191fba75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:39:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Releasing lock "refresh_cache-7348b004-4d46-4db5-a451-afd3b7476569" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:39:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2c5eed1c-e179-4bf4-835d-bff728f76af1 tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "interface-7348b004-4d46-4db5-a451-afd3b7476569-ca4312d6-790c-49f6-b6e5-dc3033d0d93f" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.712s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:42 user nova-compute[73484]: DEBUG nova.compute.manager [req-39d8037b-7a3e-442b-ad7c-0d69633d9feb req-22b74ac2-08f1-49fc-9315-de34bef3dd7f service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Received event network-vif-deleted-ca4312d6-790c-49f6-b6e5-dc3033d0d93f {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:42 user nova-compute[73484]: DEBUG nova.compute.manager [req-3c58513a-2d5b-4269-8a05-2ebc79c39f71 req-b19f54d1-3cd7-4628-8636-b64b984022c7 service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Received event network-vif-plugged-ca4312d6-790c-49f6-b6e5-dc3033d0d93f {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3c58513a-2d5b-4269-8a05-2ebc79c39f71 req-b19f54d1-3cd7-4628-8636-b64b984022c7 service nova] Acquiring lock "7348b004-4d46-4db5-a451-afd3b7476569-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3c58513a-2d5b-4269-8a05-2ebc79c39f71 req-b19f54d1-3cd7-4628-8636-b64b984022c7 service nova] Lock "7348b004-4d46-4db5-a451-afd3b7476569-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3c58513a-2d5b-4269-8a05-2ebc79c39f71 req-b19f54d1-3cd7-4628-8636-b64b984022c7 service nova] Lock "7348b004-4d46-4db5-a451-afd3b7476569-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:42 user nova-compute[73484]: DEBUG nova.compute.manager [req-3c58513a-2d5b-4269-8a05-2ebc79c39f71 req-b19f54d1-3cd7-4628-8636-b64b984022c7 service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] No waiting events found dispatching network-vif-plugged-ca4312d6-790c-49f6-b6e5-dc3033d0d93f {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:39:42 user nova-compute[73484]: WARNING nova.compute.manager [req-3c58513a-2d5b-4269-8a05-2ebc79c39f71 req-b19f54d1-3cd7-4628-8636-b64b984022c7 service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Received unexpected event network-vif-plugged-ca4312d6-790c-49f6-b6e5-dc3033d0d93f for instance with vm_state active and task_state None.
Aug 14 13:39:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG nova.compute.manager [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EpvxaGLg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7ac05f68-a20f-4a57-b990-ef0799aadc58', 'attached_at': '', 'detached_at': '', 'volume_id': '3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4', 'serial': '3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'matSGeRK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '7ac05f68-a20f-4a57-b990-ef0799aadc58', 'attached_at': '', 'detached_at': '', 'volume_id': 'b74c54bf-81bc-4b2a-9dc3-c7186d64df0e', 'serial'} {{(pid=73484) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EpvxaGLg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:39:44 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:39:44 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:39:44 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:39:44 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:39:44 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea18f2eb-fbbb-458b-832d-2668e4cb8a8a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:39:44 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd15c66-7bb3-4dac-ab9f-e7b38ad9e89e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4] added
Aug 14 13:39:44 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c548c201-2fa8-4976-95aa-d63a006634b9]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2d637d-614c-486d-ab09-28a7ea6b6d8d]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EpvxaGLg {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EpvxaGLg" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b4ce80-db3d-47a4-bbea-327369c32fc8]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EpvxaGLg'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fca58c7-9b01-4388-aa4a-e84f3d428ec5]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdca3a6-aa5b-4dcb-9d80-90b93ae41b2e]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:44 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:44 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:44 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:44 user nova-compute[73484]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:39:44 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:44 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:44 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:44 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:44 user nova-compute[73484]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:39:44 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[08aaa10f-2f2b-4270-8833-ccb3bd6ba21f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4, portal: 172.16.0.220,3260]
Aug 14 13:39:44 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4, portal: 172.16.0.220,3260] successful.
Aug 14 13:39:44 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bf10b1-4364-4ad3-b3b8-4f2b78ded3ab]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ca4c31-033f-473b-a4c9-ea8dd505fb7f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 (non-flash)
Aug 14 13:39:44 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:44 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:44 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:44 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:44 user nova-compute[73484]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:39:44 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 (non-flash)
Aug 14 13:39:44 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:44 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:44 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:44 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:44 user nova-compute[73484]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:39:44 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8da202-0e74-4a0b-b130-f46f361487b1]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:44 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: None {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:39:45 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:39:45 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EpvxaGLg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:39:45 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:39:45 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23564353361383033', 'path': '/dev/sdb'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:39:45 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564353361383033', 'path': '/dev/sdb'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:39:45 user nova-compute[73484]: DEBUG nova.objects.instance [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Lazy-loading 'flavor' on Instance uuid 7ac05f68-a20f-4a57-b990-ef0799aadc58 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:39:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:45 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] COPY block job progress, current cursor: 8388608 final cursor: 1073741824 {{(pid=73484) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 13:39:46 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] COPY block job progress, current cursor: 101711872 final cursor: 1073741824 {{(pid=73484) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 13:39:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] COPY block job progress, current cursor: 183500800 final cursor: 1073741824 {{(pid=73484) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 13:39:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:47 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692020372.1752944, eaaccbea-d453-4943-9663-949c66029d87 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:39:47 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: eaaccbea-d453-4943-9663-949c66029d87] VM Stopped (Lifecycle Event)
Aug 14 13:39:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-532a1a0d-1fd7-4b4b-81bb-8ae59106c341 None None] [instance: eaaccbea-d453-4943-9663-949c66029d87] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:39:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:39:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:47 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:39:47 user nova-compute[73484]: INFO nova.compute.claims [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Claim successful on node user
Aug 14 13:39:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] COPY block job progress, current cursor: 356515840 final cursor: 1073741824 {{(pid=73484) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 13:39:48 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:39:48 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:39:48 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] COPY block job progress, current cursor: 508559360 final cursor: 1073741824 {{(pid=73484) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 13:39:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.664s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:48 user nova-compute[73484]: DEBUG nova.compute.manager [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:39:48 user nova-compute[73484]: DEBUG nova.compute.manager [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:39:48 user nova-compute[73484]: DEBUG nova.network.neutron [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:39:48 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:39:48 user nova-compute[73484]: DEBUG nova.compute.manager [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:39:48 user nova-compute[73484]: INFO nova.virt.block_device [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Booting with blank volume at /dev/vda
Aug 14 13:39:48 user nova-compute[73484]: DEBUG nova.policy [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a0f55ad018d4c0ca587d8bdd40df4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c7f2c51c0f84bf1aedcf493a9ff860f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:39:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:48 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] COPY block job progress, current cursor: 675282944 final cursor: 1073741824 {{(pid=73484) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 13:39:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] COPY block job progress, current cursor: 828375040 final cursor: 1073741824 {{(pid=73484) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 13:39:49 user nova-compute[73484]: DEBUG nova.network.neutron [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Successfully created port: a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:39:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] COPY block job progress, current cursor: 991952896 final cursor: 1073741824 {{(pid=73484) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73484) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG nova.network.neutron [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Successfully updated port: a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "refresh_cache-a9d4ec42-3db9-439b-87a7-02bcaab514a4" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquired lock "refresh_cache-a9d4ec42-3db9-439b-87a7-02bcaab514a4" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG nova.network.neutron [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG nova.compute.manager [req-22688bdd-53a2-4238-96b9-7aeb15933be3 req-b28a9355-ee2f-457f-83f3-dbce09950ef9 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Received event network-changed-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG nova.compute.manager [req-22688bdd-53a2-4238-96b9-7aeb15933be3 req-b28a9355-ee2f-457f-83f3-dbce09950ef9 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Refreshing instance network info cache due to event network-changed-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-22688bdd-53a2-4238-96b9-7aeb15933be3 req-b28a9355-ee2f-457f-83f3-dbce09950ef9 service nova] Acquiring lock "refresh_cache-a9d4ec42-3db9-439b-87a7-02bcaab514a4" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'matSGeRK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:39:50 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:39:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG nova.network.neutron [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6e33f0-1bc7-41a3-bd20-7378360a3577]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d85bbae-7300-4ff8-a71b-4344c0b95fe7]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 (non-flash)
Aug 14 13:39:50 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:50 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:50 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:50 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:50 user nova-compute[73484]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:39:50 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 (non-flash)
Aug 14 13:39:50 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:50 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:50 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:50 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:50 user nova-compute[73484]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:39:50 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4951ca710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e'): ({'sdi'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Removing single pathed devices sdi {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[948cc254-065e-4cf4-865a-67e9a0b15027]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce44fb3c-b65a-48fe-b53b-8513fe63651b]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Flushing IO for device /dev/sdi {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[703dfd45-62a7-4928-b249-c4c0395b8128]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.039s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d954b7-c487-4d1d-ab89-3d537653dd3e]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] SCSI volumes sdi have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ac41ee-3ad5-43c1-aa38-6bc1164b365e]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dba612-32a7-41cf-b06c-9a86302f4ddb]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e, portal: 172.16.0.220,3260]
Aug 14 13:39:50 user nova-compute[73484]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e, portal: 172.16.0.220,3260] successful.
Aug 14 13:39:50 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e1ed03-1c3d-409d-a740-1fa0132691af]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] <== disconnect_volume: return (333ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG nova.compute.manager [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EpvxaGLg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '7ac05f68-a20f-4a57-b990-ef0799aadc58', 'attached_at': '', 'detached_at': '', 'volume_id': '3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4', 'serial'} {{(pid=73484) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG nova.compute.manager [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] swap_volume: removing Cinder connection for volume b74c54bf-81bc-4b2a-9dc3-c7186d64df0e {{(pid=73484) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG nova.network.neutron [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Updating instance_info_cache with network_info: [{"id": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "address": "fa:16:3e:a8:f5:8b", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa109f4ac-a7", "ovs_interfaceid": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Releasing lock "refresh_cache-a9d4ec42-3db9-439b-87a7-02bcaab514a4" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG nova.compute.manager [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Instance network_info: |[{"id": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "address": "fa:16:3e:a8:f5:8b", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa109f4ac-a7", "ovs_interfaceid": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-22688bdd-53a2-4238-96b9-7aeb15933be3 req-b28a9355-ee2f-457f-83f3-dbce09950ef9 service nova] Acquired lock "refresh_cache-a9d4ec42-3db9-439b-87a7-02bcaab514a4" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:39:50 user nova-compute[73484]: DEBUG nova.network.neutron [req-22688bdd-53a2-4238-96b9-7aeb15933be3 req-b28a9355-ee2f-457f-83f3-dbce09950ef9 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Refreshing network info cache for port a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:39:51 user nova-compute[73484]: DEBUG nova.network.neutron [req-22688bdd-53a2-4238-96b9-7aeb15933be3 req-b28a9355-ee2f-457f-83f3-dbce09950ef9 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Updated VIF entry in instance network info cache for port a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:39:51 user nova-compute[73484]: DEBUG nova.network.neutron [req-22688bdd-53a2-4238-96b9-7aeb15933be3 req-b28a9355-ee2f-457f-83f3-dbce09950ef9 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Updating instance_info_cache with network_info: [{"id": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "address": "fa:16:3e:a8:f5:8b", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa109f4ac-a7", "ovs_interfaceid": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:39:51 user nova-compute[73484]: DEBUG nova.compute.manager [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] swap_volume: Updating volume b74c54bf-81bc-4b2a-9dc3-c7186d64df0e BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "EpvxaGLg", "auth_password": "WPGva425oBCSxJ", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4"}, "status": "reserved", "instance": "7ac05f68-a20f-4a57-b990-ef0799aadc58", "attached_at": "", "detached_at": "", "volume_id": "3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4", "serial": "3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4', 'no_device': None, 'attachment_id': 'e562b0d8-1338-4dd7-a0a8-56b59ac61470'} {{(pid=73484) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 14 13:39:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-22688bdd-53a2-4238-96b9-7aeb15933be3 req-b28a9355-ee2f-457f-83f3-dbce09950ef9 service nova] Releasing lock "refresh_cache-a9d4ec42-3db9-439b-87a7-02bcaab514a4" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:39:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-93ff678b-36d9-42c0-b878-de6544216f26 tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Lock "7ac05f68-a20f-4a57-b990-ef0799aadc58" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.967s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:53 user nova-compute[73484]: DEBUG nova.compute.manager [req-8bb85d37-8c06-47c0-847b-d1bd501ec09e req-f76db4a0-4b77-43d4-aaa7-da1d65a43307 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-changed-876f74d5-7991-4068-8fa4-625ac7cc3d22 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:53 user nova-compute[73484]: DEBUG nova.compute.manager [req-8bb85d37-8c06-47c0-847b-d1bd501ec09e req-f76db4a0-4b77-43d4-aaa7-da1d65a43307 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Refreshing instance network info cache due to event network-changed-876f74d5-7991-4068-8fa4-625ac7cc3d22. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:39:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8bb85d37-8c06-47c0-847b-d1bd501ec09e req-f76db4a0-4b77-43d4-aaa7-da1d65a43307 service nova] Acquiring lock "refresh_cache-18feef86-7a18-43e3-80cb-fb1d01d34d49" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:39:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8bb85d37-8c06-47c0-847b-d1bd501ec09e req-f76db4a0-4b77-43d4-aaa7-da1d65a43307 service nova] Acquired lock "refresh_cache-18feef86-7a18-43e3-80cb-fb1d01d34d49" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:39:53 user nova-compute[73484]: DEBUG nova.network.neutron [req-8bb85d37-8c06-47c0-847b-d1bd501ec09e req-f76db4a0-4b77-43d4-aaa7-da1d65a43307 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Refreshing network info cache for port 876f74d5-7991-4068-8fa4-625ac7cc3d22 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:39:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Acquiring lock "7ac05f68-a20f-4a57-b990-ef0799aadc58" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Lock "7ac05f68-a20f-4a57-b990-ef0799aadc58" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:53 user nova-compute[73484]: DEBUG os_brick.utils [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:39:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:53 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f72507-6daa-4698-9384-834f3fac9a16]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:53 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f264bd33-fa20-4551-9bae-329798fde909]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:53 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a7739c-60cf-4e53-85d5-c5c8891c3032]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:53 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[30622035-9e02-4940-a34e-5a0400ce43a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:39:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:39:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:39:53 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:39:53 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d260d41-27a2-4edd-86b7-28a850a07990]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:39:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:39:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:39:53 user nova-compute[73484]: DEBUG os_brick.utils [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:39:53 user nova-compute[73484]: INFO nova.compute.manager [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Swapping volume 3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 for b74c54bf-81bc-4b2a-9dc3-c7186d64df0e
Aug 14 13:39:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Acquiring lock "856807c9-af22-4be7-834e-2d7003329f8c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Lock "856807c9-af22-4be7-834e-2d7003329f8c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:54 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692020379.0373132, 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:39:54 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] VM Stopped (Lifecycle Event)
Aug 14 13:39:54 user nova-compute[73484]: DEBUG nova.network.neutron [req-8bb85d37-8c06-47c0-847b-d1bd501ec09e req-f76db4a0-4b77-43d4-aaa7-da1d65a43307 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Updated VIF entry in instance network info cache for port 876f74d5-7991-4068-8fa4-625ac7cc3d22. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:39:54 user nova-compute[73484]: DEBUG nova.network.neutron [req-8bb85d37-8c06-47c0-847b-d1bd501ec09e req-f76db4a0-4b77-43d4-aaa7-da1d65a43307 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Updating instance_info_cache with network_info: [{"id": "876f74d5-7991-4068-8fa4-625ac7cc3d22", "address": "fa:16:3e:66:68:cc", "network": {"id": "1a9b1894-c8aa-4c1c-a1dc-70f91e648b89", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1258957124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap876f74d5-79", "ovs_interfaceid": "876f74d5-7991-4068-8fa4-625ac7cc3d22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "32ed41f4-a698-4873-98aa-ab0a08e09ad1", "address": "fa:16:3e:61:3b:99", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32ed41f4-a6", "ovs_interfaceid": "32ed41f4-a698-4873-98aa-ab0a08e09ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44be0321-53ca-43af-9af4-35ed291d2695", "address": "fa:16:3e:1f:78:bf", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44be0321-53", "ovs_interfaceid": "44be0321-53ca-43af-9af4-35ed291d2695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "29ec01c6-3b25-4dfa-a9de-5474a29d0c5e", "address": "fa:16:3e:90:ec:d6", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec01c6-3b", "ovs_interfaceid": "29ec01c6-3b25-4dfa-a9de-5474a29d0c5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9672687d-4ab3-4b9d-886b-fc73d8f551d6", "address": "fa:16:3e:7f:7d:8d", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9672687d-4a", "ovs_interfaceid": "9672687d-4ab3-4b9d-886b-fc73d8f551d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "489a48ce-8925-499b-a234-c92c2d760375", "address": "fa:16:3e:b9:d7:ad", "network": {"id": "6811ba1b-eff5-4665-8046-cfb393845d13", "bridge": "br-int", "label": "tempest-device-tagging-net2-585065546", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap489a48ce-89", "ovs_interfaceid": "489a48ce-8925-499b-a234-c92c2d760375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d", "address": "fa:16:3e:5d:7d:d6", "network": {"id": "6811ba1b-eff5-4665-8046-cfb393845d13", "bridge": "br-int", "label": "tempest-device-tagging-net2-585065546", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e1d6f8-1c", "ovs_interfaceid": "a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:39:54 user nova-compute[73484]: DEBUG nova.compute.manager [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:39:54 user nova-compute[73484]: DEBUG nova.compute.manager [None req-3bec3f24-c63a-4897-80e7-daff2153718a None None] [instance: 96025e5d-7c98-4ed4-8180-7c2cdb1d65bf] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:39:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8bb85d37-8c06-47c0-847b-d1bd501ec09e req-f76db4a0-4b77-43d4-aaa7-da1d65a43307 service nova] Releasing lock "refresh_cache-18feef86-7a18-43e3-80cb-fb1d01d34d49" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:39:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:54 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:39:54 user nova-compute[73484]: INFO nova.compute.claims [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Claim successful on node user
Aug 14 13:39:54 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:39:54 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:39:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:54 user nova-compute[73484]: DEBUG nova.compute.manager [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:39:54 user nova-compute[73484]: DEBUG nova.compute.manager [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:39:54 user nova-compute[73484]: DEBUG nova.network.neutron [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:39:54 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:39:54 user nova-compute[73484]: DEBUG nova.compute.manager [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:39:54 user nova-compute[73484]: DEBUG nova.policy [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b10546863791489591e53a730bb66b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bd52d9b486b418687c2c40a72449b92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:39:54 user nova-compute[73484]: DEBUG nova.compute.manager [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:39:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:39:54 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Creating image(s)
Aug 14 13:39:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Acquiring lock "/opt/stack/data/nova/instances/856807c9-af22-4be7-834e-2d7003329f8c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Lock "/opt/stack/data/nova/instances/856807c9-af22-4be7-834e-2d7003329f8c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Lock "/opt/stack/data/nova/instances/856807c9-af22-4be7-834e-2d7003329f8c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.221s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.171s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/856807c9-af22-4be7-834e-2d7003329f8c/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/856807c9-af22-4be7-834e-2d7003329f8c/disk 1073741824" returned: 0 in 0.047s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:55 user nova-compute[73484]: DEBUG nova.network.neutron [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Successfully created port: 59f1948e-70b8-4051-bda8-44296770add6 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:39:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.191s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:55 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Checking if we can resize image /opt/stack/data/nova/instances/856807c9-af22-4be7-834e-2d7003329f8c/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:39:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856807c9-af22-4be7-834e-2d7003329f8c/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856807c9-af22-4be7-834e-2d7003329f8c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:55 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Cannot resize image /opt/stack/data/nova/instances/856807c9-af22-4be7-834e-2d7003329f8c/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:39:55 user nova-compute[73484]: DEBUG nova.objects.instance [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Lazy-loading 'migration_context' on Instance uuid 856807c9-af22-4be7-834e-2d7003329f8c {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:39:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:39:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Ensure instance console log exists: /opt/stack/data/nova/instances/856807c9-af22-4be7-834e-2d7003329f8c/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:39:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Acquiring lock "18feef86-7a18-43e3-80cb-fb1d01d34d49" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Acquiring lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:56 user nova-compute[73484]: INFO nova.compute.manager [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Terminating instance
Aug 14 13:39:56 user nova-compute[73484]: DEBUG nova.compute.manager [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG nova.compute.manager [req-b27037f6-cbba-444a-b6df-a924dfb128e8 req-e1401cac-1e60-4936-b77c-bca1f5277525 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-unplugged-876f74d5-7991-4068-8fa4-625ac7cc3d22 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b27037f6-cbba-444a-b6df-a924dfb128e8 req-e1401cac-1e60-4936-b77c-bca1f5277525 service nova] Acquiring lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b27037f6-cbba-444a-b6df-a924dfb128e8 req-e1401cac-1e60-4936-b77c-bca1f5277525 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b27037f6-cbba-444a-b6df-a924dfb128e8 req-e1401cac-1e60-4936-b77c-bca1f5277525 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG nova.compute.manager [req-b27037f6-cbba-444a-b6df-a924dfb128e8 req-e1401cac-1e60-4936-b77c-bca1f5277525 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] No waiting events found dispatching network-vif-unplugged-876f74d5-7991-4068-8fa4-625ac7cc3d22 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG nova.compute.manager [req-b27037f6-cbba-444a-b6df-a924dfb128e8 req-e1401cac-1e60-4936-b77c-bca1f5277525 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-unplugged-876f74d5-7991-4068-8fa4-625ac7cc3d22 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG nova.compute.manager [req-64ec22ad-1a88-4173-bf1d-912d3c91fad1 req-75e463f3-2179-4562-88a3-18dd7ac3c40c service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-unplugged-29ec01c6-3b25-4dfa-a9de-5474a29d0c5e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-64ec22ad-1a88-4173-bf1d-912d3c91fad1 req-75e463f3-2179-4562-88a3-18dd7ac3c40c service nova] Acquiring lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-64ec22ad-1a88-4173-bf1d-912d3c91fad1 req-75e463f3-2179-4562-88a3-18dd7ac3c40c service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-64ec22ad-1a88-4173-bf1d-912d3c91fad1 req-75e463f3-2179-4562-88a3-18dd7ac3c40c service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG nova.compute.manager [req-64ec22ad-1a88-4173-bf1d-912d3c91fad1 req-75e463f3-2179-4562-88a3-18dd7ac3c40c service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] No waiting events found dispatching network-vif-unplugged-29ec01c6-3b25-4dfa-a9de-5474a29d0c5e {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG nova.compute.manager [req-64ec22ad-1a88-4173-bf1d-912d3c91fad1 req-75e463f3-2179-4562-88a3-18dd7ac3c40c service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-unplugged-29ec01c6-3b25-4dfa-a9de-5474a29d0c5e for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG nova.compute.manager [req-ec28beb3-fcf9-446e-ade4-b84cde230caf req-9792f17f-e15f-424d-b67d-f3be468a913a service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-unplugged-32ed41f4-a698-4873-98aa-ab0a08e09ad1 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ec28beb3-fcf9-446e-ade4-b84cde230caf req-9792f17f-e15f-424d-b67d-f3be468a913a service nova] Acquiring lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ec28beb3-fcf9-446e-ade4-b84cde230caf req-9792f17f-e15f-424d-b67d-f3be468a913a service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ec28beb3-fcf9-446e-ade4-b84cde230caf req-9792f17f-e15f-424d-b67d-f3be468a913a service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG nova.compute.manager [req-ec28beb3-fcf9-446e-ade4-b84cde230caf req-9792f17f-e15f-424d-b67d-f3be468a913a service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] No waiting events found dispatching network-vif-unplugged-32ed41f4-a698-4873-98aa-ab0a08e09ad1 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG nova.compute.manager [req-ec28beb3-fcf9-446e-ade4-b84cde230caf req-9792f17f-e15f-424d-b67d-f3be468a913a service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-unplugged-32ed41f4-a698-4873-98aa-ab0a08e09ad1 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG nova.network.neutron [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Successfully updated port: 59f1948e-70b8-4051-bda8-44296770add6 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Acquiring lock "refresh_cache-856807c9-af22-4be7-834e-2d7003329f8c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Acquired lock "refresh_cache-856807c9-af22-4be7-834e-2d7003329f8c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG nova.network.neutron [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:39:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG nova.network.neutron [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG nova.network.neutron [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Updating instance_info_cache with network_info: [{"id": "59f1948e-70b8-4051-bda8-44296770add6", "address": "fa:16:3e:c8:e6:56", "network": {"id": "25df0ef0-3c04-4a7d-840e-6f556ebd1dbc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a23940f0738942409fd00984c52e7e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f1948e-70", "ovs_interfaceid": "59f1948e-70b8-4051-bda8-44296770add6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Releasing lock "refresh_cache-856807c9-af22-4be7-834e-2d7003329f8c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Instance network_info: |[{"id": "59f1948e-70b8-4051-bda8-44296770add6", "address": "fa:16:3e:c8:e6:56", "network": {"id": "25df0ef0-3c04-4a7d-840e-6f556ebd1dbc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a23940f0738942409fd00984c52e7e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f1948e-70", "ovs_interfaceid": "59f1948e-70b8-4051-bda8-44296770add6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Start _get_guest_xml network_info=[{"id": "59f1948e-70b8-4051-bda8-44296770add6", "address": "fa:16:3e:c8:e6:56", "network": {"id": "25df0ef0-3c04-4a7d-840e-6f556ebd1dbc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a23940f0738942409fd00984c52e7e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f1948e-70", "ovs_interfaceid": "59f1948e-70b8-4051-bda8-44296770add6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:39:57 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:39:57 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:39:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:39:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2017245773',display_name='tempest-VolumesNegativeTest-instance-2017245773',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2017245773',id=13,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bd52d9b486b418687c2c40a72449b92',ramdisk_id='',reservation_id='r-019mb11d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-559064245',owner_user_name='tempest-VolumesNegativeTest-559064245-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:39:55Z,user_data=None,user_id='b10546863791489591e53a730bb66b18',uuid=856807c9-af22-4be7-834e-2d7003329f8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59f1948e-70b8-4051-bda8-44296770add6", "address": "fa:16:3e:c8:e6:56", "network": {"id": "25df0ef0-3c04-4a7d-840e-6f556ebd1dbc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a23940f0738942409fd00984c52e7e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f1948e-70", "ovs_interfaceid": "59f1948e-70b8-4051-bda8-44296770add6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Converting VIF {"id": "59f1948e-70b8-4051-bda8-44296770add6", "address": "fa:16:3e:c8:e6:56", "network": {"id": "25df0ef0-3c04-4a7d-840e-6f556ebd1dbc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a23940f0738942409fd00984c52e7e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f1948e-70", "ovs_interfaceid": "59f1948e-70b8-4051-bda8-44296770add6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:e6:56,bridge_name='br-int',has_traffic_filtering=True,id=59f1948e-70b8-4051-bda8-44296770add6,network=Network(25df0ef0-3c04-4a7d-840e-6f556ebd1dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59f1948e-70') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG nova.objects.instance [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Lazy-loading 'pci_devices' on Instance uuid 856807c9-af22-4be7-834e-2d7003329f8c {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:39:57 user nova-compute[73484]:   <uuid>856807c9-af22-4be7-834e-2d7003329f8c</uuid>
Aug 14 13:39:57 user nova-compute[73484]:   <name>instance-0000000d</name>
Aug 14 13:39:57 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:39:57 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:39:57 user nova-compute[73484]:   <metadata>
Aug 14 13:39:57 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:39:57 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:39:57 user nova-compute[73484]:       <nova:name>tempest-VolumesNegativeTest-instance-2017245773</nova:name>
Aug 14 13:39:57 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:39:57</nova:creationTime>
Aug 14 13:39:57 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:39:57 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:39:57 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:39:57 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:39:57 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:39:57 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:39:57 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:39:57 user nova-compute[73484]:       <nova:owner>
Aug 14 13:39:57 user nova-compute[73484]:         <nova:user uuid="b10546863791489591e53a730bb66b18">tempest-VolumesNegativeTest-559064245-project-member</nova:user>
Aug 14 13:39:57 user nova-compute[73484]:         <nova:project uuid="2bd52d9b486b418687c2c40a72449b92">tempest-VolumesNegativeTest-559064245</nova:project>
Aug 14 13:39:57 user nova-compute[73484]:       </nova:owner>
Aug 14 13:39:57 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:39:57 user nova-compute[73484]:       <nova:ports>
Aug 14 13:39:57 user nova-compute[73484]:         <nova:port uuid="59f1948e-70b8-4051-bda8-44296770add6">
Aug 14 13:39:57 user nova-compute[73484]:           <nova:ip type="fixed" address="192.168.233.181" ipVersion="4"/>
Aug 14 13:39:57 user nova-compute[73484]:         </nova:port>
Aug 14 13:39:57 user nova-compute[73484]:       </nova:ports>
Aug 14 13:39:57 user nova-compute[73484]:     </nova:instance>
Aug 14 13:39:57 user nova-compute[73484]:   </metadata>
Aug 14 13:39:57 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:39:57 user nova-compute[73484]:     <system>
Aug 14 13:39:57 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:39:57 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:39:57 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:39:57 user nova-compute[73484]:       <entry name="serial">856807c9-af22-4be7-834e-2d7003329f8c</entry>
Aug 14 13:39:57 user nova-compute[73484]:       <entry name="uuid">856807c9-af22-4be7-834e-2d7003329f8c</entry>
Aug 14 13:39:57 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:39:57 user nova-compute[73484]:     </system>
Aug 14 13:39:57 user nova-compute[73484]:   </sysinfo>
Aug 14 13:39:57 user nova-compute[73484]:   <os>
Aug 14 13:39:57 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:39:57 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:39:57 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:39:57 user nova-compute[73484]:   </os>
Aug 14 13:39:57 user nova-compute[73484]:   <features>
Aug 14 13:39:57 user nova-compute[73484]:     <acpi/>
Aug 14 13:39:57 user nova-compute[73484]:     <apic/>
Aug 14 13:39:57 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:39:57 user nova-compute[73484]:   </features>
Aug 14 13:39:57 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:39:57 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:39:57 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:39:57 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:39:57 user nova-compute[73484]:   </clock>
Aug 14 13:39:57 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:39:57 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:39:57 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:39:57 user nova-compute[73484]:   </cpu>
Aug 14 13:39:57 user nova-compute[73484]:   <devices>
Aug 14 13:39:57 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:39:57 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:39:57 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/856807c9-af22-4be7-834e-2d7003329f8c/disk"/>
Aug 14 13:39:57 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:39:57 user nova-compute[73484]:     </disk>
Aug 14 13:39:57 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:39:57 user nova-compute[73484]:       <mac address="fa:16:3e:c8:e6:56"/>
Aug 14 13:39:57 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:39:57 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:39:57 user nova-compute[73484]:       <target dev="tap59f1948e-70"/>
Aug 14 13:39:57 user nova-compute[73484]:     </interface>
Aug 14 13:39:57 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:39:57 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/856807c9-af22-4be7-834e-2d7003329f8c/console.log" append="off"/>
Aug 14 13:39:57 user nova-compute[73484]:     </serial>
Aug 14 13:39:57 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:39:57 user nova-compute[73484]:     <video>
Aug 14 13:39:57 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:39:57 user nova-compute[73484]:     </video>
Aug 14 13:39:57 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:39:57 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:39:57 user nova-compute[73484]:     </rng>
Aug 14 13:39:57 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:39:57 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:39:57 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:39:57 user nova-compute[73484]:     </memballoon>
Aug 14 13:39:57 user nova-compute[73484]:   </devices>
Aug 14 13:39:57 user nova-compute[73484]: </domain>
Aug 14 13:39:57 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:39:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2017245773',display_name='tempest-VolumesNegativeTest-instance-2017245773',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2017245773',id=13,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bd52d9b486b418687c2c40a72449b92',ramdisk_id='',reservation_id='r-019mb11d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-559064245',owner_user_name='tempest-VolumesNegativeTest-559064245-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:39:55Z,user_data=None,user_id='b10546863791489591e53a730bb66b18',uuid=856807c9-af22-4be7-834e-2d7003329f8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59f1948e-70b8-4051-bda8-44296770add6", "address": "fa:16:3e:c8:e6:56", "network": {"id": "25df0ef0-3c04-4a7d-840e-6f556ebd1dbc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a23940f0738942409fd00984c52e7e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f1948e-70", "ovs_interfaceid": "59f1948e-70b8-4051-bda8-44296770add6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Converting VIF {"id": "59f1948e-70b8-4051-bda8-44296770add6", "address": "fa:16:3e:c8:e6:56", "network": {"id": "25df0ef0-3c04-4a7d-840e-6f556ebd1dbc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a23940f0738942409fd00984c52e7e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f1948e-70", "ovs_interfaceid": "59f1948e-70b8-4051-bda8-44296770add6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:e6:56,bridge_name='br-int',has_traffic_filtering=True,id=59f1948e-70b8-4051-bda8-44296770add6,network=Network(25df0ef0-3c04-4a7d-840e-6f556ebd1dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59f1948e-70') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG os_vif [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:e6:56,bridge_name='br-int',has_traffic_filtering=True,id=59f1948e-70b8-4051-bda8-44296770add6,network=Network(25df0ef0-3c04-4a7d-840e-6f556ebd1dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59f1948e-70') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59f1948e-70, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap59f1948e-70, col_values=(('external_ids', {'iface-id': '59f1948e-70b8-4051-bda8-44296770add6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:e6:56', 'vm-uuid': '856807c9-af22-4be7-834e-2d7003329f8c'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:57 user nova-compute[73484]: INFO os_vif [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:e6:56,bridge_name='br-int',has_traffic_filtering=True,id=59f1948e-70b8-4051-bda8-44296770add6,network=Network(25df0ef0-3c04-4a7d-840e-6f556ebd1dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59f1948e-70')
Aug 14 13:39:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:39:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] No VIF found with MAC fa:16:3e:c8:e6:56, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:39:58 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Instance destroyed successfully.
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.objects.instance [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lazy-loading 'resources' on Instance uuid 18feef86-7a18-43e3-80cb-fb1d01d34d49 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2091684054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2091684054',id=11,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYASXzOIIlX/renwy9P0bMTWnWqPwOvzELOuBlfAnHxtG8LsZBf1zV7H5dtd1aUubmLnuJxpB35cdMemRlWnH5SWrsXQBfo+vfoJ3yW+4lUfLxww0fOBI3IslW2hj3X2w==',key_name='tempest-keypair-575416246',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:38:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16a61399aa994f3b890de6ad50d91d6b',ramdisk_id='',reservation_id='r-yn3od48m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2119808848',owner_user_name='tempest-TaggedBootDevicesTest_v242-2119808848-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2355c1d4bfcb475ca72fbc555e38f6f7',uuid=18feef86-7a18-43e3-80cb-fb1d01d34d49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "876f74d5-7991-4068-8fa4-625ac7cc3d22", "address": "fa:16:3e:66:68:cc", "network": {"id": "1a9b1894-c8aa-4c1c-a1dc-70f91e648b89", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1258957124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap876f74d5-79", "ovs_interfaceid": "876f74d5-7991-4068-8fa4-625ac7cc3d22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converting VIF {"id": "876f74d5-7991-4068-8fa4-625ac7cc3d22", "address": "fa:16:3e:66:68:cc", "network": {"id": "1a9b1894-c8aa-4c1c-a1dc-70f91e648b89", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1258957124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap876f74d5-79", "ovs_interfaceid": "876f74d5-7991-4068-8fa4-625ac7cc3d22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:68:cc,bridge_name='br-int',has_traffic_filtering=True,id=876f74d5-7991-4068-8fa4-625ac7cc3d22,network=Network(1a9b1894-c8aa-4c1c-a1dc-70f91e648b89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap876f74d5-79') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG os_vif [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:68:cc,bridge_name='br-int',has_traffic_filtering=True,id=876f74d5-7991-4068-8fa4-625ac7cc3d22,network=Network(1a9b1894-c8aa-4c1c-a1dc-70f91e648b89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap876f74d5-79') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap876f74d5-79, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:58 user nova-compute[73484]: INFO os_vif [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:68:cc,bridge_name='br-int',has_traffic_filtering=True,id=876f74d5-7991-4068-8fa4-625ac7cc3d22,network=Network(1a9b1894-c8aa-4c1c-a1dc-70f91e648b89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap876f74d5-79')
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2091684054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2091684054',id=11,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYASXzOIIlX/renwy9P0bMTWnWqPwOvzELOuBlfAnHxtG8LsZBf1zV7H5dtd1aUubmLnuJxpB35cdMemRlWnH5SWrsXQBfo+vfoJ3yW+4lUfLxww0fOBI3IslW2hj3X2w==',key_name='tempest-keypair-575416246',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:38:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16a61399aa994f3b890de6ad50d91d6b',ramdisk_id='',reservation_id='r-yn3od48m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2119808848',owner_user_name='tempest-TaggedBootDevicesTest_v242-2119808848-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2355c1d4bfcb475ca72fbc555e38f6f7',uuid=18feef86-7a18-43e3-80cb-fb1d01d34d49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32ed41f4-a698-4873-98aa-ab0a08e09ad1", "address": "fa:16:3e:61:3b:99", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32ed41f4-a6", "ovs_interfaceid": "32ed41f4-a698-4873-98aa-ab0a08e09ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converting VIF {"id": "32ed41f4-a698-4873-98aa-ab0a08e09ad1", "address": "fa:16:3e:61:3b:99", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32ed41f4-a6", "ovs_interfaceid": "32ed41f4-a698-4873-98aa-ab0a08e09ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:3b:99,bridge_name='br-int',has_traffic_filtering=True,id=32ed41f4-a698-4873-98aa-ab0a08e09ad1,network=Network(d684c792-0e3b-4523-865c-9a2d4cc25568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap32ed41f4-a6') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG os_vif [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:3b:99,bridge_name='br-int',has_traffic_filtering=True,id=32ed41f4-a698-4873-98aa-ab0a08e09ad1,network=Network(d684c792-0e3b-4523-865c-9a2d4cc25568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap32ed41f4-a6') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32ed41f4-a6, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:58 user nova-compute[73484]: INFO os_vif [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:3b:99,bridge_name='br-int',has_traffic_filtering=True,id=32ed41f4-a698-4873-98aa-ab0a08e09ad1,network=Network(d684c792-0e3b-4523-865c-9a2d4cc25568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap32ed41f4-a6')
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2091684054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2091684054',id=11,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYASXzOIIlX/renwy9P0bMTWnWqPwOvzELOuBlfAnHxtG8LsZBf1zV7H5dtd1aUubmLnuJxpB35cdMemRlWnH5SWrsXQBfo+vfoJ3yW+4lUfLxww0fOBI3IslW2hj3X2w==',key_name='tempest-keypair-575416246',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:38:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16a61399aa994f3b890de6ad50d91d6b',ramdisk_id='',reservation_id='r-yn3od48m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2119808848',owner_user_name='tempest-TaggedBootDevicesTest_v242-2119808848-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2355c1d4bfcb475ca72fbc555e38f6f7',uuid=18feef86-7a18-43e3-80cb-fb1d01d34d49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44be0321-53ca-43af-9af4-35ed291d2695", "address": "fa:16:3e:1f:78:bf", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44be0321-53", "ovs_interfaceid": "44be0321-53ca-43af-9af4-35ed291d2695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converting VIF {"id": "44be0321-53ca-43af-9af4-35ed291d2695", "address": "fa:16:3e:1f:78:bf", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44be0321-53", "ovs_interfaceid": "44be0321-53ca-43af-9af4-35ed291d2695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:78:bf,bridge_name='br-int',has_traffic_filtering=True,id=44be0321-53ca-43af-9af4-35ed291d2695,network=Network(d684c792-0e3b-4523-865c-9a2d4cc25568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44be0321-53') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG os_vif [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:78:bf,bridge_name='br-int',has_traffic_filtering=True,id=44be0321-53ca-43af-9af4-35ed291d2695,network=Network(d684c792-0e3b-4523-865c-9a2d4cc25568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44be0321-53') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44be0321-53, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:58 user nova-compute[73484]: INFO os_vif [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:78:bf,bridge_name='br-int',has_traffic_filtering=True,id=44be0321-53ca-43af-9af4-35ed291d2695,network=Network(d684c792-0e3b-4523-865c-9a2d4cc25568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44be0321-53')
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2091684054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2091684054',id=11,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYASXzOIIlX/renwy9P0bMTWnWqPwOvzELOuBlfAnHxtG8LsZBf1zV7H5dtd1aUubmLnuJxpB35cdMemRlWnH5SWrsXQBfo+vfoJ3yW+4lUfLxww0fOBI3IslW2hj3X2w==',key_name='tempest-keypair-575416246',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:38:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16a61399aa994f3b890de6ad50d91d6b',ramdisk_id='',reservation_id='r-yn3od48m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2119808848',owner_user_name='tempest-TaggedBootDevicesTest_v242-2119808848-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2355c1d4bfcb475ca72fbc555e38f6f7',uuid=18feef86-7a18-43e3-80cb-fb1d01d34d49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29ec01c6-3b25-4dfa-a9de-5474a29d0c5e", "address": "fa:16:3e:90:ec:d6", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec01c6-3b", "ovs_interfaceid": "29ec01c6-3b25-4dfa-a9de-5474a29d0c5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converting VIF {"id": "29ec01c6-3b25-4dfa-a9de-5474a29d0c5e", "address": "fa:16:3e:90:ec:d6", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec01c6-3b", "ovs_interfaceid": "29ec01c6-3b25-4dfa-a9de-5474a29d0c5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:ec:d6,bridge_name='br-int',has_traffic_filtering=True,id=29ec01c6-3b25-4dfa-a9de-5474a29d0c5e,network=Network(d684c792-0e3b-4523-865c-9a2d4cc25568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ec01c6-3b') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG os_vif [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:ec:d6,bridge_name='br-int',has_traffic_filtering=True,id=29ec01c6-3b25-4dfa-a9de-5474a29d0c5e,network=Network(d684c792-0e3b-4523-865c-9a2d4cc25568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ec01c6-3b') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29ec01c6-3b, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.compute.manager [req-c4a15ee2-2206-444d-bde8-b7e966d8fad7 req-7e36d557-2178-40bc-8a3a-fb59efb3ecdd service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-plugged-876f74d5-7991-4068-8fa4-625ac7cc3d22 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c4a15ee2-2206-444d-bde8-b7e966d8fad7 req-7e36d557-2178-40bc-8a3a-fb59efb3ecdd service nova] Acquiring lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c4a15ee2-2206-444d-bde8-b7e966d8fad7 req-7e36d557-2178-40bc-8a3a-fb59efb3ecdd service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c4a15ee2-2206-444d-bde8-b7e966d8fad7 req-7e36d557-2178-40bc-8a3a-fb59efb3ecdd service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.compute.manager [req-c4a15ee2-2206-444d-bde8-b7e966d8fad7 req-7e36d557-2178-40bc-8a3a-fb59efb3ecdd service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] No waiting events found dispatching network-vif-plugged-876f74d5-7991-4068-8fa4-625ac7cc3d22 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:39:58 user nova-compute[73484]: WARNING nova.compute.manager [req-c4a15ee2-2206-444d-bde8-b7e966d8fad7 req-7e36d557-2178-40bc-8a3a-fb59efb3ecdd service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received unexpected event network-vif-plugged-876f74d5-7991-4068-8fa4-625ac7cc3d22 for instance with vm_state active and task_state deleting.
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:58 user nova-compute[73484]: INFO os_vif [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:ec:d6,bridge_name='br-int',has_traffic_filtering=True,id=29ec01c6-3b25-4dfa-a9de-5474a29d0c5e,network=Network(d684c792-0e3b-4523-865c-9a2d4cc25568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ec01c6-3b')
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2091684054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2091684054',id=11,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYASXzOIIlX/renwy9P0bMTWnWqPwOvzELOuBlfAnHxtG8LsZBf1zV7H5dtd1aUubmLnuJxpB35cdMemRlWnH5SWrsXQBfo+vfoJ3yW+4lUfLxww0fOBI3IslW2hj3X2w==',key_name='tempest-keypair-575416246',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:38:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16a61399aa994f3b890de6ad50d91d6b',ramdisk_id='',reservation_id='r-yn3od48m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2119808848',owner_user_name='tempest-TaggedBootDevicesTest_v242-2119808848-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2355c1d4bfcb475ca72fbc555e38f6f7',uuid=18feef86-7a18-43e3-80cb-fb1d01d34d49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9672687d-4ab3-4b9d-886b-fc73d8f551d6", "address": "fa:16:3e:7f:7d:8d", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9672687d-4a", "ovs_interfaceid": "9672687d-4ab3-4b9d-886b-fc73d8f551d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converting VIF {"id": "9672687d-4ab3-4b9d-886b-fc73d8f551d6", "address": "fa:16:3e:7f:7d:8d", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9672687d-4a", "ovs_interfaceid": "9672687d-4ab3-4b9d-886b-fc73d8f551d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:7d:8d,bridge_name='br-int',has_traffic_filtering=True,id=9672687d-4ab3-4b9d-886b-fc73d8f551d6,network=Network(d684c792-0e3b-4523-865c-9a2d4cc25568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9672687d-4a') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG os_vif [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:7d:8d,bridge_name='br-int',has_traffic_filtering=True,id=9672687d-4ab3-4b9d-886b-fc73d8f551d6,network=Network(d684c792-0e3b-4523-865c-9a2d4cc25568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9672687d-4a') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9672687d-4a, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:58 user nova-compute[73484]: INFO os_vif [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:7d:8d,bridge_name='br-int',has_traffic_filtering=True,id=9672687d-4ab3-4b9d-886b-fc73d8f551d6,network=Network(d684c792-0e3b-4523-865c-9a2d4cc25568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9672687d-4a')
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2091684054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2091684054',id=11,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYASXzOIIlX/renwy9P0bMTWnWqPwOvzELOuBlfAnHxtG8LsZBf1zV7H5dtd1aUubmLnuJxpB35cdMemRlWnH5SWrsXQBfo+vfoJ3yW+4lUfLxww0fOBI3IslW2hj3X2w==',key_name='tempest-keypair-575416246',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:38:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16a61399aa994f3b890de6ad50d91d6b',ramdisk_id='',reservation_id='r-yn3od48m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2119808848',owner_user_name='tempest-TaggedBootDevicesTest_v242-2119808848-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2355c1d4bfcb475ca72fbc555e38f6f7',uuid=18feef86-7a18-43e3-80cb-fb1d01d34d49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "489a48ce-8925-499b-a234-c92c2d760375", "address": "fa:16:3e:b9:d7:ad", "network": {"id": "6811ba1b-eff5-4665-8046-cfb393845d13", "bridge": "br-int", "label": "tempest-device-tagging-net2-585065546", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap489a48ce-89", "ovs_interfaceid": "489a48ce-8925-499b-a234-c92c2d760375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converting VIF {"id": "489a48ce-8925-499b-a234-c92c2d760375", "address": "fa:16:3e:b9:d7:ad", "network": {"id": "6811ba1b-eff5-4665-8046-cfb393845d13", "bridge": "br-int", "label": "tempest-device-tagging-net2-585065546", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap489a48ce-89", "ovs_interfaceid": "489a48ce-8925-499b-a234-c92c2d760375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d7:ad,bridge_name='br-int',has_traffic_filtering=True,id=489a48ce-8925-499b-a234-c92c2d760375,network=Network(6811ba1b-eff5-4665-8046-cfb393845d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap489a48ce-89') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG os_vif [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d7:ad,bridge_name='br-int',has_traffic_filtering=True,id=489a48ce-8925-499b-a234-c92c2d760375,network=Network(6811ba1b-eff5-4665-8046-cfb393845d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap489a48ce-89') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap489a48ce-89, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:58 user nova-compute[73484]: INFO os_vif [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d7:ad,bridge_name='br-int',has_traffic_filtering=True,id=489a48ce-8925-499b-a234-c92c2d760375,network=Network(6811ba1b-eff5-4665-8046-cfb393845d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap489a48ce-89')
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2091684054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2091684054',id=11,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYASXzOIIlX/renwy9P0bMTWnWqPwOvzELOuBlfAnHxtG8LsZBf1zV7H5dtd1aUubmLnuJxpB35cdMemRlWnH5SWrsXQBfo+vfoJ3yW+4lUfLxww0fOBI3IslW2hj3X2w==',key_name='tempest-keypair-575416246',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:38:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16a61399aa994f3b890de6ad50d91d6b',ramdisk_id='',reservation_id='r-yn3od48m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2119808848',owner_user_name='tempest-TaggedBootDevicesTest_v242-2119808848-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:38:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2355c1d4bfcb475ca72fbc555e38f6f7',uuid=18feef86-7a18-43e3-80cb-fb1d01d34d49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d", "address": "fa:16:3e:5d:7d:d6", "network": {"id": "6811ba1b-eff5-4665-8046-cfb393845d13", "bridge": "br-int", "label": "tempest-device-tagging-net2-585065546", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e1d6f8-1c", "ovs_interfaceid": "a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converting VIF {"id": "a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d", "address": "fa:16:3e:5d:7d:d6", "network": {"id": "6811ba1b-eff5-4665-8046-cfb393845d13", "bridge": "br-int", "label": "tempest-device-tagging-net2-585065546", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1e1d6f8-1c", "ovs_interfaceid": "a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:7d:d6,bridge_name='br-int',has_traffic_filtering=True,id=a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d,network=Network(6811ba1b-eff5-4665-8046-cfb393845d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e1d6f8-1c') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG os_vif [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:7d:d6,bridge_name='br-int',has_traffic_filtering=True,id=a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d,network=Network(6811ba1b-eff5-4665-8046-cfb393845d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e1d6f8-1c') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1e1d6f8-1c, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:58 user nova-compute[73484]: INFO os_vif [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:7d:d6,bridge_name='br-int',has_traffic_filtering=True,id=a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d,network=Network(6811ba1b-eff5-4665-8046-cfb393845d13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1e1d6f8-1c')
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zYODyUgm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:39:58 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:39:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8cb7f8-5f39-44f2-98b8-749a4e8bbab1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[14240068-510e-462a-874a-aa0777aed80e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 (non-flash)
Aug 14 13:39:58 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:58 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:58 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:58 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:58 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 (non-flash)
Aug 14 13:39:58 user nova-compute[73484]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 (non-flash)
Aug 14 13:39:58 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:58 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:58 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:58 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc497fb8310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07'): ({'sdc'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Removing single pathed devices sdc {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ac2bcd-c509-4cb5-a892-e9b7f65f8753]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4c2e36-bdc7-4819-818e-1edb404c8119]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Flushing IO for device /dev/sdc {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[af85df39-691c-44a8-b266-29792b90368a]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4e85c6-7edc-4526-a546-657d66113a99]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbf54e0-bfc5-46de-9f58-bfab36c9e70e]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5967407-b44b-4466-b7d8-a3b1bc3bcaf5]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07, portal: 172.16.0.220,3260]
Aug 14 13:39:58 user nova-compute[73484]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07, portal: 172.16.0.220,3260] successful.
Aug 14 13:39:58 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.compute.manager [req-076ce0bf-8586-4b54-9140-b83edd9d515b req-1a5cffa2-f4fc-4390-8682-41b4328d8bce service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-plugged-29ec01c6-3b25-4dfa-a9de-5474a29d0c5e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-076ce0bf-8586-4b54-9140-b83edd9d515b req-1a5cffa2-f4fc-4390-8682-41b4328d8bce service nova] Acquiring lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-076ce0bf-8586-4b54-9140-b83edd9d515b req-1a5cffa2-f4fc-4390-8682-41b4328d8bce service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-076ce0bf-8586-4b54-9140-b83edd9d515b req-1a5cffa2-f4fc-4390-8682-41b4328d8bce service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.compute.manager [req-076ce0bf-8586-4b54-9140-b83edd9d515b req-1a5cffa2-f4fc-4390-8682-41b4328d8bce service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] No waiting events found dispatching network-vif-plugged-29ec01c6-3b25-4dfa-a9de-5474a29d0c5e {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:39:58 user nova-compute[73484]: WARNING nova.compute.manager [req-076ce0bf-8586-4b54-9140-b83edd9d515b req-1a5cffa2-f4fc-4390-8682-41b4328d8bce service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received unexpected event network-vif-plugged-29ec01c6-3b25-4dfa-a9de-5474a29d0c5e for instance with vm_state active and task_state deleting.
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.compute.manager [req-076ce0bf-8586-4b54-9140-b83edd9d515b req-1a5cffa2-f4fc-4390-8682-41b4328d8bce service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-unplugged-9672687d-4ab3-4b9d-886b-fc73d8f551d6 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-076ce0bf-8586-4b54-9140-b83edd9d515b req-1a5cffa2-f4fc-4390-8682-41b4328d8bce service nova] Acquiring lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-076ce0bf-8586-4b54-9140-b83edd9d515b req-1a5cffa2-f4fc-4390-8682-41b4328d8bce service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-076ce0bf-8586-4b54-9140-b83edd9d515b req-1a5cffa2-f4fc-4390-8682-41b4328d8bce service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.compute.manager [req-076ce0bf-8586-4b54-9140-b83edd9d515b req-1a5cffa2-f4fc-4390-8682-41b4328d8bce service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] No waiting events found dispatching network-vif-unplugged-9672687d-4ab3-4b9d-886b-fc73d8f551d6 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.compute.manager [req-076ce0bf-8586-4b54-9140-b83edd9d515b req-1a5cffa2-f4fc-4390-8682-41b4328d8bce service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-unplugged-9672687d-4ab3-4b9d-886b-fc73d8f551d6 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.compute.manager [req-076ce0bf-8586-4b54-9140-b83edd9d515b req-1a5cffa2-f4fc-4390-8682-41b4328d8bce service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-plugged-9672687d-4ab3-4b9d-886b-fc73d8f551d6 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-076ce0bf-8586-4b54-9140-b83edd9d515b req-1a5cffa2-f4fc-4390-8682-41b4328d8bce service nova] Acquiring lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-076ce0bf-8586-4b54-9140-b83edd9d515b req-1a5cffa2-f4fc-4390-8682-41b4328d8bce service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-076ce0bf-8586-4b54-9140-b83edd9d515b req-1a5cffa2-f4fc-4390-8682-41b4328d8bce service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.compute.manager [req-076ce0bf-8586-4b54-9140-b83edd9d515b req-1a5cffa2-f4fc-4390-8682-41b4328d8bce service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] No waiting events found dispatching network-vif-plugged-9672687d-4ab3-4b9d-886b-fc73d8f551d6 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:39:58 user nova-compute[73484]: WARNING nova.compute.manager [req-076ce0bf-8586-4b54-9140-b83edd9d515b req-1a5cffa2-f4fc-4390-8682-41b4328d8bce service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received unexpected event network-vif-plugged-9672687d-4ab3-4b9d-886b-fc73d8f551d6 for instance with vm_state active and task_state deleting.
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.compute.manager [req-076ce0bf-8586-4b54-9140-b83edd9d515b req-1a5cffa2-f4fc-4390-8682-41b4328d8bce service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-unplugged-a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-076ce0bf-8586-4b54-9140-b83edd9d515b req-1a5cffa2-f4fc-4390-8682-41b4328d8bce service nova] Acquiring lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-076ce0bf-8586-4b54-9140-b83edd9d515b req-1a5cffa2-f4fc-4390-8682-41b4328d8bce service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-076ce0bf-8586-4b54-9140-b83edd9d515b req-1a5cffa2-f4fc-4390-8682-41b4328d8bce service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.compute.manager [req-076ce0bf-8586-4b54-9140-b83edd9d515b req-1a5cffa2-f4fc-4390-8682-41b4328d8bce service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] No waiting events found dispatching network-vif-unplugged-a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.compute.manager [req-076ce0bf-8586-4b54-9140-b83edd9d515b req-1a5cffa2-f4fc-4390-8682-41b4328d8bce service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-unplugged-a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.compute.manager [req-076ce0bf-8586-4b54-9140-b83edd9d515b req-1a5cffa2-f4fc-4390-8682-41b4328d8bce service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-plugged-a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-076ce0bf-8586-4b54-9140-b83edd9d515b req-1a5cffa2-f4fc-4390-8682-41b4328d8bce service nova] Acquiring lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-076ce0bf-8586-4b54-9140-b83edd9d515b req-1a5cffa2-f4fc-4390-8682-41b4328d8bce service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-076ce0bf-8586-4b54-9140-b83edd9d515b req-1a5cffa2-f4fc-4390-8682-41b4328d8bce service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.compute.manager [req-076ce0bf-8586-4b54-9140-b83edd9d515b req-1a5cffa2-f4fc-4390-8682-41b4328d8bce service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] No waiting events found dispatching network-vif-plugged-a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:39:58 user nova-compute[73484]: WARNING nova.compute.manager [req-076ce0bf-8586-4b54-9140-b83edd9d515b req-1a5cffa2-f4fc-4390-8682-41b4328d8bce service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received unexpected event network-vif-plugged-a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d for instance with vm_state active and task_state deleting.
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0e13048-762f-4009-88c3-d5594be47a07 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ff17dd-0d98-4e9d-a0db-0fc8b1056850]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] <== disconnect_volume: return (277ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hRgsIJwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:39:58 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:39:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.compute.manager [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Received event network-changed-59f1948e-70b8-4051-bda8-44296770add6 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.compute.manager [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Refreshing instance network info cache due to event network-changed-59f1948e-70b8-4051-bda8-44296770add6. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] Acquiring lock "refresh_cache-856807c9-af22-4be7-834e-2d7003329f8c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] Acquired lock "refresh_cache-856807c9-af22-4be7-834e-2d7003329f8c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG nova.network.neutron [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Refreshing network info cache for port 59f1948e-70b8-4051-bda8-44296770add6 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[381a8e44-ae83-447e-9f39-70071568fe8a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8facab4d-2462-47ac-b9a4-fa0857ae4119]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 (non-flash)
Aug 14 13:39:59 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:59 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:59 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:59 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 (non-flash)
Aug 14 13:39:59 user nova-compute[73484]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 (non-flash)
Aug 14 13:39:59 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:59 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:59 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4785e9ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220'): ({'sdd'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Removing single pathed devices sdd {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b801e44-bc1d-4b0b-b491-aabcec56cbea]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[478e4505-4b25-4c5a-839f-3f4698a509df]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Flushing IO for device /dev/sdd {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a113f933-f39b-4aa8-948f-6ec84f84986f]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.utils [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abcbb8b-8e6f-4a99-997d-e9b2e7607d06]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] SCSI volumes sdd have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0528d40-1fd0-41a7-b162-ebe2a160bf31]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a30762-c174-43f6-9103-dd9e64b3e643]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab6ee9a-c59d-4789-b13d-3980266f50ef]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb3dbfb-2f2c-4363-b52c-642cb4c8691f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53e176d-8701-4806-a1ca-bcf8c4fed7a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[026a05d4-bf48-4fd5-ac6a-fc7560ca0261]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220, portal: 172.16.0.220,3260]
Aug 14 13:39:59 user nova-compute[73484]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220, portal: 172.16.0.220,3260] successful.
Aug 14 13:39:59 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:39:59 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb2f85b-08fb-4eaa-be75-578ee747513a]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.utils [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Updating existing volume attachment record: 6ae62a28-0b8d-44de-a48a-65049f67232f {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7259b003-154c-4381-83d3-e5a23346a220 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32d421f-d9c6-4acb-8851-c9048aac5005]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] <== disconnect_volume: return (359ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'roiphftj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:39:59 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c4a780-6e13-44b8-b309-9e959c7579eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[036bac74-ae53-4fb2-915b-6c6daacafdb3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 (non-flash)
Aug 14 13:39:59 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:59 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:59 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 (non-flash)
Aug 14 13:39:59 user nova-compute[73484]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 (non-flash)
Aug 14 13:39:59 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:39:59 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4951c96c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007'): ({'sde'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Removing single pathed devices sde {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c6b013-b485-4972-9247-cb23b2b372c9]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1653ec-bda8-4968-9ea8-0399128e5d4d]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Flushing IO for device /dev/sde {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c9de5d-5565-4103-9e9a-25c2257ba05f]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG nova.network.neutron [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Updated VIF entry in instance network info cache for port 59f1948e-70b8-4051-bda8-44296770add6. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG nova.network.neutron [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Updating instance_info_cache with network_info: [{"id": "59f1948e-70b8-4051-bda8-44296770add6", "address": "fa:16:3e:c8:e6:56", "network": {"id": "25df0ef0-3c04-4a7d-840e-6f556ebd1dbc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a23940f0738942409fd00984c52e7e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f1948e-70", "ovs_interfaceid": "59f1948e-70b8-4051-bda8-44296770add6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.102s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0781e858-d73f-48fe-b444-bb94e7663b86]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] SCSI volumes sde have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] Releasing lock "refresh_cache-856807c9-af22-4be7-834e-2d7003329f8c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG nova.compute.manager [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-plugged-32ed41f4-a698-4873-98aa-ab0a08e09ad1 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] Acquiring lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG nova.compute.manager [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] No waiting events found dispatching network-vif-plugged-32ed41f4-a698-4873-98aa-ab0a08e09ad1 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:39:59 user nova-compute[73484]: WARNING nova.compute.manager [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received unexpected event network-vif-plugged-32ed41f4-a698-4873-98aa-ab0a08e09ad1 for instance with vm_state active and task_state deleting.
Aug 14 13:39:59 user nova-compute[73484]: DEBUG nova.compute.manager [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-unplugged-44be0321-53ca-43af-9af4-35ed291d2695 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] Acquiring lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG nova.compute.manager [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] No waiting events found dispatching network-vif-unplugged-44be0321-53ca-43af-9af4-35ed291d2695 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG nova.compute.manager [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-unplugged-44be0321-53ca-43af-9af4-35ed291d2695 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG nova.compute.manager [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-plugged-44be0321-53ca-43af-9af4-35ed291d2695 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] Acquiring lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG nova.compute.manager [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] No waiting events found dispatching network-vif-plugged-44be0321-53ca-43af-9af4-35ed291d2695 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:39:59 user nova-compute[73484]: WARNING nova.compute.manager [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received unexpected event network-vif-plugged-44be0321-53ca-43af-9af4-35ed291d2695 for instance with vm_state active and task_state deleting.
Aug 14 13:39:59 user nova-compute[73484]: DEBUG nova.compute.manager [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-unplugged-489a48ce-8925-499b-a234-c92c2d760375 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] Acquiring lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG nova.compute.manager [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] No waiting events found dispatching network-vif-unplugged-489a48ce-8925-499b-a234-c92c2d760375 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG nova.compute.manager [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-unplugged-489a48ce-8925-499b-a234-c92c2d760375 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG nova.compute.manager [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-plugged-489a48ce-8925-499b-a234-c92c2d760375 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] Acquiring lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG nova.compute.manager [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] No waiting events found dispatching network-vif-plugged-489a48ce-8925-499b-a234-c92c2d760375 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:39:59 user nova-compute[73484]: WARNING nova.compute.manager [req-d3986b9c-e114-49ba-94e5-18a26f8ae380 req-a9c42943-6f21-4359-9410-921ae0bbc726 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received unexpected event network-vif-plugged-489a48ce-8925-499b-a234-c92c2d760375 for instance with vm_state active and task_state deleting.
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cea5043-8234-46a7-861c-56ed2d1f679e]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfdeae9-d4f5-4754-8f1d-838ffd1e2fb0]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007, portal: 172.16.0.220,3260]
Aug 14 13:39:59 user nova-compute[73484]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007, portal: 172.16.0.220,3260] successful.
Aug 14 13:39:59 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50fa87d8-9dde-44bc-a634-e9415d684007 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff1b221-aab1-4962-9366-921be50b40f7]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] <== disconnect_volume: return (394ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:39:59 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Deleting instance files /opt/stack/data/nova/instances/18feef86-7a18-43e3-80cb-fb1d01d34d49_del
Aug 14 13:39:59 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Deletion of /opt/stack/data/nova/instances/18feef86-7a18-43e3-80cb-fb1d01d34d49_del complete
Aug 14 13:39:59 user nova-compute[73484]: INFO nova.compute.manager [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Took 3.70 seconds to destroy the instance on the hypervisor.
Aug 14 13:39:59 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:39:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:01 user nova-compute[73484]: DEBUG nova.compute.manager [req-ec1c8806-d53e-4232-afd4-893ce4e36997 req-d952b2f0-055e-4036-8653-ecff0df96fb3 service nova] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Received event network-vif-plugged-59f1948e-70b8-4051-bda8-44296770add6 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:40:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ec1c8806-d53e-4232-afd4-893ce4e36997 req-d952b2f0-055e-4036-8653-ecff0df96fb3 service nova] Acquiring lock "856807c9-af22-4be7-834e-2d7003329f8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ec1c8806-d53e-4232-afd4-893ce4e36997 req-d952b2f0-055e-4036-8653-ecff0df96fb3 service nova] Lock "856807c9-af22-4be7-834e-2d7003329f8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ec1c8806-d53e-4232-afd4-893ce4e36997 req-d952b2f0-055e-4036-8653-ecff0df96fb3 service nova] Lock "856807c9-af22-4be7-834e-2d7003329f8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:01 user nova-compute[73484]: DEBUG nova.compute.manager [req-ec1c8806-d53e-4232-afd4-893ce4e36997 req-d952b2f0-055e-4036-8653-ecff0df96fb3 service nova] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] No waiting events found dispatching network-vif-plugged-59f1948e-70b8-4051-bda8-44296770add6 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:40:01 user nova-compute[73484]: WARNING nova.compute.manager [req-ec1c8806-d53e-4232-afd4-893ce4e36997 req-d952b2f0-055e-4036-8653-ecff0df96fb3 service nova] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Received unexpected event network-vif-plugged-59f1948e-70b8-4051-bda8-44296770add6 for instance with vm_state building and task_state spawning.
Aug 14 13:40:01 user nova-compute[73484]: DEBUG nova.compute.manager [req-ec1c8806-d53e-4232-afd4-893ce4e36997 req-d952b2f0-055e-4036-8653-ecff0df96fb3 service nova] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Received event network-vif-plugged-59f1948e-70b8-4051-bda8-44296770add6 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:40:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ec1c8806-d53e-4232-afd4-893ce4e36997 req-d952b2f0-055e-4036-8653-ecff0df96fb3 service nova] Acquiring lock "856807c9-af22-4be7-834e-2d7003329f8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ec1c8806-d53e-4232-afd4-893ce4e36997 req-d952b2f0-055e-4036-8653-ecff0df96fb3 service nova] Lock "856807c9-af22-4be7-834e-2d7003329f8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ec1c8806-d53e-4232-afd4-893ce4e36997 req-d952b2f0-055e-4036-8653-ecff0df96fb3 service nova] Lock "856807c9-af22-4be7-834e-2d7003329f8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:01 user nova-compute[73484]: DEBUG nova.compute.manager [req-ec1c8806-d53e-4232-afd4-893ce4e36997 req-d952b2f0-055e-4036-8653-ecff0df96fb3 service nova] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] No waiting events found dispatching network-vif-plugged-59f1948e-70b8-4051-bda8-44296770add6 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:40:01 user nova-compute[73484]: WARNING nova.compute.manager [req-ec1c8806-d53e-4232-afd4-893ce4e36997 req-d952b2f0-055e-4036-8653-ecff0df96fb3 service nova] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Received unexpected event network-vif-plugged-59f1948e-70b8-4051-bda8-44296770add6 for instance with vm_state building and task_state spawning.
Aug 14 13:40:01 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020401.5727642, 856807c9-af22-4be7-834e-2d7003329f8c => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:40:01 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] VM Resumed (Lifecycle Event)
Aug 14 13:40:01 user nova-compute[73484]: DEBUG nova.compute.manager [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:40:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:40:01 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Instance spawned successfully.
Aug 14 13:40:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:40:01 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:40:01 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:40:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:40:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:40:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:40:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:40:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:40:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:40:01 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:40:01 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020401.5729551, 856807c9-af22-4be7-834e-2d7003329f8c => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:40:01 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] VM Started (Lifecycle Event)
Aug 14 13:40:01 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:40:01 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:40:01 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:40:01 user nova-compute[73484]: INFO nova.compute.manager [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Took 6.82 seconds to spawn the instance on the hypervisor.
Aug 14 13:40:01 user nova-compute[73484]: DEBUG nova.compute.manager [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:40:01 user nova-compute[73484]: INFO nova.compute.manager [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Took 7.60 seconds to build instance.
Aug 14 13:40:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f13c9605-9d0f-4036-ba64-b8f9aba8df8e tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Lock "856807c9-af22-4be7-834e-2d7003329f8c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.867s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG nova.compute.manager [req-0e61851d-9ace-4fb9-b6f3-027355cb4e49 req-8e880b0a-914f-4e85-b7bd-3242e274c929 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-deleted-a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:40:03 user nova-compute[73484]: INFO nova.compute.manager [req-0e61851d-9ace-4fb9-b6f3-027355cb4e49 req-8e880b0a-914f-4e85-b7bd-3242e274c929 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Neutron deleted interface a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d; detaching it from the instance and deleting it from the info cache
Aug 14 13:40:03 user nova-compute[73484]: DEBUG nova.network.neutron [req-0e61851d-9ace-4fb9-b6f3-027355cb4e49 req-8e880b0a-914f-4e85-b7bd-3242e274c929 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Updating instance_info_cache with network_info: [{"id": "876f74d5-7991-4068-8fa4-625ac7cc3d22", "address": "fa:16:3e:66:68:cc", "network": {"id": "1a9b1894-c8aa-4c1c-a1dc-70f91e648b89", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1258957124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap876f74d5-79", "ovs_interfaceid": "876f74d5-7991-4068-8fa4-625ac7cc3d22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "32ed41f4-a698-4873-98aa-ab0a08e09ad1", "address": "fa:16:3e:61:3b:99", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32ed41f4-a6", "ovs_interfaceid": "32ed41f4-a698-4873-98aa-ab0a08e09ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44be0321-53ca-43af-9af4-35ed291d2695", "address": "fa:16:3e:1f:78:bf", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44be0321-53", "ovs_interfaceid": "44be0321-53ca-43af-9af4-35ed291d2695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "29ec01c6-3b25-4dfa-a9de-5474a29d0c5e", "address": "fa:16:3e:90:ec:d6", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ec01c6-3b", "ovs_interfaceid": "29ec01c6-3b25-4dfa-a9de-5474a29d0c5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9672687d-4ab3-4b9d-886b-fc73d8f551d6", "address": "fa:16:3e:7f:7d:8d", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9672687d-4a", "ovs_interfaceid": "9672687d-4ab3-4b9d-886b-fc73d8f551d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "489a48ce-8925-499b-a234-c92c2d760375", "address": "fa:16:3e:b9:d7:ad", "network": {"id": "6811ba1b-eff5-4665-8046-cfb393845d13", "bridge": "br-int", "label": "tempest-device-tagging-net2-585065546", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap489a48ce-89", "ovs_interfaceid": "489a48ce-8925-499b-a234-c92c2d760375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG nova.compute.manager [req-0e61851d-9ace-4fb9-b6f3-027355cb4e49 req-8e880b0a-914f-4e85-b7bd-3242e274c929 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Detach interface failed, port_id=a1e1d6f8-1ca6-409d-af2e-c22b2e820b5d, reason: Instance 18feef86-7a18-43e3-80cb-fb1d01d34d49 could not be found. {{(pid=73484) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG nova.compute.manager [req-0e61851d-9ace-4fb9-b6f3-027355cb4e49 req-8e880b0a-914f-4e85-b7bd-3242e274c929 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-deleted-29ec01c6-3b25-4dfa-a9de-5474a29d0c5e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:40:03 user nova-compute[73484]: INFO nova.compute.manager [req-0e61851d-9ace-4fb9-b6f3-027355cb4e49 req-8e880b0a-914f-4e85-b7bd-3242e274c929 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Neutron deleted interface 29ec01c6-3b25-4dfa-a9de-5474a29d0c5e; detaching it from the instance and deleting it from the info cache
Aug 14 13:40:03 user nova-compute[73484]: DEBUG nova.network.neutron [req-0e61851d-9ace-4fb9-b6f3-027355cb4e49 req-8e880b0a-914f-4e85-b7bd-3242e274c929 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Updating instance_info_cache with network_info: [{"id": "876f74d5-7991-4068-8fa4-625ac7cc3d22", "address": "fa:16:3e:66:68:cc", "network": {"id": "1a9b1894-c8aa-4c1c-a1dc-70f91e648b89", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1258957124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap876f74d5-79", "ovs_interfaceid": "876f74d5-7991-4068-8fa4-625ac7cc3d22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "32ed41f4-a698-4873-98aa-ab0a08e09ad1", "address": "fa:16:3e:61:3b:99", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32ed41f4-a6", "ovs_interfaceid": "32ed41f4-a698-4873-98aa-ab0a08e09ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44be0321-53ca-43af-9af4-35ed291d2695", "address": "fa:16:3e:1f:78:bf", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44be0321-53", "ovs_interfaceid": "44be0321-53ca-43af-9af4-35ed291d2695", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9672687d-4ab3-4b9d-886b-fc73d8f551d6", "address": "fa:16:3e:7f:7d:8d", "network": {"id": "d684c792-0e3b-4523-865c-9a2d4cc25568", "bridge": "br-int", "label": "tempest-device-tagging-net1-1532430311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9672687d-4a", "ovs_interfaceid": "9672687d-4ab3-4b9d-886b-fc73d8f551d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "489a48ce-8925-499b-a234-c92c2d760375", "address": "fa:16:3e:b9:d7:ad", "network": {"id": "6811ba1b-eff5-4665-8046-cfb393845d13", "bridge": "br-int", "label": "tempest-device-tagging-net2-585065546", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "16a61399aa994f3b890de6ad50d91d6b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap489a48ce-89", "ovs_interfaceid": "489a48ce-8925-499b-a234-c92c2d760375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG nova.compute.manager [req-0e61851d-9ace-4fb9-b6f3-027355cb4e49 req-8e880b0a-914f-4e85-b7bd-3242e274c929 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Detach interface failed, port_id=29ec01c6-3b25-4dfa-a9de-5474a29d0c5e, reason: Instance 18feef86-7a18-43e3-80cb-fb1d01d34d49 could not be found. {{(pid=73484) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'matSGeRK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7ac05f68-a20f-4a57-b990-ef0799aadc58', 'attached_at': '', 'detached_at': '', 'volume_id': 'b74c54bf-81bc-4b2a-9dc3-c7186d64df0e', 'serial': 'b74c54bf-81bc-4b2a-9dc3-c7186d64df0e'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EpvxaGLg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4'}, 'status': 'reserved', 'instance': '7ac05f68-a20f-4a57-b990-ef0799aadc58', 'attached_at': '', 'detached_at': '', 'volume_id': '3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4', 'serial'} {{(pid=73484) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'matSGeRK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:40:03 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:40:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:40:03 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:40:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:40:03 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:40:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0fc993-e55a-48f6-a962-1f782d362d4e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:40:03 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[382abb7c-3353-4efd-8f06-35977c31c970]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e] added
Aug 14 13:40:03 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a48adeb-d9aa-4312-9311-707300f32987]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd5ac6d-1118-434f-bda3-f91cc86a2e43]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v matSGeRK {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v matSGeRK" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d967666d-5d94-4035-aba8-5eaa0d8a6286]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'matSGeRK'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94863f7-4aeb-4f4c-98ee-6fc36ea277d6]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f52ef90-ba61-437f-a8d9-664c7f662b17]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 (non-flash)
Aug 14 13:40:03 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:40:03 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 (non-flash)
Aug 14 13:40:03 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:40:03 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa323ed4-b881-484e-ac65-d9ca03483d6d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e, portal: 172.16.0.220,3260]
Aug 14 13:40:03 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e, portal: 172.16.0.220,3260] successful.
Aug 14 13:40:03 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54cc554-11ee-4cce-90ac-26bb846b351f]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8164f6-adf8-4d29-9c4a-f783e381c77e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 (non-flash)
Aug 14 13:40:03 user nova-compute[73484]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:40:03 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:40:03 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 (non-flash)
Aug 14 13:40:03 user nova-compute[73484]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:40:03 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:40:03 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:40:03 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:40:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.044s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:04 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15a316c-44be-42e8-a762-e3ae0cd9dfe9]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:04 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: None {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:40:04 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:40:04 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Took 4.79 seconds to deallocate network for instance.
Aug 14 13:40:05 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:40:05 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'matSGeRK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:40:05 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:40:05 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '23837663562373765', 'path': '/dev/sdc'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:40:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837663562373765', 'path': '/dev/sdc'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:40:05 user nova-compute[73484]: DEBUG nova.objects.instance [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Lazy-loading 'flavor' on Instance uuid 7ac05f68-a20f-4a57-b990-ef0799aadc58 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:40:05 user nova-compute[73484]: DEBUG nova.compute.manager [req-c492fd7c-8578-469a-b12b-c03e6ec0db68 req-16375b45-9657-44a4-9097-f40a3eb829f0 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-deleted-876f74d5-7991-4068-8fa4-625ac7cc3d22 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:40:05 user nova-compute[73484]: DEBUG nova.compute.manager [req-c492fd7c-8578-469a-b12b-c03e6ec0db68 req-16375b45-9657-44a4-9097-f40a3eb829f0 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-deleted-9672687d-4ab3-4b9d-886b-fc73d8f551d6 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:40:05 user nova-compute[73484]: DEBUG nova.compute.manager [req-c492fd7c-8578-469a-b12b-c03e6ec0db68 req-16375b45-9657-44a4-9097-f40a3eb829f0 service nova] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Received event network-vif-deleted-489a48ce-8925-499b-a234-c92c2d760375 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:40:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73484) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 13:40:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] COPY block job progress, current cursor: 155189248 final cursor: 1073741824 {{(pid=73484) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 13:40:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] COPY block job progress, current cursor: 300941312 final cursor: 1073741824 {{(pid=73484) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 13:40:07 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] COPY block job progress, current cursor: 411041792 final cursor: 1073741824 {{(pid=73484) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 13:40:07 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] COPY block job progress, current cursor: 545259520 final cursor: 1073741824 {{(pid=73484) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 13:40:08 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] COPY block job progress, current cursor: 668991488 final cursor: 1073741824 {{(pid=73484) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 13:40:08 user nova-compute[73484]: INFO nova.compute.manager [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Took 3.80 seconds to detach 3 volumes for instance.
Aug 14 13:40:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:08 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] COPY block job progress, current cursor: 791674880 final cursor: 1073741824 {{(pid=73484) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 13:40:08 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:40:08 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:08 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 13:40:08 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:40:08 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:40:08 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:08 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:40:08 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.553s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] COPY block job progress, current cursor: 970981376 final cursor: 1073741824 {{(pid=73484) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 13:40:09 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Deleted allocations for instance 18feef86-7a18-43e3-80cb-fb1d01d34d49
Aug 14 13:40:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-91c7c037-50af-41b8-80a8-5f85f007939d tempest-TaggedBootDevicesTest_v242-2119808848 tempest-TaggedBootDevicesTest_v242-2119808848-project-member] Lock "18feef86-7a18-43e3-80cb-fb1d01d34d49" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.152s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73484) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EpvxaGLg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:40:09 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:40:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a87408d-7ab6-45de-965e-f9643dc7550e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96e921e-76ba-458d-a759-682099461c27]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 (non-flash)
Aug 14 13:40:09 user nova-compute[73484]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:40:09 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:40:09 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 (non-flash)
Aug 14 13:40:09 user nova-compute[73484]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:40:09 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:40:09 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc491fbb370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4'): ({'sdb'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Removing single pathed devices sdb {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a9e618-43bf-4162-912b-54a97c001f73]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2abc267-41cd-4f0c-822d-805bd0e63d4c]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Flushing IO for device /dev/sdb {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc17db96-be71-4dce-a1fc-b68ee66a1efa]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d43c71-788d-43d4-842b-fdc147d8e4c5]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] SCSI volumes sdb have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec6e2f1-1606-4c2b-93ab-aae0520be28d]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb754024-b341-4bda-81c3-c14a4d864798]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4, portal: 172.16.0.220,3260]
Aug 14 13:40:09 user nova-compute[73484]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4, portal: 172.16.0.220,3260] successful.
Aug 14 13:40:09 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f90f057-6d76-45d5-85cf-1d2713290aa4]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] <== disconnect_volume: return (276ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'matSGeRK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '7ac05f68-a20f-4a57-b990-ef0799aadc58', 'attached_at': '', 'detached_at': '', 'volume_id': 'b74c54bf-81bc-4b2a-9dc3-c7186d64df0e', 'serial'} {{(pid=73484) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] swap_volume: removing Cinder connection for volume 3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 {{(pid=73484) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG nova.compute.manager [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:40:10 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Creating image(s)
Aug 14 13:40:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Did not create local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Ensure instance console log exists: /opt/stack/data/nova/instances/a9d4ec42-3db9-439b-87a7-02bcaab514a4/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Start _get_guest_xml network_info=[{"id": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "address": "fa:16:3e:a8:f5:8b", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa109f4ac-a7", "ovs_interfaceid": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6ae62a28-0b8d-44de-a48a-65049f67232f', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzLZCdIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a9d4ec42-3db9-439b-87a7-02bcaab514a4', 'attached_at': '', 'detached_at': '', 'volume_id': 'aac0dffc-1c43-44e8-adff-0463af08c68d', 'serial': 'aac0dffc-1c43-44e8-adff-0463af08c68d'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:40:10 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:40:10 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:40:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzLZCdIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:40:10 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:40:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:40:10 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:40:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:40:10 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee69fde-9341-4578-acc4-1c988ba06ba5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:40:10 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0a111e-7b5f-4b8f-8625-7525423bed5b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d] added
Aug 14 13:40:10 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6876195-e927-401d-869e-3744e15f4343]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b83cb5-f14e-415e-992e-38e5c3ba5882]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EzLZCdIX {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EzLZCdIX" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0561a0-b21d-43be-a75c-005c4e4f2927]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EzLZCdIX'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab20c20-0b60-46ba-9022-af67f0d6dcb9]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[58db46ec-ff3a-43f2-8872-58c9a87111ac]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:40:10 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:40:10 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:40:10 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:40:10 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] swap_volume: Updating volume 3bc80bac-b2a4-4397-b0ec-c2e6f871f2e4 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "matSGeRK", "auth_password": "i5JCQOnSapherD", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "b74c54bf-81bc-4b2a-9dc3-c7186d64df0e"}, "status": "reserved", "instance": "7ac05f68-a20f-4a57-b990-ef0799aadc58", "attached_at": "", "detached_at": "", "volume_id": "b74c54bf-81bc-4b2a-9dc3-c7186d64df0e", "serial": "b74c54bf-81bc-4b2a-9dc3-c7186d64df0e"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'b74c54bf-81bc-4b2a-9dc3-c7186d64df0e', 'no_device': None, 'attachment_id': 'df71f625-da87-4a3b-b575-d689a5e33914'} {{(pid=73484) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a3e758d1-6df3-4a11-9abe-547486e5813d tempest-TestVolumeSwap-579275193 tempest-TestVolumeSwap-579275193-project-admin] Lock "7ac05f68-a20f-4a57-b990-ef0799aadc58" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.831s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[050a2e24-f545-4ffe-8b51-fd39f1037346]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d, portal: 172.16.0.220,3260]
Aug 14 13:40:10 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d, portal: 172.16.0.220,3260] successful.
Aug 14 13:40:10 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbae7b38-bac5-43b9-aa50-35b91448fb58]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:11 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf08e31e-542d-4087-97b2-48a8552a4660]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:11 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:40:11 user nova-compute[73484]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:40:11 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:40:11 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:40:11 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:40:11 user nova-compute[73484]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:40:11 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:40:11 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:40:11 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:40:11 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:40:11 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:40:11 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:40:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:11 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97f9042-0e5f-4881-ba53-5438edae396d]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:11 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: None {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:40:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Acquiring lock "7ac05f68-a20f-4a57-b990-ef0799aadc58" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lock "7ac05f68-a20f-4a57-b990-ef0799aadc58" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:11 user nova-compute[73484]: INFO nova.compute.manager [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Detaching volume b74c54bf-81bc-4b2a-9dc3-c7186d64df0e
Aug 14 13:40:11 user nova-compute[73484]: INFO nova.virt.block_device [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Attempting to driver detach volume b74c54bf-81bc-4b2a-9dc3-c7186d64df0e from mountpoint /dev/vdb
Aug 14 13:40:11 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Attempting to detach device vdb from instance 7ac05f68-a20f-4a57-b990-ef0799aadc58 from the persistent domain config. {{(pid=73484) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 13:40:11 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:40:11 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:40:11 user nova-compute[73484]:   <source dev="/dev/sdc"/>
Aug 14 13:40:11 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:40:11 user nova-compute[73484]:   <serial>b74c54bf-81bc-4b2a-9dc3-c7186d64df0e</serial>
Aug 14 13:40:11 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 13:40:11 user nova-compute[73484]: </disk>
Aug 14 13:40:11 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:40:11 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Successfully detached device vdb from instance 7ac05f68-a20f-4a57-b990-ef0799aadc58 from the persistent domain config.
Aug 14 13:40:11 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7ac05f68-a20f-4a57-b990-ef0799aadc58 from the live domain config. {{(pid=73484) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 13:40:11 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:40:11 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:40:11 user nova-compute[73484]:   <source dev="/dev/sdc"/>
Aug 14 13:40:11 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:40:11 user nova-compute[73484]:   <serial>b74c54bf-81bc-4b2a-9dc3-c7186d64df0e</serial>
Aug 14 13:40:11 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 13:40:11 user nova-compute[73484]: </disk>
Aug 14 13:40:11 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzLZCdIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26162303666646438', 'path': '/dev/sdb'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162303666646438', 'path': '/dev/sdb'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:39:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-276871641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-276871641',id=12,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c7f2c51c0f84bf1aedcf493a9ff860f',ramdisk_id='',reservation_id='r-zx07pb5m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-830908511',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:39:48Z,user_data=None,user_id='5a0f55ad018d4c0ca587d8bdd40df4c8',uuid=a9d4ec42-3db9-439b-87a7-02bcaab514a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "address": "fa:16:3e:a8:f5:8b", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa109f4ac-a7", "ovs_interfaceid": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Converting VIF {"id": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "address": "fa:16:3e:a8:f5:8b", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa109f4ac-a7", "ovs_interfaceid": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:f5:8b,bridge_name='br-int',has_traffic_filtering=True,id=a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26,network=Network(4ec437fc-4371-48d6-8026-b64423fbc0ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa109f4ac-a7') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG nova.objects.instance [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lazy-loading 'pci_devices' on Instance uuid a9d4ec42-3db9-439b-87a7-02bcaab514a4 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:40:12 user nova-compute[73484]:   <uuid>a9d4ec42-3db9-439b-87a7-02bcaab514a4</uuid>
Aug 14 13:40:12 user nova-compute[73484]:   <name>instance-0000000c</name>
Aug 14 13:40:12 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:40:12 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:40:12 user nova-compute[73484]:   <metadata>
Aug 14 13:40:12 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:40:12 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:40:12 user nova-compute[73484]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-276871641</nova:name>
Aug 14 13:40:12 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:40:10</nova:creationTime>
Aug 14 13:40:12 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:40:12 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:40:12 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:40:12 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:40:12 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:40:12 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:40:12 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:40:12 user nova-compute[73484]:       <nova:owner>
Aug 14 13:40:12 user nova-compute[73484]:         <nova:user uuid="5a0f55ad018d4c0ca587d8bdd40df4c8">tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member</nova:user>
Aug 14 13:40:12 user nova-compute[73484]:         <nova:project uuid="2c7f2c51c0f84bf1aedcf493a9ff860f">tempest-ServerBootFromVolumeStableRescueTest-830908511</nova:project>
Aug 14 13:40:12 user nova-compute[73484]:       </nova:owner>
Aug 14 13:40:12 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:40:12 user nova-compute[73484]:       <nova:ports>
Aug 14 13:40:12 user nova-compute[73484]:         <nova:port uuid="a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26">
Aug 14 13:40:12 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 13:40:12 user nova-compute[73484]:         </nova:port>
Aug 14 13:40:12 user nova-compute[73484]:       </nova:ports>
Aug 14 13:40:12 user nova-compute[73484]:     </nova:instance>
Aug 14 13:40:12 user nova-compute[73484]:   </metadata>
Aug 14 13:40:12 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:40:12 user nova-compute[73484]:     <system>
Aug 14 13:40:12 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:40:12 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:40:12 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:40:12 user nova-compute[73484]:       <entry name="serial">a9d4ec42-3db9-439b-87a7-02bcaab514a4</entry>
Aug 14 13:40:12 user nova-compute[73484]:       <entry name="uuid">a9d4ec42-3db9-439b-87a7-02bcaab514a4</entry>
Aug 14 13:40:12 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:40:12 user nova-compute[73484]:     </system>
Aug 14 13:40:12 user nova-compute[73484]:   </sysinfo>
Aug 14 13:40:12 user nova-compute[73484]:   <os>
Aug 14 13:40:12 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:40:12 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:40:12 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:40:12 user nova-compute[73484]:   </os>
Aug 14 13:40:12 user nova-compute[73484]:   <features>
Aug 14 13:40:12 user nova-compute[73484]:     <acpi/>
Aug 14 13:40:12 user nova-compute[73484]:     <apic/>
Aug 14 13:40:12 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:40:12 user nova-compute[73484]:   </features>
Aug 14 13:40:12 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:40:12 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:40:12 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:40:12 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:40:12 user nova-compute[73484]:   </clock>
Aug 14 13:40:12 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:40:12 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:40:12 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:40:12 user nova-compute[73484]:   </cpu>
Aug 14 13:40:12 user nova-compute[73484]:   <devices>
Aug 14 13:40:12 user nova-compute[73484]:     <disk type="block" device="disk">
Aug 14 13:40:12 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:40:12 user nova-compute[73484]:       <source dev="/dev/sdb"/>
Aug 14 13:40:12 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:40:12 user nova-compute[73484]:       <serial>aac0dffc-1c43-44e8-adff-0463af08c68d</serial>
Aug 14 13:40:12 user nova-compute[73484]:     </disk>
Aug 14 13:40:12 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:40:12 user nova-compute[73484]:       <mac address="fa:16:3e:a8:f5:8b"/>
Aug 14 13:40:12 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:40:12 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:40:12 user nova-compute[73484]:       <target dev="tapa109f4ac-a7"/>
Aug 14 13:40:12 user nova-compute[73484]:     </interface>
Aug 14 13:40:12 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:40:12 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/a9d4ec42-3db9-439b-87a7-02bcaab514a4/console.log" append="off"/>
Aug 14 13:40:12 user nova-compute[73484]:     </serial>
Aug 14 13:40:12 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:40:12 user nova-compute[73484]:     <video>
Aug 14 13:40:12 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:40:12 user nova-compute[73484]:     </video>
Aug 14 13:40:12 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:40:12 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:40:12 user nova-compute[73484]:     </rng>
Aug 14 13:40:12 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:40:12 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:40:12 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:40:12 user nova-compute[73484]:     </memballoon>
Aug 14 13:40:12 user nova-compute[73484]:   </devices>
Aug 14 13:40:12 user nova-compute[73484]: </domain>
Aug 14 13:40:12 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:39:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-276871641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-276871641',id=12,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c7f2c51c0f84bf1aedcf493a9ff860f',ramdisk_id='',reservation_id='r-zx07pb5m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-830908511',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:39:48Z,user_data=None,user_id='5a0f55ad018d4c0ca587d8bdd40df4c8',uuid=a9d4ec42-3db9-439b-87a7-02bcaab514a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "address": "fa:16:3e:a8:f5:8b", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa109f4ac-a7", "ovs_interfaceid": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Converting VIF {"id": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "address": "fa:16:3e:a8:f5:8b", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa109f4ac-a7", "ovs_interfaceid": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:f5:8b,bridge_name='br-int',has_traffic_filtering=True,id=a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26,network=Network(4ec437fc-4371-48d6-8026-b64423fbc0ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa109f4ac-a7') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG os_vif [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:f5:8b,bridge_name='br-int',has_traffic_filtering=True,id=a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26,network=Network(4ec437fc-4371-48d6-8026-b64423fbc0ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa109f4ac-a7') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa109f4ac-a7, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa109f4ac-a7, col_values=(('external_ids', {'iface-id': 'a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:f5:8b', 'vm-uuid': 'a9d4ec42-3db9-439b-87a7-02bcaab514a4'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:12 user nova-compute[73484]: INFO os_vif [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:f5:8b,bridge_name='br-int',has_traffic_filtering=True,id=a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26,network=Network(4ec437fc-4371-48d6-8026-b64423fbc0ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa109f4ac-a7')
Aug 14 13:40:12 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] No VIF found with MAC fa:16:3e:a8:f5:8b, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Received event <DeviceRemovedEvent: 1692020412.3232067, 7ac05f68-a20f-4a57-b990-ef0799aadc58 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73484) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7ac05f68-a20f-4a57-b990-ef0799aadc58 {{(pid=73484) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 13:40:12 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Successfully detached device vdb from instance 7ac05f68-a20f-4a57-b990-ef0799aadc58 from the live domain config.
Aug 14 13:40:12 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'matSGeRK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': 'b74c54bf-81bc-4b2a-9dc3-c7186d64df0e'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:40:12 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:40:12 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d9aa10-e13e-4612-896a-cd578f705c80]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be31e26-4775-4cfa-888b-03e85b6f1794]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:40:12 user nova-compute[73484]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:40:12 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:40:12 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e (non-flash)
Aug 14 13:40:12 user nova-compute[73484]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:40:12 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:40:12 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc458652560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e'): ({'sdc'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Removing single pathed devices sdc {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1865c0f3-821d-4731-a5b8-fad7749d8edd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c7470f-51a9-4fbd-9b86-3287bb92daad]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Flushing IO for device /dev/sdc {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f4a603-93e1-433e-bde6-0b51255dd698]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d51210d-fca7-4ecb-9c5e-354adcfc1b30]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8487f441-4608-40e9-93c0-ef60eb8593c7]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9046b380-1726-4ac0-a581-438f3bbcf7f0]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e, portal: 172.16.0.220,3260]
Aug 14 13:40:12 user nova-compute[73484]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e, portal: 172.16.0.220,3260] successful.
Aug 14 13:40:12 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b74c54bf-81bc-4b2a-9dc3-c7186d64df0e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9aa8d0-e7dd-46da-ade4-61d48f2b2d2c]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] <== disconnect_volume: return (283ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:40:12 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:40:13 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692020398.2320888, 18feef86-7a18-43e3-80cb-fb1d01d34d49 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:40:13 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] VM Stopped (Lifecycle Event)
Aug 14 13:40:13 user nova-compute[73484]: DEBUG nova.compute.manager [None req-642b061f-c399-414e-b51e-8e8202fcca60 None None] [instance: 18feef86-7a18-43e3-80cb-fb1d01d34d49] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:40:13 user nova-compute[73484]: DEBUG nova.objects.instance [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lazy-loading 'flavor' on Instance uuid 7ac05f68-a20f-4a57-b990-ef0799aadc58 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:40:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-271106ac-15d4-4c3b-9e91-3a9b443c29f4 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lock "7ac05f68-a20f-4a57-b990-ef0799aadc58" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.634s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:13 user nova-compute[73484]: DEBUG nova.compute.manager [req-4b956613-9d2a-4e1b-a21f-5ba6614b1242 req-402da932-bb41-4fcf-8fa3-5f0b1b6aef75 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Received event network-vif-plugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:40:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4b956613-9d2a-4e1b-a21f-5ba6614b1242 req-402da932-bb41-4fcf-8fa3-5f0b1b6aef75 service nova] Acquiring lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4b956613-9d2a-4e1b-a21f-5ba6614b1242 req-402da932-bb41-4fcf-8fa3-5f0b1b6aef75 service nova] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4b956613-9d2a-4e1b-a21f-5ba6614b1242 req-402da932-bb41-4fcf-8fa3-5f0b1b6aef75 service nova] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:13 user nova-compute[73484]: DEBUG nova.compute.manager [req-4b956613-9d2a-4e1b-a21f-5ba6614b1242 req-402da932-bb41-4fcf-8fa3-5f0b1b6aef75 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] No waiting events found dispatching network-vif-plugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:40:13 user nova-compute[73484]: WARNING nova.compute.manager [req-4b956613-9d2a-4e1b-a21f-5ba6614b1242 req-402da932-bb41-4fcf-8fa3-5f0b1b6aef75 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Received unexpected event network-vif-plugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 for instance with vm_state building and task_state spawning.
Aug 14 13:40:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:15 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020415.6326525, a9d4ec42-3db9-439b-87a7-02bcaab514a4 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:40:15 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] VM Resumed (Lifecycle Event)
Aug 14 13:40:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:40:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:40:15 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Instance spawned successfully.
Aug 14 13:40:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:40:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:40:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:40:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:40:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:40:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:40:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:40:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:40:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:40:15 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:40:15 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020415.6336982, a9d4ec42-3db9-439b-87a7-02bcaab514a4 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:40:15 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] VM Started (Lifecycle Event)
Aug 14 13:40:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:40:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:40:15 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:40:15 user nova-compute[73484]: INFO nova.compute.manager [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Took 5.05 seconds to spawn the instance on the hypervisor.
Aug 14 13:40:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:40:15 user nova-compute[73484]: INFO nova.compute.manager [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Took 28.42 seconds to build instance.
Aug 14 13:40:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3b27534e-4379-4229-b248-0ad6d21ba33c tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.658s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:15 user nova-compute[73484]: DEBUG nova.compute.manager [req-76d202cc-e0e4-490a-8017-ba9824b42696 req-d9c5f15d-3b05-4a2b-a802-689d4c3de5ab service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Received event network-vif-plugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:40:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-76d202cc-e0e4-490a-8017-ba9824b42696 req-d9c5f15d-3b05-4a2b-a802-689d4c3de5ab service nova] Acquiring lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-76d202cc-e0e4-490a-8017-ba9824b42696 req-d9c5f15d-3b05-4a2b-a802-689d4c3de5ab service nova] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-76d202cc-e0e4-490a-8017-ba9824b42696 req-d9c5f15d-3b05-4a2b-a802-689d4c3de5ab service nova] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:15 user nova-compute[73484]: DEBUG nova.compute.manager [req-76d202cc-e0e4-490a-8017-ba9824b42696 req-d9c5f15d-3b05-4a2b-a802-689d4c3de5ab service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] No waiting events found dispatching network-vif-plugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:40:15 user nova-compute[73484]: WARNING nova.compute.manager [req-76d202cc-e0e4-490a-8017-ba9824b42696 req-d9c5f15d-3b05-4a2b-a802-689d4c3de5ab service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Received unexpected event network-vif-plugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 for instance with vm_state active and task_state None.
Aug 14 13:40:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Acquiring lock "20d01b50-8888-4def-a617-5b4e77a45837" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "20d01b50-8888-4def-a617-5b4e77a45837" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:40:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:21 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:40:21 user nova-compute[73484]: INFO nova.compute.claims [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Claim successful on node user
Aug 14 13:40:22 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:22 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:40:22 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:40:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:22 user nova-compute[73484]: DEBUG nova.compute.manager [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:40:22 user nova-compute[73484]: DEBUG nova.compute.manager [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:40:22 user nova-compute[73484]: DEBUG nova.network.neutron [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:40:22 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:40:22 user nova-compute[73484]: DEBUG nova.compute.manager [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:40:22 user nova-compute[73484]: DEBUG nova.policy [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d89860cdc284bc898c650b2a6fc3a2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a95ec66f3424934bdff0335e262cc9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:40:22 user nova-compute[73484]: DEBUG nova.compute.manager [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:40:22 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:40:22 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Creating image(s)
Aug 14 13:40:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Acquiring lock "/opt/stack/data/nova/instances/20d01b50-8888-4def-a617-5b4e77a45837/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "/opt/stack/data/nova/instances/20d01b50-8888-4def-a617-5b4e77a45837/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "/opt/stack/data/nova/instances/20d01b50-8888-4def-a617-5b4e77a45837/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:22 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:22 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.222s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:22 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:22 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.198s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:22 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/20d01b50-8888-4def-a617-5b4e77a45837/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:22 user nova-compute[73484]: DEBUG nova.network.neutron [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Successfully created port: ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:40:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/20d01b50-8888-4def-a617-5b4e77a45837/disk 1073741824" returned: 0 in 0.065s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.201s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:23 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Checking if we can resize image /opt/stack/data/nova/instances/20d01b50-8888-4def-a617-5b4e77a45837/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:40:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d01b50-8888-4def-a617-5b4e77a45837/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d01b50-8888-4def-a617-5b4e77a45837/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:23 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Cannot resize image /opt/stack/data/nova/instances/20d01b50-8888-4def-a617-5b4e77a45837/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:40:23 user nova-compute[73484]: DEBUG nova.objects.instance [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lazy-loading 'migration_context' on Instance uuid 20d01b50-8888-4def-a617-5b4e77a45837 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:40:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:40:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Ensure instance console log exists: /opt/stack/data/nova/instances/20d01b50-8888-4def-a617-5b4e77a45837/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:40:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:23 user nova-compute[73484]: DEBUG nova.network.neutron [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Successfully updated port: ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:40:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Acquiring lock "refresh_cache-20d01b50-8888-4def-a617-5b4e77a45837" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:40:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Acquired lock "refresh_cache-20d01b50-8888-4def-a617-5b4e77a45837" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:40:23 user nova-compute[73484]: DEBUG nova.network.neutron [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:40:23 user nova-compute[73484]: DEBUG nova.compute.manager [req-4546bc2b-ac82-4f3d-8569-b2e7a1fdb00b req-223438d0-2b17-476e-9fd6-0508f7064f32 service nova] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Received event network-changed-ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:40:23 user nova-compute[73484]: DEBUG nova.compute.manager [req-4546bc2b-ac82-4f3d-8569-b2e7a1fdb00b req-223438d0-2b17-476e-9fd6-0508f7064f32 service nova] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Refreshing instance network info cache due to event network-changed-ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:40:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4546bc2b-ac82-4f3d-8569-b2e7a1fdb00b req-223438d0-2b17-476e-9fd6-0508f7064f32 service nova] Acquiring lock "refresh_cache-20d01b50-8888-4def-a617-5b4e77a45837" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:40:23 user nova-compute[73484]: DEBUG nova.network.neutron [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.network.neutron [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Updating instance_info_cache with network_info: [{"id": "ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be", "address": "fa:16:3e:c8:81:2b", "network": {"id": "988c9059-476e-4558-8e68-3cfe68a53a09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1683768593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a95ec66f3424934bdff0335e262cc9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee6fbdc8-24", "ovs_interfaceid": "ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Releasing lock "refresh_cache-20d01b50-8888-4def-a617-5b4e77a45837" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.compute.manager [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Instance network_info: |[{"id": "ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be", "address": "fa:16:3e:c8:81:2b", "network": {"id": "988c9059-476e-4558-8e68-3cfe68a53a09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1683768593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a95ec66f3424934bdff0335e262cc9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee6fbdc8-24", "ovs_interfaceid": "ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4546bc2b-ac82-4f3d-8569-b2e7a1fdb00b req-223438d0-2b17-476e-9fd6-0508f7064f32 service nova] Acquired lock "refresh_cache-20d01b50-8888-4def-a617-5b4e77a45837" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.network.neutron [req-4546bc2b-ac82-4f3d-8569-b2e7a1fdb00b req-223438d0-2b17-476e-9fd6-0508f7064f32 service nova] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Refreshing network info cache for port ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Start _get_guest_xml network_info=[{"id": "ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be", "address": "fa:16:3e:c8:81:2b", "network": {"id": "988c9059-476e-4558-8e68-3cfe68a53a09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1683768593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a95ec66f3424934bdff0335e262cc9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee6fbdc8-24", "ovs_interfaceid": "ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:40:24 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:40:24 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2129585793',display_name='tempest-VolumesAdminNegativeTest-server-2129585793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2129585793',id=14,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a95ec66f3424934bdff0335e262cc9e',ramdisk_id='',reservation_id='r-3bl1mn1n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-730276289',owner_user_name='tempest-VolumesAdminNegativeTest-730276289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:40:22Z,user_data=None,user_id='6d89860cdc284bc898c650b2a6fc3a2a',uuid=20d01b50-8888-4def-a617-5b4e77a45837,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be", "address": "fa:16:3e:c8:81:2b", "network": {"id": "988c9059-476e-4558-8e68-3cfe68a53a09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1683768593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a95ec66f3424934bdff0335e262cc9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee6fbdc8-24", "ovs_interfaceid": "ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Converting VIF {"id": "ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be", "address": "fa:16:3e:c8:81:2b", "network": {"id": "988c9059-476e-4558-8e68-3cfe68a53a09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1683768593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a95ec66f3424934bdff0335e262cc9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee6fbdc8-24", "ovs_interfaceid": "ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:81:2b,bridge_name='br-int',has_traffic_filtering=True,id=ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be,network=Network(988c9059-476e-4558-8e68-3cfe68a53a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee6fbdc8-24') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.objects.instance [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lazy-loading 'pci_devices' on Instance uuid 20d01b50-8888-4def-a617-5b4e77a45837 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:40:24 user nova-compute[73484]:   <uuid>20d01b50-8888-4def-a617-5b4e77a45837</uuid>
Aug 14 13:40:24 user nova-compute[73484]:   <name>instance-0000000e</name>
Aug 14 13:40:24 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:40:24 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:40:24 user nova-compute[73484]:   <metadata>
Aug 14 13:40:24 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:40:24 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:40:24 user nova-compute[73484]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2129585793</nova:name>
Aug 14 13:40:24 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:40:24</nova:creationTime>
Aug 14 13:40:24 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:40:24 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:40:24 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:40:24 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:40:24 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:40:24 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:40:24 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:40:24 user nova-compute[73484]:       <nova:owner>
Aug 14 13:40:24 user nova-compute[73484]:         <nova:user uuid="6d89860cdc284bc898c650b2a6fc3a2a">tempest-VolumesAdminNegativeTest-730276289-project-member</nova:user>
Aug 14 13:40:24 user nova-compute[73484]:         <nova:project uuid="6a95ec66f3424934bdff0335e262cc9e">tempest-VolumesAdminNegativeTest-730276289</nova:project>
Aug 14 13:40:24 user nova-compute[73484]:       </nova:owner>
Aug 14 13:40:24 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:40:24 user nova-compute[73484]:       <nova:ports>
Aug 14 13:40:24 user nova-compute[73484]:         <nova:port uuid="ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be">
Aug 14 13:40:24 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 13:40:24 user nova-compute[73484]:         </nova:port>
Aug 14 13:40:24 user nova-compute[73484]:       </nova:ports>
Aug 14 13:40:24 user nova-compute[73484]:     </nova:instance>
Aug 14 13:40:24 user nova-compute[73484]:   </metadata>
Aug 14 13:40:24 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:40:24 user nova-compute[73484]:     <system>
Aug 14 13:40:24 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:40:24 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:40:24 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:40:24 user nova-compute[73484]:       <entry name="serial">20d01b50-8888-4def-a617-5b4e77a45837</entry>
Aug 14 13:40:24 user nova-compute[73484]:       <entry name="uuid">20d01b50-8888-4def-a617-5b4e77a45837</entry>
Aug 14 13:40:24 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:40:24 user nova-compute[73484]:     </system>
Aug 14 13:40:24 user nova-compute[73484]:   </sysinfo>
Aug 14 13:40:24 user nova-compute[73484]:   <os>
Aug 14 13:40:24 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:40:24 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:40:24 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:40:24 user nova-compute[73484]:   </os>
Aug 14 13:40:24 user nova-compute[73484]:   <features>
Aug 14 13:40:24 user nova-compute[73484]:     <acpi/>
Aug 14 13:40:24 user nova-compute[73484]:     <apic/>
Aug 14 13:40:24 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:40:24 user nova-compute[73484]:   </features>
Aug 14 13:40:24 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:40:24 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:40:24 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:40:24 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:40:24 user nova-compute[73484]:   </clock>
Aug 14 13:40:24 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:40:24 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:40:24 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:40:24 user nova-compute[73484]:   </cpu>
Aug 14 13:40:24 user nova-compute[73484]:   <devices>
Aug 14 13:40:24 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:40:24 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:40:24 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/20d01b50-8888-4def-a617-5b4e77a45837/disk"/>
Aug 14 13:40:24 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:40:24 user nova-compute[73484]:     </disk>
Aug 14 13:40:24 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:40:24 user nova-compute[73484]:       <mac address="fa:16:3e:c8:81:2b"/>
Aug 14 13:40:24 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:40:24 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:40:24 user nova-compute[73484]:       <target dev="tapee6fbdc8-24"/>
Aug 14 13:40:24 user nova-compute[73484]:     </interface>
Aug 14 13:40:24 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:40:24 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/20d01b50-8888-4def-a617-5b4e77a45837/console.log" append="off"/>
Aug 14 13:40:24 user nova-compute[73484]:     </serial>
Aug 14 13:40:24 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:40:24 user nova-compute[73484]:     <video>
Aug 14 13:40:24 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:40:24 user nova-compute[73484]:     </video>
Aug 14 13:40:24 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:40:24 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:40:24 user nova-compute[73484]:     </rng>
Aug 14 13:40:24 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:40:24 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:40:24 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:40:24 user nova-compute[73484]:     </memballoon>
Aug 14 13:40:24 user nova-compute[73484]:   </devices>
Aug 14 13:40:24 user nova-compute[73484]: </domain>
Aug 14 13:40:24 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2129585793',display_name='tempest-VolumesAdminNegativeTest-server-2129585793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2129585793',id=14,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a95ec66f3424934bdff0335e262cc9e',ramdisk_id='',reservation_id='r-3bl1mn1n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-730276289',owner_user_name='tempest-VolumesAdminNegativeTest-730276289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:40:22Z,user_data=None,user_id='6d89860cdc284bc898c650b2a6fc3a2a',uuid=20d01b50-8888-4def-a617-5b4e77a45837,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be", "address": "fa:16:3e:c8:81:2b", "network": {"id": "988c9059-476e-4558-8e68-3cfe68a53a09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1683768593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a95ec66f3424934bdff0335e262cc9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee6fbdc8-24", "ovs_interfaceid": "ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Converting VIF {"id": "ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be", "address": "fa:16:3e:c8:81:2b", "network": {"id": "988c9059-476e-4558-8e68-3cfe68a53a09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1683768593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a95ec66f3424934bdff0335e262cc9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee6fbdc8-24", "ovs_interfaceid": "ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:81:2b,bridge_name='br-int',has_traffic_filtering=True,id=ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be,network=Network(988c9059-476e-4558-8e68-3cfe68a53a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee6fbdc8-24') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG os_vif [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:81:2b,bridge_name='br-int',has_traffic_filtering=True,id=ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be,network=Network(988c9059-476e-4558-8e68-3cfe68a53a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee6fbdc8-24') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee6fbdc8-24, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapee6fbdc8-24, col_values=(('external_ids', {'iface-id': 'ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:81:2b', 'vm-uuid': '20d01b50-8888-4def-a617-5b4e77a45837'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:24 user nova-compute[73484]: INFO os_vif [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:81:2b,bridge_name='br-int',has_traffic_filtering=True,id=ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be,network=Network(988c9059-476e-4558-8e68-3cfe68a53a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee6fbdc8-24')
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] No VIF found with MAC fa:16:3e:c8:81:2b, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.network.neutron [req-4546bc2b-ac82-4f3d-8569-b2e7a1fdb00b req-223438d0-2b17-476e-9fd6-0508f7064f32 service nova] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Updated VIF entry in instance network info cache for port ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG nova.network.neutron [req-4546bc2b-ac82-4f3d-8569-b2e7a1fdb00b req-223438d0-2b17-476e-9fd6-0508f7064f32 service nova] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Updating instance_info_cache with network_info: [{"id": "ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be", "address": "fa:16:3e:c8:81:2b", "network": {"id": "988c9059-476e-4558-8e68-3cfe68a53a09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1683768593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a95ec66f3424934bdff0335e262cc9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee6fbdc8-24", "ovs_interfaceid": "ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:40:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4546bc2b-ac82-4f3d-8569-b2e7a1fdb00b req-223438d0-2b17-476e-9fd6-0508f7064f32 service nova] Releasing lock "refresh_cache-20d01b50-8888-4def-a617-5b4e77a45837" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:40:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:25 user nova-compute[73484]: DEBUG nova.compute.manager [req-ac8538d9-7ed1-4287-ad4e-70a86bbedaad req-b9ab4c48-f255-4d72-8c9f-1778461b6b61 service nova] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Received event network-vif-plugged-ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:40:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ac8538d9-7ed1-4287-ad4e-70a86bbedaad req-b9ab4c48-f255-4d72-8c9f-1778461b6b61 service nova] Acquiring lock "20d01b50-8888-4def-a617-5b4e77a45837-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ac8538d9-7ed1-4287-ad4e-70a86bbedaad req-b9ab4c48-f255-4d72-8c9f-1778461b6b61 service nova] Lock "20d01b50-8888-4def-a617-5b4e77a45837-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ac8538d9-7ed1-4287-ad4e-70a86bbedaad req-b9ab4c48-f255-4d72-8c9f-1778461b6b61 service nova] Lock "20d01b50-8888-4def-a617-5b4e77a45837-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:25 user nova-compute[73484]: DEBUG nova.compute.manager [req-ac8538d9-7ed1-4287-ad4e-70a86bbedaad req-b9ab4c48-f255-4d72-8c9f-1778461b6b61 service nova] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] No waiting events found dispatching network-vif-plugged-ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:40:25 user nova-compute[73484]: WARNING nova.compute.manager [req-ac8538d9-7ed1-4287-ad4e-70a86bbedaad req-b9ab4c48-f255-4d72-8c9f-1778461b6b61 service nova] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Received unexpected event network-vif-plugged-ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be for instance with vm_state building and task_state spawning.
Aug 14 13:40:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:27 user nova-compute[73484]: DEBUG nova.compute.manager [req-295af8b5-52a5-4e7a-b3af-b60015270e20 req-5e96326a-6164-4054-bc32-3ecaebb9db63 service nova] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Received event network-vif-plugged-ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:40:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-295af8b5-52a5-4e7a-b3af-b60015270e20 req-5e96326a-6164-4054-bc32-3ecaebb9db63 service nova] Acquiring lock "20d01b50-8888-4def-a617-5b4e77a45837-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-295af8b5-52a5-4e7a-b3af-b60015270e20 req-5e96326a-6164-4054-bc32-3ecaebb9db63 service nova] Lock "20d01b50-8888-4def-a617-5b4e77a45837-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-295af8b5-52a5-4e7a-b3af-b60015270e20 req-5e96326a-6164-4054-bc32-3ecaebb9db63 service nova] Lock "20d01b50-8888-4def-a617-5b4e77a45837-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:27 user nova-compute[73484]: DEBUG nova.compute.manager [req-295af8b5-52a5-4e7a-b3af-b60015270e20 req-5e96326a-6164-4054-bc32-3ecaebb9db63 service nova] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] No waiting events found dispatching network-vif-plugged-ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:40:27 user nova-compute[73484]: WARNING nova.compute.manager [req-295af8b5-52a5-4e7a-b3af-b60015270e20 req-5e96326a-6164-4054-bc32-3ecaebb9db63 service nova] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Received unexpected event network-vif-plugged-ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be for instance with vm_state building and task_state spawning.
Aug 14 13:40:27 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020427.860939, 20d01b50-8888-4def-a617-5b4e77a45837 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:40:27 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] VM Resumed (Lifecycle Event)
Aug 14 13:40:27 user nova-compute[73484]: DEBUG nova.compute.manager [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:40:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:40:27 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Instance spawned successfully.
Aug 14 13:40:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:40:27 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:40:27 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:40:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:40:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:40:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:40:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:40:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:40:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:40:27 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:40:27 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020427.8622594, 20d01b50-8888-4def-a617-5b4e77a45837 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:40:27 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] VM Started (Lifecycle Event)
Aug 14 13:40:27 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:40:27 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:40:27 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:40:27 user nova-compute[73484]: INFO nova.compute.manager [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Took 5.47 seconds to spawn the instance on the hypervisor.
Aug 14 13:40:27 user nova-compute[73484]: DEBUG nova.compute.manager [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:40:28 user nova-compute[73484]: INFO nova.compute.manager [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Took 6.19 seconds to build instance.
Aug 14 13:40:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fa466e6e-a5a8-48f8-93da-f67a4cfb1cac tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "20d01b50-8888-4def-a617-5b4e77a45837" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.284s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2e9b6cbd-be97-4a95-8103-6bc9428a840b tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Acquiring lock "377257a6-916e-4269-bc53-a81d8bed6bdb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2e9b6cbd-be97-4a95-8103-6bc9428a840b tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Lock "377257a6-916e-4269-bc53-a81d8bed6bdb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2e9b6cbd-be97-4a95-8103-6bc9428a840b tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Acquiring lock "377257a6-916e-4269-bc53-a81d8bed6bdb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2e9b6cbd-be97-4a95-8103-6bc9428a840b tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Lock "377257a6-916e-4269-bc53-a81d8bed6bdb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2e9b6cbd-be97-4a95-8103-6bc9428a840b tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Lock "377257a6-916e-4269-bc53-a81d8bed6bdb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:28 user nova-compute[73484]: INFO nova.compute.manager [None req-2e9b6cbd-be97-4a95-8103-6bc9428a840b tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Terminating instance
Aug 14 13:40:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-2e9b6cbd-be97-4a95-8103-6bc9428a840b tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:40:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:28 user nova-compute[73484]: DEBUG nova.compute.manager [req-26dac99f-5ca7-488e-958b-9dd3a80443ed req-013bcda4-ab82-48ae-98d3-d4df316326e8 service nova] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Received event network-vif-unplugged-16674c9f-fc44-461d-ac6b-1a7239360f06 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:40:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-26dac99f-5ca7-488e-958b-9dd3a80443ed req-013bcda4-ab82-48ae-98d3-d4df316326e8 service nova] Acquiring lock "377257a6-916e-4269-bc53-a81d8bed6bdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-26dac99f-5ca7-488e-958b-9dd3a80443ed req-013bcda4-ab82-48ae-98d3-d4df316326e8 service nova] Lock "377257a6-916e-4269-bc53-a81d8bed6bdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-26dac99f-5ca7-488e-958b-9dd3a80443ed req-013bcda4-ab82-48ae-98d3-d4df316326e8 service nova] Lock "377257a6-916e-4269-bc53-a81d8bed6bdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:28 user nova-compute[73484]: DEBUG nova.compute.manager [req-26dac99f-5ca7-488e-958b-9dd3a80443ed req-013bcda4-ab82-48ae-98d3-d4df316326e8 service nova] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] No waiting events found dispatching network-vif-unplugged-16674c9f-fc44-461d-ac6b-1a7239360f06 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:40:28 user nova-compute[73484]: DEBUG nova.compute.manager [req-26dac99f-5ca7-488e-958b-9dd3a80443ed req-013bcda4-ab82-48ae-98d3-d4df316326e8 service nova] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Received event network-vif-unplugged-16674c9f-fc44-461d-ac6b-1a7239360f06 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:40:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:28 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Instance destroyed successfully.
Aug 14 13:40:28 user nova-compute[73484]: DEBUG nova.objects.instance [None req-2e9b6cbd-be97-4a95-8103-6bc9428a840b tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Lazy-loading 'resources' on Instance uuid 377257a6-916e-4269-bc53-a81d8bed6bdb {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:40:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-2e9b6cbd-be97-4a95-8103-6bc9428a840b tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-903355159',display_name='tempest-VolumesAssistedSnapshotsTest-server-903355159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-903355159',id=6,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKwYW5kfSCK4Ikb6IEBR2A3Wi1QOLjgj/lI8Hw/M9tXCiZlSo1wMcAqx5xKdtrFuWIifz3dnwbltE0WvK5zYBMn3UEmy5mQ+rldU+mxzofxZ/aWUIU19+NmRei+5ZmwaA==',key_name='tempest-keypair-660594573',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:37:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd28ddec1473427ca368b92bb6fbd1df',ramdisk_id='',reservation_id='r-7oxnzmw6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1411250009',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1411250009-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:37:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9bac745e5da4b4f9bccf6aa53c45a4a',uuid=377257a6-916e-4269-bc53-a81d8bed6bdb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16674c9f-fc44-461d-ac6b-1a7239360f06", "address": "fa:16:3e:3e:15:05", "network": {"id": "4d15ff21-bb7f-4f6f-a5cb-7a77b1fd50a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-471876759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd28ddec1473427ca368b92bb6fbd1df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16674c9f-fc", "ovs_interfaceid": "16674c9f-fc44-461d-ac6b-1a7239360f06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:40:28 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-2e9b6cbd-be97-4a95-8103-6bc9428a840b tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Converting VIF {"id": "16674c9f-fc44-461d-ac6b-1a7239360f06", "address": "fa:16:3e:3e:15:05", "network": {"id": "4d15ff21-bb7f-4f6f-a5cb-7a77b1fd50a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-471876759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd28ddec1473427ca368b92bb6fbd1df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16674c9f-fc", "ovs_interfaceid": "16674c9f-fc44-461d-ac6b-1a7239360f06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:40:28 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-2e9b6cbd-be97-4a95-8103-6bc9428a840b tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:15:05,bridge_name='br-int',has_traffic_filtering=True,id=16674c9f-fc44-461d-ac6b-1a7239360f06,network=Network(4d15ff21-bb7f-4f6f-a5cb-7a77b1fd50a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16674c9f-fc') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:40:28 user nova-compute[73484]: DEBUG os_vif [None req-2e9b6cbd-be97-4a95-8103-6bc9428a840b tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:15:05,bridge_name='br-int',has_traffic_filtering=True,id=16674c9f-fc44-461d-ac6b-1a7239360f06,network=Network(4d15ff21-bb7f-4f6f-a5cb-7a77b1fd50a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16674c9f-fc') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:40:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16674c9f-fc, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:40:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:40:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:29 user nova-compute[73484]: INFO os_vif [None req-2e9b6cbd-be97-4a95-8103-6bc9428a840b tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:15:05,bridge_name='br-int',has_traffic_filtering=True,id=16674c9f-fc44-461d-ac6b-1a7239360f06,network=Network(4d15ff21-bb7f-4f6f-a5cb-7a77b1fd50a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16674c9f-fc')
Aug 14 13:40:29 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-2e9b6cbd-be97-4a95-8103-6bc9428a840b tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Deleting instance files /opt/stack/data/nova/instances/377257a6-916e-4269-bc53-a81d8bed6bdb_del
Aug 14 13:40:29 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-2e9b6cbd-be97-4a95-8103-6bc9428a840b tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Deletion of /opt/stack/data/nova/instances/377257a6-916e-4269-bc53-a81d8bed6bdb_del complete
Aug 14 13:40:29 user nova-compute[73484]: INFO nova.compute.manager [None req-2e9b6cbd-be97-4a95-8103-6bc9428a840b tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 14 13:40:29 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-2e9b6cbd-be97-4a95-8103-6bc9428a840b tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:40:29 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:40:29 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:40:30 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:40:30 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Took 0.92 seconds to deallocate network for instance.
Aug 14 13:40:30 user nova-compute[73484]: DEBUG nova.compute.manager [req-72eda3eb-eb41-47db-9430-48eda9318552 req-03a73d7a-58b6-4603-a00e-7965ed73f421 service nova] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Received event network-vif-deleted-16674c9f-fc44-461d-ac6b-1a7239360f06 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:40:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2e9b6cbd-be97-4a95-8103-6bc9428a840b tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2e9b6cbd-be97-4a95-8103-6bc9428a840b tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:30 user nova-compute[73484]: DEBUG nova.compute.manager [req-ab6921d0-270c-4cb6-aa25-2550a45b5fd2 req-49a18000-ef9b-4e0f-8754-32e33caad780 service nova] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Received event network-vif-plugged-16674c9f-fc44-461d-ac6b-1a7239360f06 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:40:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ab6921d0-270c-4cb6-aa25-2550a45b5fd2 req-49a18000-ef9b-4e0f-8754-32e33caad780 service nova] Acquiring lock "377257a6-916e-4269-bc53-a81d8bed6bdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ab6921d0-270c-4cb6-aa25-2550a45b5fd2 req-49a18000-ef9b-4e0f-8754-32e33caad780 service nova] Lock "377257a6-916e-4269-bc53-a81d8bed6bdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ab6921d0-270c-4cb6-aa25-2550a45b5fd2 req-49a18000-ef9b-4e0f-8754-32e33caad780 service nova] Lock "377257a6-916e-4269-bc53-a81d8bed6bdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:30 user nova-compute[73484]: DEBUG nova.compute.manager [req-ab6921d0-270c-4cb6-aa25-2550a45b5fd2 req-49a18000-ef9b-4e0f-8754-32e33caad780 service nova] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] No waiting events found dispatching network-vif-plugged-16674c9f-fc44-461d-ac6b-1a7239360f06 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:40:30 user nova-compute[73484]: WARNING nova.compute.manager [req-ab6921d0-270c-4cb6-aa25-2550a45b5fd2 req-49a18000-ef9b-4e0f-8754-32e33caad780 service nova] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Received unexpected event network-vif-plugged-16674c9f-fc44-461d-ac6b-1a7239360f06 for instance with vm_state deleted and task_state None.
Aug 14 13:40:30 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-2e9b6cbd-be97-4a95-8103-6bc9428a840b tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:40:30 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-2e9b6cbd-be97-4a95-8103-6bc9428a840b tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:40:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2e9b6cbd-be97-4a95-8103-6bc9428a840b tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.459s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:30 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-2e9b6cbd-be97-4a95-8103-6bc9428a840b tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Deleted allocations for instance 377257a6-916e-4269-bc53-a81d8bed6bdb
Aug 14 13:40:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2e9b6cbd-be97-4a95-8103-6bc9428a840b tempest-VolumesAssistedSnapshotsTest-1411250009 tempest-VolumesAssistedSnapshotsTest-1411250009-project-member] Lock "377257a6-916e-4269-bc53-a81d8bed6bdb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.724s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:30 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:40:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d6e6a2e3-dde0-4c61-bf69-4a92330b349e tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Acquiring lock "7348b004-4d46-4db5-a451-afd3b7476569" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d6e6a2e3-dde0-4c61-bf69-4a92330b349e tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "7348b004-4d46-4db5-a451-afd3b7476569" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d6e6a2e3-dde0-4c61-bf69-4a92330b349e tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Acquiring lock "7348b004-4d46-4db5-a451-afd3b7476569-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d6e6a2e3-dde0-4c61-bf69-4a92330b349e tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "7348b004-4d46-4db5-a451-afd3b7476569-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d6e6a2e3-dde0-4c61-bf69-4a92330b349e tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "7348b004-4d46-4db5-a451-afd3b7476569-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:31 user nova-compute[73484]: INFO nova.compute.manager [None req-d6e6a2e3-dde0-4c61-bf69-4a92330b349e tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Terminating instance
Aug 14 13:40:31 user nova-compute[73484]: DEBUG nova.compute.manager [None req-d6e6a2e3-dde0-4c61-bf69-4a92330b349e tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:40:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:31 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:40:31 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Instance destroyed successfully.
Aug 14 13:40:31 user nova-compute[73484]: DEBUG nova.objects.instance [None req-d6e6a2e3-dde0-4c61-bf69-4a92330b349e tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lazy-loading 'resources' on Instance uuid 7348b004-4d46-4db5-a451-afd3b7476569 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:40:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-d6e6a2e3-dde0-4c61-bf69-4a92330b349e tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:37:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-522186817',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-522186817',id=9,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiK6LkV4LYXJ9k8WiSdM3r6iHP8qN1XXbA8EbfSGkzqKZ1oy8APH01wj6TnPRn+92njmmJyEDjXb8n2RsiEiMAkKvCvz4+a7zm6gB5yZrCVjYB/hhRdrNwSW43XY6YGlg==',key_name='tempest-keypair-2063229418',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:37:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='900fe242d672495d832feee598acf991',ramdisk_id='',reservation_id='r-smdsx10g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-696464863',owner_user_name='tempest-TaggedAttachmentsTest-696464863-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:37:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='602233ac777c42ac8f97536c706d5fd8',uuid=7348b004-4d46-4db5-a451-afd3b7476569,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2eb5bc00-16a1-43cd-ac1f-db1d191fba75", "address": "fa:16:3e:a3:34:4e", "network": {"id": "06967e28-4529-4bb4-913e-406da0cbf817", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-360793833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "900fe242d672495d832feee598acf991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb5bc00-16", "ovs_interfaceid": "2eb5bc00-16a1-43cd-ac1f-db1d191fba75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:40:31 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-d6e6a2e3-dde0-4c61-bf69-4a92330b349e tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Converting VIF {"id": "2eb5bc00-16a1-43cd-ac1f-db1d191fba75", "address": "fa:16:3e:a3:34:4e", "network": {"id": "06967e28-4529-4bb4-913e-406da0cbf817", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-360793833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "900fe242d672495d832feee598acf991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eb5bc00-16", "ovs_interfaceid": "2eb5bc00-16a1-43cd-ac1f-db1d191fba75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:40:31 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-d6e6a2e3-dde0-4c61-bf69-4a92330b349e tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:34:4e,bridge_name='br-int',has_traffic_filtering=True,id=2eb5bc00-16a1-43cd-ac1f-db1d191fba75,network=Network(06967e28-4529-4bb4-913e-406da0cbf817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb5bc00-16') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:40:31 user nova-compute[73484]: DEBUG os_vif [None req-d6e6a2e3-dde0-4c61-bf69-4a92330b349e tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:34:4e,bridge_name='br-int',has_traffic_filtering=True,id=2eb5bc00-16a1-43cd-ac1f-db1d191fba75,network=Network(06967e28-4529-4bb4-913e-406da0cbf817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb5bc00-16') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:40:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2eb5bc00-16, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:40:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:40:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:31 user nova-compute[73484]: INFO os_vif [None req-d6e6a2e3-dde0-4c61-bf69-4a92330b349e tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:34:4e,bridge_name='br-int',has_traffic_filtering=True,id=2eb5bc00-16a1-43cd-ac1f-db1d191fba75,network=Network(06967e28-4529-4bb4-913e-406da0cbf817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eb5bc00-16')
Aug 14 13:40:31 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-d6e6a2e3-dde0-4c61-bf69-4a92330b349e tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Deleting instance files /opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569_del
Aug 14 13:40:31 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-d6e6a2e3-dde0-4c61-bf69-4a92330b349e tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Deletion of /opt/stack/data/nova/instances/7348b004-4d46-4db5-a451-afd3b7476569_del complete
Aug 14 13:40:31 user nova-compute[73484]: INFO nova.compute.manager [None req-d6e6a2e3-dde0-4c61-bf69-4a92330b349e tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 14 13:40:31 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-d6e6a2e3-dde0-4c61-bf69-4a92330b349e tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:40:31 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:40:31 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:40:32 user nova-compute[73484]: DEBUG nova.compute.manager [req-0ef872bf-3082-4a22-8619-b4eb4645991b req-ff6922d6-6cb1-441e-9db5-c24336c4615f service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Received event network-vif-unplugged-2eb5bc00-16a1-43cd-ac1f-db1d191fba75 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:40:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0ef872bf-3082-4a22-8619-b4eb4645991b req-ff6922d6-6cb1-441e-9db5-c24336c4615f service nova] Acquiring lock "7348b004-4d46-4db5-a451-afd3b7476569-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0ef872bf-3082-4a22-8619-b4eb4645991b req-ff6922d6-6cb1-441e-9db5-c24336c4615f service nova] Lock "7348b004-4d46-4db5-a451-afd3b7476569-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0ef872bf-3082-4a22-8619-b4eb4645991b req-ff6922d6-6cb1-441e-9db5-c24336c4615f service nova] Lock "7348b004-4d46-4db5-a451-afd3b7476569-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:32 user nova-compute[73484]: DEBUG nova.compute.manager [req-0ef872bf-3082-4a22-8619-b4eb4645991b req-ff6922d6-6cb1-441e-9db5-c24336c4615f service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] No waiting events found dispatching network-vif-unplugged-2eb5bc00-16a1-43cd-ac1f-db1d191fba75 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:40:32 user nova-compute[73484]: DEBUG nova.compute.manager [req-0ef872bf-3082-4a22-8619-b4eb4645991b req-ff6922d6-6cb1-441e-9db5-c24336c4615f service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Received event network-vif-unplugged-2eb5bc00-16a1-43cd-ac1f-db1d191fba75 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:40:32 user nova-compute[73484]: DEBUG nova.compute.manager [req-0ef872bf-3082-4a22-8619-b4eb4645991b req-ff6922d6-6cb1-441e-9db5-c24336c4615f service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Received event network-vif-plugged-2eb5bc00-16a1-43cd-ac1f-db1d191fba75 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:40:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0ef872bf-3082-4a22-8619-b4eb4645991b req-ff6922d6-6cb1-441e-9db5-c24336c4615f service nova] Acquiring lock "7348b004-4d46-4db5-a451-afd3b7476569-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0ef872bf-3082-4a22-8619-b4eb4645991b req-ff6922d6-6cb1-441e-9db5-c24336c4615f service nova] Lock "7348b004-4d46-4db5-a451-afd3b7476569-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0ef872bf-3082-4a22-8619-b4eb4645991b req-ff6922d6-6cb1-441e-9db5-c24336c4615f service nova] Lock "7348b004-4d46-4db5-a451-afd3b7476569-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:32 user nova-compute[73484]: DEBUG nova.compute.manager [req-0ef872bf-3082-4a22-8619-b4eb4645991b req-ff6922d6-6cb1-441e-9db5-c24336c4615f service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] No waiting events found dispatching network-vif-plugged-2eb5bc00-16a1-43cd-ac1f-db1d191fba75 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:40:32 user nova-compute[73484]: WARNING nova.compute.manager [req-0ef872bf-3082-4a22-8619-b4eb4645991b req-ff6922d6-6cb1-441e-9db5-c24336c4615f service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Received unexpected event network-vif-plugged-2eb5bc00-16a1-43cd-ac1f-db1d191fba75 for instance with vm_state active and task_state deleting.
Aug 14 13:40:32 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:40:32 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 13:40:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-66e161f1-2f3b-4777-9a0d-5f4d62e850d5" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:40:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-66e161f1-2f3b-4777-9a0d-5f4d62e850d5" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:40:33 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 13:40:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:33 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:40:33 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Took 1.64 seconds to deallocate network for instance.
Aug 14 13:40:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d6e6a2e3-dde0-4c61-bf69-4a92330b349e tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d6e6a2e3-dde0-4c61-bf69-4a92330b349e tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:34 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Updating instance_info_cache with network_info: [{"id": "290c0b61-ba11-4074-a7f2-cb172a576a19", "address": "fa:16:3e:69:2f:ce", "network": {"id": "2306cc91-8443-4c0e-b5a6-3883766b686a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-577320480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ea5214248845418e322d18d298c449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap290c0b61-ba", "ovs_interfaceid": "290c0b61-ba11-4074-a7f2-cb172a576a19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:40:34 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-d6e6a2e3-dde0-4c61-bf69-4a92330b349e tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:40:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-66e161f1-2f3b-4777-9a0d-5f4d62e850d5" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:40:34 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 13:40:34 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:40:34 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 13:40:34 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-d6e6a2e3-dde0-4c61-bf69-4a92330b349e tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:40:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d6e6a2e3-dde0-4c61-bf69-4a92330b349e tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.483s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:34 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-d6e6a2e3-dde0-4c61-bf69-4a92330b349e tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Deleted allocations for instance 7348b004-4d46-4db5-a451-afd3b7476569
Aug 14 13:40:34 user nova-compute[73484]: DEBUG nova.compute.manager [req-1e28cbd3-e5e7-4765-b38a-65ab03f06a06 req-e344415a-b1fb-4f74-9227-28b48e83408f service nova] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Received event network-vif-deleted-2eb5bc00-16a1-43cd-ac1f-db1d191fba75 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:40:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d6e6a2e3-dde0-4c61-bf69-4a92330b349e tempest-TaggedAttachmentsTest-696464863 tempest-TaggedAttachmentsTest-696464863-project-member] Lock "7348b004-4d46-4db5-a451-afd3b7476569" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.251s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:34 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:40:34 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:40:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:34 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 13:40:34 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:40:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:40:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac05f68-a20f-4a57-b990-ef0799aadc58/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac05f68-a20f-4a57-b990-ef0799aadc58/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac05f68-a20f-4a57-b990-ef0799aadc58/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ac05f68-a20f-4a57-b990-ef0799aadc58/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856807c9-af22-4be7-834e-2d7003329f8c/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856807c9-af22-4be7-834e-2d7003329f8c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856807c9-af22-4be7-834e-2d7003329f8c/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856807c9-af22-4be7-834e-2d7003329f8c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:37 user nova-compute[73484]: WARNING nova.compute.manager [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Timeout waiting for ['volume-reimaged-abbda33a-ae60-404c-85b3-9df266cc1567'] for instance with vm_state active and task_state rebuilding. Event states are: volume-reimaged-abbda33a-ae60-404c-85b3-9df266cc1567: timed out after 60.00 seconds: eventlet.timeout.Timeout: 60 seconds
Aug 14 13:40:37 user nova-compute[73484]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_serialization/jsonutils.py:180: UserWarning: Cannot convert <Timeout at 0x7fc478369cc0 seconds=60> to primitive, will raise ValueError instead of warning in version 3.0
Aug 14 13:40:37 user nova-compute[73484]:   warnings.warn("Cannot convert %r to primitive, will raise ValueError "
Aug 14 13:40:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d01b50-8888-4def-a617-5b4e77a45837/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d01b50-8888-4def-a617-5b4e77a45837/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d01b50-8888-4def-a617-5b4e77a45837/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:38 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:40:38 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:40:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:38 user nova-compute[73484]: INFO nova.compute.manager [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Successfully reverted task state from rebuilding on failure for instance.
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server [None req-5bcd539a-b476-4656-8f67-f28e609fba24 tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Exception during message handling: ValueError: Circular reference detected
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3841, in rebuild_instance
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance_with_claim(
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3927, in _do_rebuild_instance_with_claim
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance(
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4119, in _do_rebuild_instance
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     self._rebuild_default_impl(**kwargs)
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3697, in _rebuild_default_impl
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     self._rebuild_volume_backed_instance(
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3617, in _rebuild_volume_backed_instance
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     with self.virtapi.wait_for_instance_event(instance, events,
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     next(self.gen)
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 559, in wait_for_instance_event
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     self._wait_for_instance_events(
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 471, in _wait_for_instance_events
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     actual_event = event.wait()
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 436, in wait
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     instance_event = self.event.wait()
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/event.py", line 125, in wait
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     result = hub.switch()
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/hub.py", line 313, in switch
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     return self.greenlet.switch()
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server eventlet.timeout.Timeout: 60 seconds
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server 
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server 
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1437, in decorated_function
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     with EventReporter(context, event_name, host, instance_uuid,
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1400, in __exit__
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     objects.InstanceActionEvent.event_finish_with_failure(
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/objects/base.py", line 355, in wrapper
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     return fn.__get__(None, obj)(*args, **kwargs)
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     result = cls.indirection_api.object_class_action_versions(
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     return cctxt.call(context, 'object_class_action_versions',
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/client.py", line 190, in call
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     result = self.transport._send(
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/transport.py", line 123, in _send
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     return self._driver.send(target, ctxt, message,
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     return self._send(target, ctxt, message, wait_for_reply, timeout,
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 644, in _send
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     msg = rpc_common.serialize_msg(msg)
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/common.py", line 292, in serialize_msg
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     _MESSAGE_KEY: jsonutils.dumps(raw_msg)}
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_serialization/jsonutils.py", line 202, in dumps
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     return json.dumps(obj, default=default, **kwargs)
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/__init__.py", line 238, in dumps
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     **kw).encode(obj)
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/encoder.py", line 199, in encode
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     chunks = self.iterencode(o, _one_shot=True)
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/encoder.py", line 257, in iterencode
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server     return _iterencode(o, 0)
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server ValueError: Circular reference detected
Aug 14 13:40:38 user nova-compute[73484]: ERROR oslo_messaging.rpc.server 
Aug 14 13:40:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d01b50-8888-4def-a617-5b4e77a45837/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:38 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:40:38 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:40:38 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=7670MB free_disk=25.678050994873047GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 13:40:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:38 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance f4f7788c-fcca-47c1-b5b8-72892253982d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:40:38 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:40:38 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:40:38 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 07bac569-8b2c-4555-b4d5-a74f7384630b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:40:38 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance b889688d-13dd-4f7b-bfef-26dc5347fd6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:40:38 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 7ac05f68-a20f-4a57-b990-ef0799aadc58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:40:38 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance eaaccbea-d453-4943-9663-949c66029d87 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:40:38 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance a9d4ec42-3db9-439b-87a7-02bcaab514a4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:40:38 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 856807c9-af22-4be7-834e-2d7003329f8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:40:38 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 20d01b50-8888-4def-a617-5b4e77a45837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:40:38 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 13:40:38 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 13:40:39 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:40:39 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:40:39 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 13:40:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.497s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:40 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:40:40 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:40:40 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:40:40 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:40:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Acquiring lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:41 user nova-compute[73484]: DEBUG nova.objects.instance [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lazy-loading 'flavor' on Instance uuid 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:40:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Acquiring lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:41 user nova-compute[73484]: INFO nova.compute.manager [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Attaching volume 383633e0-0201-479d-8e03-3a15c3341c1d to /dev/vdb
Aug 14 13:40:41 user nova-compute[73484]: DEBUG os_brick.utils [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:40:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:41 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[04203f71-e444-4ecb-a542-f84c904d832c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:41 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f55cc6e-d22c-468f-a5ac-2166d1b334ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:41 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc004fd7-ae88-47dc-9567-161f5b399d14]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:41 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[32266af0-ce17-4d74-98a9-8449c9d12835]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:40:41 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:40:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:40:41 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:40:41 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7f3684-8e5b-4faf-a364-0ad0bfd71982]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:41 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:40:41 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:40:41 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:40:41 user nova-compute[73484]: DEBUG os_brick.utils [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:40:41 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Updating existing volume attachment record: 6abde082-4520-42f8-833a-6b4ae9cf4a65 {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:40:41 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "ed239af5-980e-42d3-8ebd-ca100ccb2708" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "ed239af5-980e-42d3-8ebd-ca100ccb2708" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:43 user nova-compute[73484]: DEBUG nova.compute.manager [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:40:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:43 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:40:43 user nova-compute[73484]: INFO nova.compute.claims [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Claim successful on node user
Aug 14 13:40:43 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692020428.9501731, 377257a6-916e-4269-bc53-a81d8bed6bdb => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:40:43 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] VM Stopped (Lifecycle Event)
Aug 14 13:40:43 user nova-compute[73484]: DEBUG nova.compute.manager [None req-19889f9f-754e-4b83-850e-677b3050a274 None None] [instance: 377257a6-916e-4269-bc53-a81d8bed6bdb] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:40:44 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:40:44 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:40:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:44 user nova-compute[73484]: DEBUG nova.compute.manager [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:40:44 user nova-compute[73484]: DEBUG nova.compute.manager [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:40:44 user nova-compute[73484]: DEBUG nova.network.neutron [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:40:44 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:40:44 user nova-compute[73484]: DEBUG nova.compute.manager [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:40:44 user nova-compute[73484]: DEBUG nova.compute.manager [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:40:44 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:40:44 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Creating image(s)
Aug 14 13:40:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "/opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "/opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:44 user nova-compute[73484]: DEBUG nova.policy [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b22dfe5647e149a5b3a19d843f0efd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9e3bd3df8a408e96e9054775c3cb83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:40:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.175s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.259s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk 1073741824" returned: 0 in 0.053s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.319s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.182s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:44 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:40:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:45 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Cannot resize image /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:40:45 user nova-compute[73484]: DEBUG nova.objects.instance [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lazy-loading 'migration_context' on Instance uuid ed239af5-980e-42d3-8ebd-ca100ccb2708 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:40:45 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:40:45 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Ensure instance console log exists: /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:40:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:45 user nova-compute[73484]: DEBUG nova.network.neutron [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Successfully created port: cfbf4211-f3cb-49ad-98dd-68029d497e5f {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.network.neutron [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Successfully updated port: cfbf4211-f3cb-49ad-98dd-68029d497e5f {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "refresh_cache-ed239af5-980e-42d3-8ebd-ca100ccb2708" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquired lock "refresh_cache-ed239af5-980e-42d3-8ebd-ca100ccb2708" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.network.neutron [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.compute.manager [req-8424283d-98ed-4928-9051-2b709c91acc1 req-dea866be-b091-4f4d-ab12-5152ed620399 service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Received event network-changed-cfbf4211-f3cb-49ad-98dd-68029d497e5f {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.compute.manager [req-8424283d-98ed-4928-9051-2b709c91acc1 req-dea866be-b091-4f4d-ab12-5152ed620399 service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Refreshing instance network info cache due to event network-changed-cfbf4211-f3cb-49ad-98dd-68029d497e5f. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8424283d-98ed-4928-9051-2b709c91acc1 req-dea866be-b091-4f4d-ab12-5152ed620399 service nova] Acquiring lock "refresh_cache-ed239af5-980e-42d3-8ebd-ca100ccb2708" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.network.neutron [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.network.neutron [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Updating instance_info_cache with network_info: [{"id": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "address": "fa:16:3e:c9:13:42", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbf4211-f3", "ovs_interfaceid": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Releasing lock "refresh_cache-ed239af5-980e-42d3-8ebd-ca100ccb2708" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.compute.manager [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Instance network_info: |[{"id": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "address": "fa:16:3e:c9:13:42", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbf4211-f3", "ovs_interfaceid": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8424283d-98ed-4928-9051-2b709c91acc1 req-dea866be-b091-4f4d-ab12-5152ed620399 service nova] Acquired lock "refresh_cache-ed239af5-980e-42d3-8ebd-ca100ccb2708" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.network.neutron [req-8424283d-98ed-4928-9051-2b709c91acc1 req-dea866be-b091-4f4d-ab12-5152ed620399 service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Refreshing network info cache for port cfbf4211-f3cb-49ad-98dd-68029d497e5f {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Start _get_guest_xml network_info=[{"id": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "address": "fa:16:3e:c9:13:42", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbf4211-f3", "ovs_interfaceid": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:40:46 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:40:46 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-808860414',display_name='tempest-tempest.common.compute-instance-808860414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-808860414',id=15,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeXNpb9XHaUrVlh12GX9afYS4uhArSHw3Bmb57wtkUnIoEAuE3Mh/kr8GY8u6/64wrETW58CSBoYMy9LyrbLjI8XQndUnGuUz3mUsWp7LyaF/HaeOtI27YfARpw+mLtGw==',key_name='tempest-keypair-1210865444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff9e3bd3df8a408e96e9054775c3cb83',ramdisk_id='',reservation_id='r-vq274olh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2033458528',owner_user_name='tempest-ServerActionsTestOtherA-2033458528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:40:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b22dfe5647e149a5b3a19d843f0efd66',uuid=ed239af5-980e-42d3-8ebd-ca100ccb2708,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "address": "fa:16:3e:c9:13:42", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbf4211-f3", "ovs_interfaceid": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Converting VIF {"id": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "address": "fa:16:3e:c9:13:42", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbf4211-f3", "ovs_interfaceid": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:13:42,bridge_name='br-int',has_traffic_filtering=True,id=cfbf4211-f3cb-49ad-98dd-68029d497e5f,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbf4211-f3') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.objects.instance [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lazy-loading 'pci_devices' on Instance uuid ed239af5-980e-42d3-8ebd-ca100ccb2708 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:40:46 user nova-compute[73484]:   <uuid>ed239af5-980e-42d3-8ebd-ca100ccb2708</uuid>
Aug 14 13:40:46 user nova-compute[73484]:   <name>instance-0000000f</name>
Aug 14 13:40:46 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:40:46 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:40:46 user nova-compute[73484]:   <metadata>
Aug 14 13:40:46 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:40:46 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:40:46 user nova-compute[73484]:       <nova:name>tempest-tempest.common.compute-instance-808860414</nova:name>
Aug 14 13:40:46 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:40:46</nova:creationTime>
Aug 14 13:40:46 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:40:46 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:40:46 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:40:46 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:40:46 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:40:46 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:40:46 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:40:46 user nova-compute[73484]:       <nova:owner>
Aug 14 13:40:46 user nova-compute[73484]:         <nova:user uuid="b22dfe5647e149a5b3a19d843f0efd66">tempest-ServerActionsTestOtherA-2033458528-project-member</nova:user>
Aug 14 13:40:46 user nova-compute[73484]:         <nova:project uuid="ff9e3bd3df8a408e96e9054775c3cb83">tempest-ServerActionsTestOtherA-2033458528</nova:project>
Aug 14 13:40:46 user nova-compute[73484]:       </nova:owner>
Aug 14 13:40:46 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:40:46 user nova-compute[73484]:       <nova:ports>
Aug 14 13:40:46 user nova-compute[73484]:         <nova:port uuid="cfbf4211-f3cb-49ad-98dd-68029d497e5f">
Aug 14 13:40:46 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 13:40:46 user nova-compute[73484]:         </nova:port>
Aug 14 13:40:46 user nova-compute[73484]:       </nova:ports>
Aug 14 13:40:46 user nova-compute[73484]:     </nova:instance>
Aug 14 13:40:46 user nova-compute[73484]:   </metadata>
Aug 14 13:40:46 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:40:46 user nova-compute[73484]:     <system>
Aug 14 13:40:46 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:40:46 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:40:46 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:40:46 user nova-compute[73484]:       <entry name="serial">ed239af5-980e-42d3-8ebd-ca100ccb2708</entry>
Aug 14 13:40:46 user nova-compute[73484]:       <entry name="uuid">ed239af5-980e-42d3-8ebd-ca100ccb2708</entry>
Aug 14 13:40:46 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:40:46 user nova-compute[73484]:     </system>
Aug 14 13:40:46 user nova-compute[73484]:   </sysinfo>
Aug 14 13:40:46 user nova-compute[73484]:   <os>
Aug 14 13:40:46 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:40:46 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:40:46 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:40:46 user nova-compute[73484]:   </os>
Aug 14 13:40:46 user nova-compute[73484]:   <features>
Aug 14 13:40:46 user nova-compute[73484]:     <acpi/>
Aug 14 13:40:46 user nova-compute[73484]:     <apic/>
Aug 14 13:40:46 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:40:46 user nova-compute[73484]:   </features>
Aug 14 13:40:46 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:40:46 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:40:46 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:40:46 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:40:46 user nova-compute[73484]:   </clock>
Aug 14 13:40:46 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:40:46 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:40:46 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:40:46 user nova-compute[73484]:   </cpu>
Aug 14 13:40:46 user nova-compute[73484]:   <devices>
Aug 14 13:40:46 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:40:46 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:40:46 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk"/>
Aug 14 13:40:46 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:40:46 user nova-compute[73484]:     </disk>
Aug 14 13:40:46 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:40:46 user nova-compute[73484]:       <mac address="fa:16:3e:c9:13:42"/>
Aug 14 13:40:46 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:40:46 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:40:46 user nova-compute[73484]:       <target dev="tapcfbf4211-f3"/>
Aug 14 13:40:46 user nova-compute[73484]:     </interface>
Aug 14 13:40:46 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:40:46 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/console.log" append="off"/>
Aug 14 13:40:46 user nova-compute[73484]:     </serial>
Aug 14 13:40:46 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:40:46 user nova-compute[73484]:     <video>
Aug 14 13:40:46 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:40:46 user nova-compute[73484]:     </video>
Aug 14 13:40:46 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:40:46 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:40:46 user nova-compute[73484]:     </rng>
Aug 14 13:40:46 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:40:46 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:40:46 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:40:46 user nova-compute[73484]:     </memballoon>
Aug 14 13:40:46 user nova-compute[73484]:   </devices>
Aug 14 13:40:46 user nova-compute[73484]: </domain>
Aug 14 13:40:46 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-808860414',display_name='tempest-tempest.common.compute-instance-808860414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-808860414',id=15,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeXNpb9XHaUrVlh12GX9afYS4uhArSHw3Bmb57wtkUnIoEAuE3Mh/kr8GY8u6/64wrETW58CSBoYMy9LyrbLjI8XQndUnGuUz3mUsWp7LyaF/HaeOtI27YfARpw+mLtGw==',key_name='tempest-keypair-1210865444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff9e3bd3df8a408e96e9054775c3cb83',ramdisk_id='',reservation_id='r-vq274olh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2033458528',owner_user_name='tempest-ServerActionsTestOtherA-2033458528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:40:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b22dfe5647e149a5b3a19d843f0efd66',uuid=ed239af5-980e-42d3-8ebd-ca100ccb2708,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "address": "fa:16:3e:c9:13:42", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbf4211-f3", "ovs_interfaceid": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Converting VIF {"id": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "address": "fa:16:3e:c9:13:42", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbf4211-f3", "ovs_interfaceid": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:13:42,bridge_name='br-int',has_traffic_filtering=True,id=cfbf4211-f3cb-49ad-98dd-68029d497e5f,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbf4211-f3') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG os_vif [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:13:42,bridge_name='br-int',has_traffic_filtering=True,id=cfbf4211-f3cb-49ad-98dd-68029d497e5f,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbf4211-f3') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcfbf4211-f3, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcfbf4211-f3, col_values=(('external_ids', {'iface-id': 'cfbf4211-f3cb-49ad-98dd-68029d497e5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:13:42', 'vm-uuid': 'ed239af5-980e-42d3-8ebd-ca100ccb2708'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:46 user nova-compute[73484]: INFO os_vif [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:13:42,bridge_name='br-int',has_traffic_filtering=True,id=cfbf4211-f3cb-49ad-98dd-68029d497e5f,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbf4211-f3')
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692020431.852237, 7348b004-4d46-4db5-a451-afd3b7476569 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:40:46 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] VM Stopped (Lifecycle Event)
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] No VIF found with MAC fa:16:3e:c9:13:42, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:40:46 user nova-compute[73484]: DEBUG nova.compute.manager [None req-c8e802bd-f63f-4a32-a736-69c352177357 None None] [instance: 7348b004-4d46-4db5-a451-afd3b7476569] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:40:47 user nova-compute[73484]: DEBUG nova.network.neutron [req-8424283d-98ed-4928-9051-2b709c91acc1 req-dea866be-b091-4f4d-ab12-5152ed620399 service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Updated VIF entry in instance network info cache for port cfbf4211-f3cb-49ad-98dd-68029d497e5f. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:40:47 user nova-compute[73484]: DEBUG nova.network.neutron [req-8424283d-98ed-4928-9051-2b709c91acc1 req-dea866be-b091-4f4d-ab12-5152ed620399 service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Updating instance_info_cache with network_info: [{"id": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "address": "fa:16:3e:c9:13:42", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbf4211-f3", "ovs_interfaceid": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:40:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8424283d-98ed-4928-9051-2b709c91acc1 req-dea866be-b091-4f4d-ab12-5152ed620399 service nova] Releasing lock "refresh_cache-ed239af5-980e-42d3-8ebd-ca100ccb2708" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:40:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:48 user nova-compute[73484]: DEBUG nova.compute.manager [req-b89704b0-b554-414a-b115-43e589622776 req-3d591bd1-54f2-40bc-b27e-062115c22ea5 service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Received event network-vif-plugged-cfbf4211-f3cb-49ad-98dd-68029d497e5f {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:40:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b89704b0-b554-414a-b115-43e589622776 req-3d591bd1-54f2-40bc-b27e-062115c22ea5 service nova] Acquiring lock "ed239af5-980e-42d3-8ebd-ca100ccb2708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b89704b0-b554-414a-b115-43e589622776 req-3d591bd1-54f2-40bc-b27e-062115c22ea5 service nova] Lock "ed239af5-980e-42d3-8ebd-ca100ccb2708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b89704b0-b554-414a-b115-43e589622776 req-3d591bd1-54f2-40bc-b27e-062115c22ea5 service nova] Lock "ed239af5-980e-42d3-8ebd-ca100ccb2708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:48 user nova-compute[73484]: DEBUG nova.compute.manager [req-b89704b0-b554-414a-b115-43e589622776 req-3d591bd1-54f2-40bc-b27e-062115c22ea5 service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] No waiting events found dispatching network-vif-plugged-cfbf4211-f3cb-49ad-98dd-68029d497e5f {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:40:48 user nova-compute[73484]: WARNING nova.compute.manager [req-b89704b0-b554-414a-b115-43e589622776 req-3d591bd1-54f2-40bc-b27e-062115c22ea5 service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Received unexpected event network-vif-plugged-cfbf4211-f3cb-49ad-98dd-68029d497e5f for instance with vm_state building and task_state spawning.
Aug 14 13:40:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:50 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020450.4903562, ed239af5-980e-42d3-8ebd-ca100ccb2708 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:40:50 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] VM Resumed (Lifecycle Event)
Aug 14 13:40:50 user nova-compute[73484]: DEBUG nova.compute.manager [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:40:50 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:40:50 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Instance spawned successfully.
Aug 14 13:40:50 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:40:50 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:40:50 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:40:50 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:40:50 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:40:50 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:40:50 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:40:50 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:40:50 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:40:50 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:40:50 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020450.4980478, ed239af5-980e-42d3-8ebd-ca100ccb2708 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:40:50 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] VM Started (Lifecycle Event)
Aug 14 13:40:50 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:40:50 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:40:50 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:40:50 user nova-compute[73484]: INFO nova.compute.manager [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Took 6.37 seconds to spawn the instance on the hypervisor.
Aug 14 13:40:50 user nova-compute[73484]: DEBUG nova.compute.manager [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:40:50 user nova-compute[73484]: DEBUG nova.compute.manager [req-066b50dc-ab19-435f-a1da-a85073148633 req-bc4e3b79-fb4f-430f-bfcf-19f71520cca1 service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Received event network-vif-plugged-cfbf4211-f3cb-49ad-98dd-68029d497e5f {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:40:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-066b50dc-ab19-435f-a1da-a85073148633 req-bc4e3b79-fb4f-430f-bfcf-19f71520cca1 service nova] Acquiring lock "ed239af5-980e-42d3-8ebd-ca100ccb2708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-066b50dc-ab19-435f-a1da-a85073148633 req-bc4e3b79-fb4f-430f-bfcf-19f71520cca1 service nova] Lock "ed239af5-980e-42d3-8ebd-ca100ccb2708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-066b50dc-ab19-435f-a1da-a85073148633 req-bc4e3b79-fb4f-430f-bfcf-19f71520cca1 service nova] Lock "ed239af5-980e-42d3-8ebd-ca100ccb2708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:50 user nova-compute[73484]: DEBUG nova.compute.manager [req-066b50dc-ab19-435f-a1da-a85073148633 req-bc4e3b79-fb4f-430f-bfcf-19f71520cca1 service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] No waiting events found dispatching network-vif-plugged-cfbf4211-f3cb-49ad-98dd-68029d497e5f {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:40:50 user nova-compute[73484]: WARNING nova.compute.manager [req-066b50dc-ab19-435f-a1da-a85073148633 req-bc4e3b79-fb4f-430f-bfcf-19f71520cca1 service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Received unexpected event network-vif-plugged-cfbf4211-f3cb-49ad-98dd-68029d497e5f for instance with vm_state building and task_state spawning.
Aug 14 13:40:50 user nova-compute[73484]: INFO nova.compute.manager [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Took 7.13 seconds to build instance.
Aug 14 13:40:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d24fa599-4a85-4b1c-affd-92d1720dc392 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "ed239af5-980e-42d3-8ebd-ca100ccb2708" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.241s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utMplJdi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:40:51 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:40:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:40:51 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:40:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:40:51 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d26db2-d262-4036-9d9f-4e8f85140197]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:40:51 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6558241c-d67d-4c96-87aa-b4aa0476af49]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d] added
Aug 14 13:40:51 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6536d652-a81d-43a6-b694-f76580e671af]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[70108bb6-485e-442d-935c-d071ad543dc6]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v utMplJdi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v utMplJdi" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[498dbdfe-0514-4ac5-acf7-cbcca5836d35]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'utMplJdi'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f296398f-fe89-4028-bffb-95ecf56016ce]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[38933071-bcb0-4edc-ae13-27e1e97a8649]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:40:51 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:40:51 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:40:51 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:40:51 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[69678ce1-4641-4a21-8a17-3dcb7ef0b8d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d, portal: 172.16.0.220,3260]
Aug 14 13:40:51 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d, portal: 172.16.0.220,3260] successful.
Aug 14 13:40:51 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a51b08-ca12-494b-baed-423fbc5b38a5]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d37e1b-77e2-43b4-8bc2-146819833d49]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:40:51 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:40:51 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:40:51 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:40:51 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:40:51 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:40:51 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15c58cf-2fee-4198-9d54-785e51f36207]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utMplJdi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:40:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:52 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:40:52 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '26165356339386133', 'path': '/dev/sdc'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:40:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165356339386133', 'path': '/dev/sdc'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:40:52 user nova-compute[73484]: DEBUG nova.objects.instance [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lazy-loading 'flavor' on Instance uuid 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:40:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 13:40:52 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:40:52 user nova-compute[73484]:   <source dev="/dev/sdc"/>
Aug 14 13:40:52 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:40:52 user nova-compute[73484]:   <serial>383633e0-0201-479d-8e03-3a15c3341c1d</serial>
Aug 14 13:40:52 user nova-compute[73484]: </disk>
Aug 14 13:40:52 user nova-compute[73484]:  {{(pid=73484) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 13:40:53 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:40:53 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:40:53 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] No VIF found with MAC fa:16:3e:69:2f:ce, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:40:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-34632273-b24b-4a7d-bb40-023260497dc6 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.799s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:53 user nova-compute[73484]: INFO nova.compute.manager [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Rescuing
Aug 14 13:40:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Acquiring lock "refresh_cache-66e161f1-2f3b-4777-9a0d-5f4d62e850d5" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:40:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Acquired lock "refresh_cache-66e161f1-2f3b-4777-9a0d-5f4d62e850d5" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:40:53 user nova-compute[73484]: DEBUG nova.network.neutron [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:40:54 user nova-compute[73484]: DEBUG nova.network.neutron [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Updating instance_info_cache with network_info: [{"id": "290c0b61-ba11-4074-a7f2-cb172a576a19", "address": "fa:16:3e:69:2f:ce", "network": {"id": "2306cc91-8443-4c0e-b5a6-3883766b686a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-577320480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ea5214248845418e322d18d298c449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap290c0b61-ba", "ovs_interfaceid": "290c0b61-ba11-4074-a7f2-cb172a576a19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:40:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Releasing lock "refresh_cache-66e161f1-2f3b-4777-9a0d-5f4d62e850d5" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:40:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:55 user nova-compute[73484]: DEBUG nova.compute.manager [req-6fa5cfb9-68c5-432b-a7c2-a4f1ac086250 req-82cd5c74-1b55-4c8d-a57c-dbfcac7b8ea9 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Received event network-vif-unplugged-290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:40:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6fa5cfb9-68c5-432b-a7c2-a4f1ac086250 req-82cd5c74-1b55-4c8d-a57c-dbfcac7b8ea9 service nova] Acquiring lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6fa5cfb9-68c5-432b-a7c2-a4f1ac086250 req-82cd5c74-1b55-4c8d-a57c-dbfcac7b8ea9 service nova] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6fa5cfb9-68c5-432b-a7c2-a4f1ac086250 req-82cd5c74-1b55-4c8d-a57c-dbfcac7b8ea9 service nova] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:55 user nova-compute[73484]: DEBUG nova.compute.manager [req-6fa5cfb9-68c5-432b-a7c2-a4f1ac086250 req-82cd5c74-1b55-4c8d-a57c-dbfcac7b8ea9 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] No waiting events found dispatching network-vif-unplugged-290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:40:55 user nova-compute[73484]: WARNING nova.compute.manager [req-6fa5cfb9-68c5-432b-a7c2-a4f1ac086250 req-82cd5c74-1b55-4c8d-a57c-dbfcac7b8ea9 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Received unexpected event network-vif-unplugged-290c0b61-ba11-4074-a7f2-cb172a576a19 for instance with vm_state active and task_state rescuing.
Aug 14 13:40:55 user nova-compute[73484]: DEBUG nova.objects.instance [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'flavor' on Instance uuid 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:40:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "refresh_cache-0a3a174b-d870-4164-891e-a2fa8cc8c8b8" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:40:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquired lock "refresh_cache-0a3a174b-d870-4164-891e-a2fa8cc8c8b8" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:40:55 user nova-compute[73484]: DEBUG nova.network.neutron [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:40:55 user nova-compute[73484]: DEBUG nova.objects.instance [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'info_cache' on Instance uuid 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:40:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Acquiring lock "bd43e3a9-0413-4e55-b6a1-7f3f792ba872" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "bd43e3a9-0413-4e55-b6a1-7f3f792ba872" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:55 user nova-compute[73484]: DEBUG nova.compute.manager [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:40:55 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Instance destroyed successfully.
Aug 14 13:40:55 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Attempting a stable device rescue
Aug 14 13:40:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73484) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 13:40:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Instance directory exists: not creating {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 13:40:55 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Creating image(s)
Aug 14 13:40:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Acquiring lock "/opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "/opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "/opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:55 user nova-compute[73484]: DEBUG nova.objects.instance [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lazy-loading 'trusted_certs' on Instance uuid 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:40:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Acquiring lock "80717719fed52231ab60729444f155cf8365e29b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "80717719fed52231ab60729444f155cf8365e29b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:55 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:40:55 user nova-compute[73484]: INFO nova.compute.claims [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Claim successful on node user
Aug 14 13:40:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80717719fed52231ab60729444f155cf8365e29b.part --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80717719fed52231ab60729444f155cf8365e29b.part --force-share --output=json" returned: 0 in 0.211s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:56 user nova-compute[73484]: DEBUG nova.virt.images [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] 453ee9dc-3ae4-4d11-b426-b8e2aa028399 was qcow2, converting to raw {{(pid=73484) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 13:40:56 user nova-compute[73484]: DEBUG nova.privsep.utils [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73484) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 13:40:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/80717719fed52231ab60729444f155cf8365e29b.part /opt/stack/data/nova/instances/_base/80717719fed52231ab60729444f155cf8365e29b.converted {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG nova.compute.manager [req-e373d027-55f0-4088-84b8-c865fa2a055f req-2f5c14a7-821f-4e55-8309-04cd19ef7e95 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Received event network-vif-plugged-290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e373d027-55f0-4088-84b8-c865fa2a055f req-2f5c14a7-821f-4e55-8309-04cd19ef7e95 service nova] Acquiring lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e373d027-55f0-4088-84b8-c865fa2a055f req-2f5c14a7-821f-4e55-8309-04cd19ef7e95 service nova] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e373d027-55f0-4088-84b8-c865fa2a055f req-2f5c14a7-821f-4e55-8309-04cd19ef7e95 service nova] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG nova.compute.manager [req-e373d027-55f0-4088-84b8-c865fa2a055f req-2f5c14a7-821f-4e55-8309-04cd19ef7e95 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] No waiting events found dispatching network-vif-plugged-290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:40:57 user nova-compute[73484]: WARNING nova.compute.manager [req-e373d027-55f0-4088-84b8-c865fa2a055f req-2f5c14a7-821f-4e55-8309-04cd19ef7e95 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Received unexpected event network-vif-plugged-290c0b61-ba11-4074-a7f2-cb172a576a19 for instance with vm_state active and task_state rescuing.
Aug 14 13:40:57 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.666s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG nova.network.neutron [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Updating instance_info_cache with network_info: [{"id": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "address": "fa:16:3e:b8:35:a4", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511cc5ad-6f", "ovs_interfaceid": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG nova.network.neutron [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/80717719fed52231ab60729444f155cf8365e29b.part /opt/stack/data/nova/instances/_base/80717719fed52231ab60729444f155cf8365e29b.converted" returned: 0 in 0.438s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80717719fed52231ab60729444f155cf8365e29b.converted --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Releasing lock "refresh_cache-0a3a174b-d870-4164-891e-a2fa8cc8c8b8" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:40:57 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:40:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:40:57 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Instance destroyed successfully.
Aug 14 13:40:57 user nova-compute[73484]: DEBUG nova.objects.instance [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'resources' on Instance uuid 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:36:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1545874430',display_name='tempest-AttachVolumeTestJSON-server-1545874430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1545874430',id=2,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALz2dA1fCV3zsqvRCM3si65BX/s2RWbHAvxkMavxCm+Cz33FBQTUMagzswhJU7/mAqiPPhCjI04IhkLCYoINFrAPHP37QxwSFtMKgaz77wIK1BXGoScfZ85G5EKo7vD3A==',key_name='tempest-keypair-1440897791',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:37:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3d2114819cda450ca1827ddd5557da23',ramdisk_id='',reservation_id='r-ifpiz561',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-852428779',owner_user_name='tempest-AttachVolumeTestJSON-852428779-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:39:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fac94bacad00447d9743d8a44118ea47',uuid=0a3a174b-d870-4164-891e-a2fa8cc8c8b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "address": "fa:16:3e:b8:35:a4", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511cc5ad-6f", "ovs_interfaceid": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Converting VIF {"id": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "address": "fa:16:3e:b8:35:a4", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511cc5ad-6f", "ovs_interfaceid": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:35:a4,bridge_name='br-int',has_traffic_filtering=True,id=511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a,network=Network(cddd6eb8-767a-42c5-8cca-a1fe1d2eb604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511cc5ad-6f') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG os_vif [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:35:a4,bridge_name='br-int',has_traffic_filtering=True,id=511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a,network=Network(cddd6eb8-767a-42c5-8cca-a1fe1d2eb604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511cc5ad-6f') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap511cc5ad-6f, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG nova.policy [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33fea6b1b7dd4b2297bac12011f57a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7afafc2d4b1fa74902cdf0ce08d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:57 user nova-compute[73484]: INFO os_vif [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:35:a4,bridge_name='br-int',has_traffic_filtering=True,id=511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a,network=Network(cddd6eb8-767a-42c5-8cca-a1fe1d2eb604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511cc5ad-6f')
Aug 14 13:40:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IbnmokSX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:40:57 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:40:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ef0eb1-c7ac-4e65-aec3-028726407f4c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:40:57 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Creating image(s)
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "/opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "/opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da3f381-9284-467c-8c58-8e66f5bcdcc6]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:40:57 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:40:57 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:40:57 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:40:57 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:40:57 user nova-compute[73484]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:40:57 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4585b0430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd'): ({'sdf'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Removing single pathed devices sdf {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80717719fed52231ab60729444f155cf8365e29b.converted --force-share --output=json" returned: 0 in 0.224s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "80717719fed52231ab60729444f155cf8365e29b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.099s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[96399628-5306-4265-8fbc-6584e57f5b7a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Acquiring lock "80717719fed52231ab60729444f155cf8365e29b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "80717719fed52231ab60729444f155cf8365e29b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80717719fed52231ab60729444f155cf8365e29b --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[995018bf-a4f1-41b6-b97f-c3672f87e756]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Flushing IO for device /dev/sdf {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[84555ac9-9141-43fa-a27f-8547c4830240]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f90c268-6bd6-4c55-a66a-e80b37709e14]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] SCSI volumes sdf have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.191s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1889ce8f-a0be-4f93-8817-596c2952f0a8]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80717719fed52231ab60729444f155cf8365e29b --force-share --output=json" returned: 0 in 0.189s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80717719fed52231ab60729444f155cf8365e29b,backing_fmt=raw /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk.rescue {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80717719fed52231ab60729444f155cf8365e29b,backing_fmt=raw /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk.rescue" returned: 0 in 0.056s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "80717719fed52231ab60729444f155cf8365e29b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG nova.objects.instance [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lazy-loading 'migration_context' on Instance uuid 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bfd28d-d1c9-4950-a8cd-8248cd6d1beb]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd, portal: 172.16.0.220,3260]
Aug 14 13:40:57 user nova-compute[73484]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd, portal: 172.16.0.220,3260] successful.
Aug 14 13:40:57 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Start _get_guest_xml network_info=[{"id": "290c0b61-ba11-4074-a7f2-cb172a576a19", "address": "fa:16:3e:69:2f:ce", "network": {"id": "2306cc91-8443-4c0e-b5a6-3883766b686a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-577320480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-577320480-network", "vif_mac": "fa:16:3e:69:2f:ce"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ea5214248845418e322d18d298c449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap290c0b61-ba", "ovs_interfaceid": "290c0b61-ba11-4074-a7f2-cb172a576a19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '453ee9dc-3ae4-4d11-b426-b8e2aa028399', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6abde082-4520-42f8-833a-6b4ae9cf4a65', 'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utMplJdi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '66e161f1-2f3b-4777-9a0d-5f4d62e850d5', 'attached_at': '', 'detached_at': '', 'volume_id': '383633e0-0201-479d-8e03-3a15c3341c1d', 'serial': '383633e0-0201-479d-8e03-3a15c3341c1d'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG nova.objects.instance [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lazy-loading 'resources' on Instance uuid 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[86abd82a-28c8-47e5-a73c-2a3a76de4441]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] <== disconnect_volume: return (411ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG nova.objects.instance [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lazy-loading 'numa_topology' on Instance uuid 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Start _get_guest_xml network_info=[{"id": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "address": "fa:16:3e:b8:35:a4", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511cc5ad-6f", "ovs_interfaceid": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '62e66b9b-68ea-4feb-a29f-c4404ccff1c6', 'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IbnmokSX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '0a3a174b-d870-4164-891e-a2fa8cc8c8b8', 'attached_at': '', 'detached_at': '', 'volume_id': 'a9a47272-145b-4612-b657-2ff1d153dcbd', 'serial': 'a9a47272-145b-4612-b657-2ff1d153dcbd'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG nova.objects.instance [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'numa_topology' on Instance uuid 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.184s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:58 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:40:58 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk 1073741824" returned: 0 in 0.062s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:40:58 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:40:58 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.objects.instance [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lazy-loading 'vcpu_model' on Instance uuid 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.objects.instance [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utMplJdi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:40:58 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:40:58 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:40:58 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IbnmokSX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:40:58 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[933a9ded-87d2-41e0-9181-79ac074190f5]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = utMplJdi\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 14 13:40:58 user nova-compute[73484]: node.name = iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d
Aug 14 13:40:58 user nova-compute[73484]: node.tpgt = -1
Aug 14 13:40:58 user nova-compute[73484]: node.startup = automatic
Aug 14 13:40:58 user nova-compute[73484]: node.leading_login = No
Aug 14 13:40:58 user nova-compute[73484]: iface.iscsi_ifacename = default
Aug 14 13:40:58 user nova-compute[73484]: iface.net_ifacename = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.ipaddress = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.prefix_len = 0
Aug 14 13:40:58 user nova-compute[73484]: iface.hwaddress = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.transport_name = tcp
Aug 14 13:40:58 user nova-compute[73484]: iface.initiatorname = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.state = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.vlan_id = 0
Aug 14 13:40:58 user nova-compute[73484]: iface.vlan_priority = 0
Aug 14 13:40:58 user nova-compute[73484]: iface.vlan_state = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.iface_num = 0
Aug 14 13:40:58 user nova-compute[73484]: iface.mtu = 0
Aug 14 13:40:58 user nova-compute[73484]: iface.port = 0
Aug 14 13:40:58 user nova-compute[73484]: iface.bootproto = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.subnet_mask = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.gateway = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.dhcp_alt_client_id_state = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.dhcp_alt_client_id = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.dhcp_dns = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.dhcp_learn_iqn = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.dhcp_req_vendor_id_state = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.dhcp_vendor_id_state = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.dhcp_vendor_id = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.dhcp_slp_da = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.fragmentation = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.gratuitous_arp = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.incoming_forwarding = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.tos_state = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.tos = 0
Aug 14 13:40:58 user nova-compute[73484]: iface.ttl = 0
Aug 14 13:40:58 user nova-compute[73484]: iface.delayed_ack = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.tcp_nagle = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.tcp_wsf_state = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.tcp_wsf = 0
Aug 14 13:40:58 user nova-compute[73484]: iface.tcp_timer_scale = 0
Aug 14 13:40:58 user nova-compute[73484]: iface.tcp_timestamp = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.redirect = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.def_task_mgmt_timeout = 0
Aug 14 13:40:58 user nova-compute[73484]: iface.header_digest = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.data_digest = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.immediate_data = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.initial_r2t = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.data_seq_inorder = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.data_pdu_inorder = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.erl = 0
Aug 14 13:40:58 user nova-compute[73484]: iface.max_receive_data_len = 0
Aug 14 13:40:58 user nova-compute[73484]: iface.first_burst_len = 0
Aug 14 13:40:58 user nova-compute[73484]: iface.max_outstanding_r2t = 0
Aug 14 13:40:58 user nova-compute[73484]: iface.max_burst_len = 0
Aug 14 13:40:58 user nova-compute[73484]: iface.chap_auth = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.bidi_chap = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.strict_login_compliance = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.discovery_auth = <empty>
Aug 14 13:40:58 user nova-compute[73484]: iface.discovery_logout = <empty>
Aug 14 13:40:58 user nova-compute[73484]: node.discovery_address = <empty>
Aug 14 13:40:58 user nova-compute[73484]: node.discovery_port = 0
Aug 14 13:40:58 user nova-compute[73484]: node.discovery_type = static
Aug 14 13:40:58 user nova-compute[73484]: node.session.initial_cmdsn = 0
Aug 14 13:40:58 user nova-compute[73484]: node.session.initial_login_retry_max = 8
Aug 14 13:40:58 user nova-compute[73484]: node.session.xmit_thread_priority = -20
Aug 14 13:40:58 user nova-compute[73484]: node.session.cmds_max = 128
Aug 14 13:40:58 user nova-compute[73484]: node.session.queue_depth = 32
Aug 14 13:40:58 user nova-compute[73484]: node.session.nr_sessions = 1
Aug 14 13:40:58 user nova-compute[73484]: node.session.auth.authmethod = CHAP
Aug 14 13:40:58 user nova-compute[73484]: node.session.auth.username = utMplJdi
Aug 14 13:40:58 user nova-compute[73484]: node.session.auth.password = ***
Aug 14 13:40:58 user nova-compute[73484]: node.session.auth.username_in = <empty>
Aug 14 13:40:58 user nova-compute[73484]: node.session.auth.password_in = <empty>
Aug 14 13:40:58 user nova-compute[73484]: node.session.auth.chap_algs = MD5
Aug 14 13:40:58 user nova-compute[73484]: node.session.timeo.replacement_timeout = 120
Aug 14 13:40:58 user nova-compute[73484]: node.session.err_timeo.abort_timeout = 15
Aug 14 13:40:58 user nova-compute[73484]: node.session.err_timeo.lu_reset_timeout = 30
Aug 14 13:40:58 user nova-compute[73484]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 14 13:40:58 user nova-compute[73484]: node.session.err_timeo.host_reset_timeout = 60
Aug 14 13:40:58 user nova-compute[73484]: node.session.iscsi.FastAbort = Yes
Aug 14 13:40:58 user nova-compute[73484]: node.session.iscsi.InitialR2T = No
Aug 14 13:40:58 user nova-compute[73484]: node.session.iscsi.ImmediateData = Yes
Aug 14 13:40:58 user nova-compute[73484]: node.session.iscsi.FirstBurstLength = 262144
Aug 14 13:40:58 user nova-compute[73484]: node.session.iscsi.MaxBurstLength = 16776192
Aug 14 13:40:58 user nova-compute[73484]: node.session.iscsi.DefaultTime2Retain = 0
Aug 14 13:40:58 user nova-compute[73484]: node.session.iscsi.DefaultTime2Wait = 2
Aug 14 13:40:58 user nova-compute[73484]: node.session.iscsi.MaxConnections = 1
Aug 14 13:40:58 user nova-compute[73484]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 14 13:40:58 user nova-compute[73484]: node.session.iscsi.ERL = 0
Aug 14 13:40:58 user nova-compute[73484]: node.session.scan = manual
Aug 14 13:40:58 user nova-compute[73484]: node.session.reopen_max = 0
Aug 14 13:40:58 user nova-compute[73484]: node.conn[0].address = 172.16.0.220
Aug 14 13:40:58 user nova-compute[73484]: node.conn[0].port = 3260
Aug 14 13:40:58 user nova-compute[73484]: node.conn[0].startup = manual
Aug 14 13:40:58 user nova-compute[73484]: node.conn[0].tcp.window_size = 524288
Aug 14 13:40:58 user nova-compute[73484]: node.conn[0].tcp.type_of_service = 0
Aug 14 13:40:58 user nova-compute[73484]: node.conn[0].timeo.logout_timeout = 15
Aug 14 13:40:58 user nova-compute[73484]: node.conn[0].timeo.login_timeout = 15
Aug 14 13:40:58 user nova-compute[73484]: node.conn[0].timeo.auth_timeout = 45
Aug 14 13:40:58 user nova-compute[73484]: node.conn[0].timeo.noop_out_interval = 5
Aug 14 13:40:58 user nova-compute[73484]: node.conn[0].timeo.noop_out_timeout = 5
Aug 14 13:40:58 user nova-compute[73484]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 14 13:40:58 user nova-compute[73484]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 14 13:40:58 user nova-compute[73484]: node.conn[0].iscsi.HeaderDigest = None
Aug 14 13:40:58 user nova-compute[73484]: node.conn[0].iscsi.DataDigest = None
Aug 14 13:40:58 user nova-compute[73484]: node.conn[0].iscsi.IFMarker = No
Aug 14 13:40:58 user nova-compute[73484]: node.conn[0].iscsi.OFMarker = No
Aug 14 13:40:58 user nova-compute[73484]: # END RECORD
Aug 14 13:40:58 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.175s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.network.neutron [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Successfully created port: 0a161ec7-dffc-474f-b741-381bf53615d4 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[224383fc-e8d9-445f-b6ed-e1e092c4eb74]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9d5b91-1d2b-4bb7-a97e-feb1fff98048]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v utMplJdi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v utMplJdi" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a81dee-211f-4430-b01c-2d6256c74cce]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'utMplJdi'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a537ab-945b-457f-b0d4-2f3b328f9b26]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8a2341-cc2a-494f-b2fc-61090e85e4e3]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:40:58 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:40:58 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:40:58 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:40:58 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] HCTL ('34', '0', '0', 0) found on session 18 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f595e53-dac2-4240-a4d3-80c0a5d8e3f9]: (4, ('0 0 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Searching for a device in session 18 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utMplJdi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.362s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] <== connect_volume: return (365ms) {'type': 'block', 'scsi_wwn': '26165356339386133', 'path': '/dev/sdc'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165356339386133', 'path': '/dev/sdc'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json" returned: 0 in 0.325s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.332s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:40:58 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:40:58 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Cannot resize image /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.objects.instance [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lazy-loading 'migration_context' on Instance uuid bd43e3a9-0413-4e55-b6a1-7f3f792ba872 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Ensure instance console log exists: /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03fc79e-119c-4e6f-8599-703ba698501b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:40:58 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:36:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1545246932',display_name='tempest-ServerStableDeviceRescueTest-server-1545246932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1545246932',id=4,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNnPFytjTYkiccqtCpAzJGkmVj4GkS19LS49sca5TI0sqXkCY1rk1X/hROtXBUUkImQA/+wT95tfW91orX+01oToWNzGrpj6pbVY4SfyVkrwI//uxjHErhihJanzPyxbg==',key_name='tempest-keypair-183088637',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:37:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1ea5214248845418e322d18d298c449',ramdisk_id='',reservation_id='r-x171fkwc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-779507232',owner_user_name='tempest-ServerStableDeviceRescueTest-779507232-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:38:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c0b51afa7a147ce9a3047642651c6bb',uuid=66e161f1-2f3b-4777-9a0d-5f4d62e850d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "290c0b61-ba11-4074-a7f2-cb172a576a19", "address": "fa:16:3e:69:2f:ce", "network": {"id": "2306cc91-8443-4c0e-b5a6-3883766b686a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-577320480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-577320480-network", "vif_mac": "fa:16:3e:69:2f:ce"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ea5214248845418e322d18d298c449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap290c0b61-ba", "ovs_interfaceid": "290c0b61-ba11-4074-a7f2-cb172a576a19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Converting VIF {"id": "290c0b61-ba11-4074-a7f2-cb172a576a19", "address": "fa:16:3e:69:2f:ce", "network": {"id": "2306cc91-8443-4c0e-b5a6-3883766b686a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-577320480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-577320480-network", "vif_mac": "fa:16:3e:69:2f:ce"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ea5214248845418e322d18d298c449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap290c0b61-ba", "ovs_interfaceid": "290c0b61-ba11-4074-a7f2-cb172a576a19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:2f:ce,bridge_name='br-int',has_traffic_filtering=True,id=290c0b61-ba11-4074-a7f2-cb172a576a19,network=Network(2306cc91-8443-4c0e-b5a6-3883766b686a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap290c0b61-ba') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.objects.instance [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lazy-loading 'pci_devices' on Instance uuid 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3591ec7a-3b01-4338-9e45-84da7f5493e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd] added
Aug 14 13:40:58 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:40:58 user nova-compute[73484]:   <uuid>66e161f1-2f3b-4777-9a0d-5f4d62e850d5</uuid>
Aug 14 13:40:58 user nova-compute[73484]:   <name>instance-00000004</name>
Aug 14 13:40:58 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:40:58 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:40:58 user nova-compute[73484]:   <metadata>
Aug 14 13:40:58 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:40:58 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:40:58 user nova-compute[73484]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1545246932</nova:name>
Aug 14 13:40:58 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:40:58</nova:creationTime>
Aug 14 13:40:58 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:40:58 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:40:58 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:40:58 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:40:58 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:40:58 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:40:58 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:40:58 user nova-compute[73484]:       <nova:owner>
Aug 14 13:40:58 user nova-compute[73484]:         <nova:user uuid="3c0b51afa7a147ce9a3047642651c6bb">tempest-ServerStableDeviceRescueTest-779507232-project-member</nova:user>
Aug 14 13:40:58 user nova-compute[73484]:         <nova:project uuid="f1ea5214248845418e322d18d298c449">tempest-ServerStableDeviceRescueTest-779507232</nova:project>
Aug 14 13:40:58 user nova-compute[73484]:       </nova:owner>
Aug 14 13:40:58 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:40:58 user nova-compute[73484]:       <nova:ports>
Aug 14 13:40:58 user nova-compute[73484]:         <nova:port uuid="290c0b61-ba11-4074-a7f2-cb172a576a19">
Aug 14 13:40:58 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 13:40:58 user nova-compute[73484]:         </nova:port>
Aug 14 13:40:58 user nova-compute[73484]:       </nova:ports>
Aug 14 13:40:58 user nova-compute[73484]:     </nova:instance>
Aug 14 13:40:58 user nova-compute[73484]:   </metadata>
Aug 14 13:40:58 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:40:58 user nova-compute[73484]:     <system>
Aug 14 13:40:58 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:40:58 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:40:58 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:40:58 user nova-compute[73484]:       <entry name="serial">66e161f1-2f3b-4777-9a0d-5f4d62e850d5</entry>
Aug 14 13:40:58 user nova-compute[73484]:       <entry name="uuid">66e161f1-2f3b-4777-9a0d-5f4d62e850d5</entry>
Aug 14 13:40:58 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:40:58 user nova-compute[73484]:     </system>
Aug 14 13:40:58 user nova-compute[73484]:   </sysinfo>
Aug 14 13:40:58 user nova-compute[73484]:   <os>
Aug 14 13:40:58 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:40:58 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:40:58 user nova-compute[73484]:   </os>
Aug 14 13:40:58 user nova-compute[73484]:   <features>
Aug 14 13:40:58 user nova-compute[73484]:     <acpi/>
Aug 14 13:40:58 user nova-compute[73484]:     <apic/>
Aug 14 13:40:58 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:40:58 user nova-compute[73484]:   </features>
Aug 14 13:40:58 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:40:58 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:40:58 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:40:58 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:40:58 user nova-compute[73484]:   </clock>
Aug 14 13:40:58 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:40:58 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:40:58 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:40:58 user nova-compute[73484]:   </cpu>
Aug 14 13:40:58 user nova-compute[73484]:   <devices>
Aug 14 13:40:58 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:40:58 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:40:58 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk"/>
Aug 14 13:40:58 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:40:58 user nova-compute[73484]:     </disk>
Aug 14 13:40:58 user nova-compute[73484]:     <disk type="block" device="disk">
Aug 14 13:40:58 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:40:58 user nova-compute[73484]:       <source dev="/dev/sdc"/>
Aug 14 13:40:58 user nova-compute[73484]:       <target dev="vdb" bus="virtio"/>
Aug 14 13:40:58 user nova-compute[73484]:       <serial>383633e0-0201-479d-8e03-3a15c3341c1d</serial>
Aug 14 13:40:58 user nova-compute[73484]:     </disk>
Aug 14 13:40:58 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:40:58 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:40:58 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk.rescue"/>
Aug 14 13:40:58 user nova-compute[73484]:       <target dev="vdc" bus="virtio"/>
Aug 14 13:40:58 user nova-compute[73484]:       <boot order="1"/>
Aug 14 13:40:58 user nova-compute[73484]:     </disk>
Aug 14 13:40:58 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:40:58 user nova-compute[73484]:       <mac address="fa:16:3e:69:2f:ce"/>
Aug 14 13:40:58 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:40:58 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:40:58 user nova-compute[73484]:       <target dev="tap290c0b61-ba"/>
Aug 14 13:40:58 user nova-compute[73484]:     </interface>
Aug 14 13:40:58 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:40:58 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/console.log" append="off"/>
Aug 14 13:40:58 user nova-compute[73484]:     </serial>
Aug 14 13:40:58 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:40:58 user nova-compute[73484]:     <video>
Aug 14 13:40:58 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:40:58 user nova-compute[73484]:     </video>
Aug 14 13:40:58 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:40:58 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:40:58 user nova-compute[73484]:     </rng>
Aug 14 13:40:58 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:40:58 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:40:58 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:40:58 user nova-compute[73484]:     </memballoon>
Aug 14 13:40:58 user nova-compute[73484]:   </devices>
Aug 14 13:40:58 user nova-compute[73484]: </domain>
Aug 14 13:40:58 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:40:58 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Instance destroyed successfully.
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2a4957-3853-41fa-aeb2-f7a7df900e87]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b9b0a8-873b-452c-aadb-9ed63b7f9d53]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IbnmokSX {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IbnmokSX" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5da517b-c31c-405b-bf2d-a76206a139f4]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IbnmokSX'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] No VIF found with MAC fa:16:3e:69:2f:ce, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[456bfae9-8742-4743-9e96-c2cc1089cac1]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1f8692-9f19-4367-b294-4b1d348b7713]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:40:58 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:40:58 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:40:58 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:40:58 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ec7b95-3fb7-4807-ad17-e6567c374f22]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd, portal: 172.16.0.220,3260]
Aug 14 13:40:58 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd, portal: 172.16.0.220,3260] successful.
Aug 14 13:40:58 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cfe2a3-4780-4007-9a40-3f70fb56d25c]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8773bcf4-3f43-44f8-abd8-af46405b8322]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:40:58 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:40:58 user nova-compute[73484]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:40:58 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:40:58 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:40:58 user nova-compute[73484]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:40:58 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cccb7fd-1405-4e2f-9007-af4476872aea]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:40:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IbnmokSX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.network.neutron [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Successfully updated port: 0a161ec7-dffc-474f-b741-381bf53615d4 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Acquiring lock "refresh_cache-bd43e3a9-0413-4e55-b6a1-7f3f792ba872" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Acquired lock "refresh_cache-bd43e3a9-0413-4e55-b6a1-7f3f792ba872" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.network.neutron [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.compute.manager [req-90939e4d-e549-4316-aeb1-c58a20703188 req-1f69c83e-3a78-4eb4-8c3f-a52fead6a8e1 service nova] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Received event network-changed-0a161ec7-dffc-474f-b741-381bf53615d4 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.compute.manager [req-90939e4d-e549-4316-aeb1-c58a20703188 req-1f69c83e-3a78-4eb4-8c3f-a52fead6a8e1 service nova] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Refreshing instance network info cache due to event network-changed-0a161ec7-dffc-474f-b741-381bf53615d4. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-90939e4d-e549-4316-aeb1-c58a20703188 req-1f69c83e-3a78-4eb4-8c3f-a52fead6a8e1 service nova] Acquiring lock "refresh_cache-bd43e3a9-0413-4e55-b6a1-7f3f792ba872" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.network.neutron [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.network.neutron [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Updating instance_info_cache with network_info: [{"id": "0a161ec7-dffc-474f-b741-381bf53615d4", "address": "fa:16:3e:bf:29:a7", "network": {"id": "893008ed-2c71-42ba-bf31-28baba1b8c2c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1936284602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ff7afafc2d4b1fa74902cdf0ce08d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a161ec7-df", "ovs_interfaceid": "0a161ec7-dffc-474f-b741-381bf53615d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Releasing lock "refresh_cache-bd43e3a9-0413-4e55-b6a1-7f3f792ba872" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.compute.manager [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Instance network_info: |[{"id": "0a161ec7-dffc-474f-b741-381bf53615d4", "address": "fa:16:3e:bf:29:a7", "network": {"id": "893008ed-2c71-42ba-bf31-28baba1b8c2c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1936284602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ff7afafc2d4b1fa74902cdf0ce08d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a161ec7-df", "ovs_interfaceid": "0a161ec7-dffc-474f-b741-381bf53615d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-90939e4d-e549-4316-aeb1-c58a20703188 req-1f69c83e-3a78-4eb4-8c3f-a52fead6a8e1 service nova] Acquired lock "refresh_cache-bd43e3a9-0413-4e55-b6a1-7f3f792ba872" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.network.neutron [req-90939e4d-e549-4316-aeb1-c58a20703188 req-1f69c83e-3a78-4eb4-8c3f-a52fead6a8e1 service nova] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Refreshing network info cache for port 0a161ec7-dffc-474f-b741-381bf53615d4 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Start _get_guest_xml network_info=[{"id": "0a161ec7-dffc-474f-b741-381bf53615d4", "address": "fa:16:3e:bf:29:a7", "network": {"id": "893008ed-2c71-42ba-bf31-28baba1b8c2c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1936284602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ff7afafc2d4b1fa74902cdf0ce08d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a161ec7-df", "ovs_interfaceid": "0a161ec7-dffc-474f-b741-381bf53615d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:40:59 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:40:59 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:40:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1494210179',display_name='tempest-ServersNegativeTestJSON-server-1494210179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1494210179',id=16,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76ff7afafc2d4b1fa74902cdf0ce08d6',ramdisk_id='',reservation_id='r-uq87c6tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-287955364',owner_user_name='tempest-ServersNegativeTestJSON-287955364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:40:58Z,user_data=None,user_id='33fea6b1b7dd4b2297bac12011f57a17',uuid=bd43e3a9-0413-4e55-b6a1-7f3f792ba872,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a161ec7-dffc-474f-b741-381bf53615d4", "address": "fa:16:3e:bf:29:a7", "network": {"id": "893008ed-2c71-42ba-bf31-28baba1b8c2c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1936284602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ff7afafc2d4b1fa74902cdf0ce08d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a161ec7-df", "ovs_interfaceid": "0a161ec7-dffc-474f-b741-381bf53615d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Converting VIF {"id": "0a161ec7-dffc-474f-b741-381bf53615d4", "address": "fa:16:3e:bf:29:a7", "network": {"id": "893008ed-2c71-42ba-bf31-28baba1b8c2c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1936284602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ff7afafc2d4b1fa74902cdf0ce08d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a161ec7-df", "ovs_interfaceid": "0a161ec7-dffc-474f-b741-381bf53615d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:29:a7,bridge_name='br-int',has_traffic_filtering=True,id=0a161ec7-dffc-474f-b741-381bf53615d4,network=Network(893008ed-2c71-42ba-bf31-28baba1b8c2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a161ec7-df') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.objects.instance [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lazy-loading 'pci_devices' on Instance uuid bd43e3a9-0413-4e55-b6a1-7f3f792ba872 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:40:59 user nova-compute[73484]:   <uuid>bd43e3a9-0413-4e55-b6a1-7f3f792ba872</uuid>
Aug 14 13:40:59 user nova-compute[73484]:   <name>instance-00000010</name>
Aug 14 13:40:59 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:40:59 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:40:59 user nova-compute[73484]:   <metadata>
Aug 14 13:40:59 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:40:59 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:40:59 user nova-compute[73484]:       <nova:name>tempest-ServersNegativeTestJSON-server-1494210179</nova:name>
Aug 14 13:40:59 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:40:59</nova:creationTime>
Aug 14 13:40:59 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:40:59 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:40:59 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:40:59 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:40:59 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:40:59 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:40:59 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:40:59 user nova-compute[73484]:       <nova:owner>
Aug 14 13:40:59 user nova-compute[73484]:         <nova:user uuid="33fea6b1b7dd4b2297bac12011f57a17">tempest-ServersNegativeTestJSON-287955364-project-member</nova:user>
Aug 14 13:40:59 user nova-compute[73484]:         <nova:project uuid="76ff7afafc2d4b1fa74902cdf0ce08d6">tempest-ServersNegativeTestJSON-287955364</nova:project>
Aug 14 13:40:59 user nova-compute[73484]:       </nova:owner>
Aug 14 13:40:59 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:40:59 user nova-compute[73484]:       <nova:ports>
Aug 14 13:40:59 user nova-compute[73484]:         <nova:port uuid="0a161ec7-dffc-474f-b741-381bf53615d4">
Aug 14 13:40:59 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 13:40:59 user nova-compute[73484]:         </nova:port>
Aug 14 13:40:59 user nova-compute[73484]:       </nova:ports>
Aug 14 13:40:59 user nova-compute[73484]:     </nova:instance>
Aug 14 13:40:59 user nova-compute[73484]:   </metadata>
Aug 14 13:40:59 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:40:59 user nova-compute[73484]:     <system>
Aug 14 13:40:59 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:40:59 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:40:59 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:40:59 user nova-compute[73484]:       <entry name="serial">bd43e3a9-0413-4e55-b6a1-7f3f792ba872</entry>
Aug 14 13:40:59 user nova-compute[73484]:       <entry name="uuid">bd43e3a9-0413-4e55-b6a1-7f3f792ba872</entry>
Aug 14 13:40:59 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:40:59 user nova-compute[73484]:     </system>
Aug 14 13:40:59 user nova-compute[73484]:   </sysinfo>
Aug 14 13:40:59 user nova-compute[73484]:   <os>
Aug 14 13:40:59 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:40:59 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:40:59 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:40:59 user nova-compute[73484]:   </os>
Aug 14 13:40:59 user nova-compute[73484]:   <features>
Aug 14 13:40:59 user nova-compute[73484]:     <acpi/>
Aug 14 13:40:59 user nova-compute[73484]:     <apic/>
Aug 14 13:40:59 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:40:59 user nova-compute[73484]:   </features>
Aug 14 13:40:59 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:40:59 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:40:59 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:40:59 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:40:59 user nova-compute[73484]:   </clock>
Aug 14 13:40:59 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:40:59 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:40:59 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:40:59 user nova-compute[73484]:   </cpu>
Aug 14 13:40:59 user nova-compute[73484]:   <devices>
Aug 14 13:40:59 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:40:59 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:40:59 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk"/>
Aug 14 13:40:59 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:40:59 user nova-compute[73484]:     </disk>
Aug 14 13:40:59 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:40:59 user nova-compute[73484]:       <mac address="fa:16:3e:bf:29:a7"/>
Aug 14 13:40:59 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:40:59 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:40:59 user nova-compute[73484]:       <target dev="tap0a161ec7-df"/>
Aug 14 13:40:59 user nova-compute[73484]:     </interface>
Aug 14 13:40:59 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:40:59 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/console.log" append="off"/>
Aug 14 13:40:59 user nova-compute[73484]:     </serial>
Aug 14 13:40:59 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:40:59 user nova-compute[73484]:     <video>
Aug 14 13:40:59 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:40:59 user nova-compute[73484]:     </video>
Aug 14 13:40:59 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:40:59 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:40:59 user nova-compute[73484]:     </rng>
Aug 14 13:40:59 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:40:59 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:40:59 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:40:59 user nova-compute[73484]:     </memballoon>
Aug 14 13:40:59 user nova-compute[73484]:   </devices>
Aug 14 13:40:59 user nova-compute[73484]: </domain>
Aug 14 13:40:59 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:40:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1494210179',display_name='tempest-ServersNegativeTestJSON-server-1494210179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1494210179',id=16,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76ff7afafc2d4b1fa74902cdf0ce08d6',ramdisk_id='',reservation_id='r-uq87c6tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-287955364',owner_user_name='tempest-ServersNegativeTestJSON-287955364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:40:58Z,user_data=None,user_id='33fea6b1b7dd4b2297bac12011f57a17',uuid=bd43e3a9-0413-4e55-b6a1-7f3f792ba872,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a161ec7-dffc-474f-b741-381bf53615d4", "address": "fa:16:3e:bf:29:a7", "network": {"id": "893008ed-2c71-42ba-bf31-28baba1b8c2c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1936284602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ff7afafc2d4b1fa74902cdf0ce08d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a161ec7-df", "ovs_interfaceid": "0a161ec7-dffc-474f-b741-381bf53615d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Converting VIF {"id": "0a161ec7-dffc-474f-b741-381bf53615d4", "address": "fa:16:3e:bf:29:a7", "network": {"id": "893008ed-2c71-42ba-bf31-28baba1b8c2c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1936284602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ff7afafc2d4b1fa74902cdf0ce08d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a161ec7-df", "ovs_interfaceid": "0a161ec7-dffc-474f-b741-381bf53615d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:29:a7,bridge_name='br-int',has_traffic_filtering=True,id=0a161ec7-dffc-474f-b741-381bf53615d4,network=Network(893008ed-2c71-42ba-bf31-28baba1b8c2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a161ec7-df') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG os_vif [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:29:a7,bridge_name='br-int',has_traffic_filtering=True,id=0a161ec7-dffc-474f-b741-381bf53615d4,network=Network(893008ed-2c71-42ba-bf31-28baba1b8c2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a161ec7-df') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a161ec7-df, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0a161ec7-df, col_values=(('external_ids', {'iface-id': '0a161ec7-dffc-474f-b741-381bf53615d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:29:a7', 'vm-uuid': 'bd43e3a9-0413-4e55-b6a1-7f3f792ba872'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:40:59 user nova-compute[73484]: INFO os_vif [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:29:a7,bridge_name='br-int',has_traffic_filtering=True,id=0a161ec7-dffc-474f-b741-381bf53615d4,network=Network(893008ed-2c71-42ba-bf31-28baba1b8c2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a161ec7-df')
Aug 14 13:40:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] <== connect_volume: return (1726ms) {'type': 'block', 'scsi_wwn': '23961353662623138', 'path': '/dev/sdd'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961353662623138', 'path': '/dev/sdd'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:40:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] No VIF found with MAC fa:16:3e:bf:29:a7, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:36:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1545874430',display_name='tempest-AttachVolumeTestJSON-server-1545874430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1545874430',id=2,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALz2dA1fCV3zsqvRCM3si65BX/s2RWbHAvxkMavxCm+Cz33FBQTUMagzswhJU7/mAqiPPhCjI04IhkLCYoINFrAPHP37QxwSFtMKgaz77wIK1BXGoScfZ85G5EKo7vD3A==',key_name='tempest-keypair-1440897791',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:37:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3d2114819cda450ca1827ddd5557da23',ramdisk_id='',reservation_id='r-ifpiz561',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-852428779',owner_user_name='tempest-AttachVolumeTestJSON-852428779-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:39:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fac94bacad00447d9743d8a44118ea47',uuid=0a3a174b-d870-4164-891e-a2fa8cc8c8b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "address": "fa:16:3e:b8:35:a4", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511cc5ad-6f", "ovs_interfaceid": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Converting VIF {"id": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "address": "fa:16:3e:b8:35:a4", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511cc5ad-6f", "ovs_interfaceid": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:35:a4,bridge_name='br-int',has_traffic_filtering=True,id=511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a,network=Network(cddd6eb8-767a-42c5-8cca-a1fe1d2eb604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511cc5ad-6f') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG nova.objects.instance [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:41:00 user nova-compute[73484]:   <uuid>0a3a174b-d870-4164-891e-a2fa8cc8c8b8</uuid>
Aug 14 13:41:00 user nova-compute[73484]:   <name>instance-00000002</name>
Aug 14 13:41:00 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:41:00 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:41:00 user nova-compute[73484]:   <metadata>
Aug 14 13:41:00 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:41:00 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:41:00 user nova-compute[73484]:       <nova:name>tempest-AttachVolumeTestJSON-server-1545874430</nova:name>
Aug 14 13:41:00 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:40:58</nova:creationTime>
Aug 14 13:41:00 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:41:00 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:41:00 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:41:00 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:41:00 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:41:00 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:41:00 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:41:00 user nova-compute[73484]:       <nova:owner>
Aug 14 13:41:00 user nova-compute[73484]:         <nova:user uuid="fac94bacad00447d9743d8a44118ea47">tempest-AttachVolumeTestJSON-852428779-project-member</nova:user>
Aug 14 13:41:00 user nova-compute[73484]:         <nova:project uuid="3d2114819cda450ca1827ddd5557da23">tempest-AttachVolumeTestJSON-852428779</nova:project>
Aug 14 13:41:00 user nova-compute[73484]:       </nova:owner>
Aug 14 13:41:00 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:41:00 user nova-compute[73484]:       <nova:ports>
Aug 14 13:41:00 user nova-compute[73484]:         <nova:port uuid="511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a">
Aug 14 13:41:00 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 13:41:00 user nova-compute[73484]:         </nova:port>
Aug 14 13:41:00 user nova-compute[73484]:       </nova:ports>
Aug 14 13:41:00 user nova-compute[73484]:     </nova:instance>
Aug 14 13:41:00 user nova-compute[73484]:   </metadata>
Aug 14 13:41:00 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:41:00 user nova-compute[73484]:     <system>
Aug 14 13:41:00 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:41:00 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:41:00 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:41:00 user nova-compute[73484]:       <entry name="serial">0a3a174b-d870-4164-891e-a2fa8cc8c8b8</entry>
Aug 14 13:41:00 user nova-compute[73484]:       <entry name="uuid">0a3a174b-d870-4164-891e-a2fa8cc8c8b8</entry>
Aug 14 13:41:00 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:41:00 user nova-compute[73484]:     </system>
Aug 14 13:41:00 user nova-compute[73484]:   </sysinfo>
Aug 14 13:41:00 user nova-compute[73484]:   <os>
Aug 14 13:41:00 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:41:00 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:41:00 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:41:00 user nova-compute[73484]:   </os>
Aug 14 13:41:00 user nova-compute[73484]:   <features>
Aug 14 13:41:00 user nova-compute[73484]:     <acpi/>
Aug 14 13:41:00 user nova-compute[73484]:     <apic/>
Aug 14 13:41:00 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:41:00 user nova-compute[73484]:   </features>
Aug 14 13:41:00 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:41:00 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:41:00 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:41:00 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:41:00 user nova-compute[73484]:   </clock>
Aug 14 13:41:00 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:41:00 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:41:00 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:41:00 user nova-compute[73484]:   </cpu>
Aug 14 13:41:00 user nova-compute[73484]:   <devices>
Aug 14 13:41:00 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:41:00 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:41:00 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk"/>
Aug 14 13:41:00 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:41:00 user nova-compute[73484]:     </disk>
Aug 14 13:41:00 user nova-compute[73484]:     <disk type="block" device="disk">
Aug 14 13:41:00 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:41:00 user nova-compute[73484]:       <source dev="/dev/sdd"/>
Aug 14 13:41:00 user nova-compute[73484]:       <target dev="vdb" bus="virtio"/>
Aug 14 13:41:00 user nova-compute[73484]:       <serial>a9a47272-145b-4612-b657-2ff1d153dcbd</serial>
Aug 14 13:41:00 user nova-compute[73484]:     </disk>
Aug 14 13:41:00 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:41:00 user nova-compute[73484]:       <mac address="fa:16:3e:b8:35:a4"/>
Aug 14 13:41:00 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:41:00 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:41:00 user nova-compute[73484]:       <target dev="tap511cc5ad-6f"/>
Aug 14 13:41:00 user nova-compute[73484]:     </interface>
Aug 14 13:41:00 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:41:00 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/console.log" append="off"/>
Aug 14 13:41:00 user nova-compute[73484]:     </serial>
Aug 14 13:41:00 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:41:00 user nova-compute[73484]:     <video>
Aug 14 13:41:00 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:41:00 user nova-compute[73484]:     </video>
Aug 14 13:41:00 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:41:00 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:41:00 user nova-compute[73484]:     </rng>
Aug 14 13:41:00 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:41:00 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:41:00 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:41:00 user nova-compute[73484]:     </memballoon>
Aug 14 13:41:00 user nova-compute[73484]:   </devices>
Aug 14 13:41:00 user nova-compute[73484]: </domain>
Aug 14 13:41:00 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG nova.objects.instance [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG nova.network.neutron [req-90939e4d-e549-4316-aeb1-c58a20703188 req-1f69c83e-3a78-4eb4-8c3f-a52fead6a8e1 service nova] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Updated VIF entry in instance network info cache for port 0a161ec7-dffc-474f-b741-381bf53615d4. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG nova.network.neutron [req-90939e4d-e549-4316-aeb1-c58a20703188 req-1f69c83e-3a78-4eb4-8c3f-a52fead6a8e1 service nova] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Updating instance_info_cache with network_info: [{"id": "0a161ec7-dffc-474f-b741-381bf53615d4", "address": "fa:16:3e:bf:29:a7", "network": {"id": "893008ed-2c71-42ba-bf31-28baba1b8c2c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1936284602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ff7afafc2d4b1fa74902cdf0ce08d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a161ec7-df", "ovs_interfaceid": "0a161ec7-dffc-474f-b741-381bf53615d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-90939e4d-e549-4316-aeb1-c58a20703188 req-1f69c83e-3a78-4eb4-8c3f-a52fead6a8e1 service nova] Releasing lock "refresh_cache-bd43e3a9-0413-4e55-b6a1-7f3f792ba872" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.192s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Cannot resize image /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG nova.objects.instance [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'migration_context' on Instance uuid 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:36:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1545874430',display_name='tempest-AttachVolumeTestJSON-server-1545874430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1545874430',id=2,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALz2dA1fCV3zsqvRCM3si65BX/s2RWbHAvxkMavxCm+Cz33FBQTUMagzswhJU7/mAqiPPhCjI04IhkLCYoINFrAPHP37QxwSFtMKgaz77wIK1BXGoScfZ85G5EKo7vD3A==',key_name='tempest-keypair-1440897791',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:37:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='3d2114819cda450ca1827ddd5557da23',ramdisk_id='',reservation_id='r-ifpiz561',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-852428779',owner_user_name='tempest-AttachVolumeTestJSON-852428779-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:39:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fac94bacad00447d9743d8a44118ea47',uuid=0a3a174b-d870-4164-891e-a2fa8cc8c8b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "address": "fa:16:3e:b8:35:a4", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511cc5ad-6f", "ovs_interfaceid": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Converting VIF {"id": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "address": "fa:16:3e:b8:35:a4", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511cc5ad-6f", "ovs_interfaceid": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:35:a4,bridge_name='br-int',has_traffic_filtering=True,id=511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a,network=Network(cddd6eb8-767a-42c5-8cca-a1fe1d2eb604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511cc5ad-6f') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG os_vif [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:35:a4,bridge_name='br-int',has_traffic_filtering=True,id=511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a,network=Network(cddd6eb8-767a-42c5-8cca-a1fe1d2eb604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511cc5ad-6f') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap511cc5ad-6f, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap511cc5ad-6f, col_values=(('external_ids', {'iface-id': '511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:35:a4', 'vm-uuid': '0a3a174b-d870-4164-891e-a2fa8cc8c8b8'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:41:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:00 user nova-compute[73484]: INFO os_vif [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:35:a4,bridge_name='br-int',has_traffic_filtering=True,id=511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a,network=Network(cddd6eb8-767a-42c5-8cca-a1fe1d2eb604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511cc5ad-6f')
Aug 14 13:41:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:01 user nova-compute[73484]: DEBUG nova.compute.manager [req-2b086810-2449-490a-b0ea-b4df7a27d323 req-08df8444-bef3-49de-a98c-d811032a2a0c service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Received event network-vif-plugged-290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:41:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2b086810-2449-490a-b0ea-b4df7a27d323 req-08df8444-bef3-49de-a98c-d811032a2a0c service nova] Acquiring lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2b086810-2449-490a-b0ea-b4df7a27d323 req-08df8444-bef3-49de-a98c-d811032a2a0c service nova] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2b086810-2449-490a-b0ea-b4df7a27d323 req-08df8444-bef3-49de-a98c-d811032a2a0c service nova] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:01 user nova-compute[73484]: DEBUG nova.compute.manager [req-2b086810-2449-490a-b0ea-b4df7a27d323 req-08df8444-bef3-49de-a98c-d811032a2a0c service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] No waiting events found dispatching network-vif-plugged-290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:41:01 user nova-compute[73484]: WARNING nova.compute.manager [req-2b086810-2449-490a-b0ea-b4df7a27d323 req-08df8444-bef3-49de-a98c-d811032a2a0c service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Received unexpected event network-vif-plugged-290c0b61-ba11-4074-a7f2-cb172a576a19 for instance with vm_state active and task_state rescuing.
Aug 14 13:41:01 user nova-compute[73484]: DEBUG nova.compute.manager [req-2b086810-2449-490a-b0ea-b4df7a27d323 req-08df8444-bef3-49de-a98c-d811032a2a0c service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Received event network-vif-plugged-290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:41:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2b086810-2449-490a-b0ea-b4df7a27d323 req-08df8444-bef3-49de-a98c-d811032a2a0c service nova] Acquiring lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2b086810-2449-490a-b0ea-b4df7a27d323 req-08df8444-bef3-49de-a98c-d811032a2a0c service nova] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2b086810-2449-490a-b0ea-b4df7a27d323 req-08df8444-bef3-49de-a98c-d811032a2a0c service nova] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:01 user nova-compute[73484]: DEBUG nova.compute.manager [req-2b086810-2449-490a-b0ea-b4df7a27d323 req-08df8444-bef3-49de-a98c-d811032a2a0c service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] No waiting events found dispatching network-vif-plugged-290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:41:01 user nova-compute[73484]: WARNING nova.compute.manager [req-2b086810-2449-490a-b0ea-b4df7a27d323 req-08df8444-bef3-49de-a98c-d811032a2a0c service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Received unexpected event network-vif-plugged-290c0b61-ba11-4074-a7f2-cb172a576a19 for instance with vm_state active and task_state rescuing.
Aug 14 13:41:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-34a2fe7d-c988-4e33-bec6-37c5a40b1a71 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Acquiring lock "7ac05f68-a20f-4a57-b990-ef0799aadc58" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-34a2fe7d-c988-4e33-bec6-37c5a40b1a71 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lock "7ac05f68-a20f-4a57-b990-ef0799aadc58" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-34a2fe7d-c988-4e33-bec6-37c5a40b1a71 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Acquiring lock "7ac05f68-a20f-4a57-b990-ef0799aadc58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-34a2fe7d-c988-4e33-bec6-37c5a40b1a71 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lock "7ac05f68-a20f-4a57-b990-ef0799aadc58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-34a2fe7d-c988-4e33-bec6-37c5a40b1a71 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lock "7ac05f68-a20f-4a57-b990-ef0799aadc58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:02 user nova-compute[73484]: INFO nova.compute.manager [None req-34a2fe7d-c988-4e33-bec6-37c5a40b1a71 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Terminating instance
Aug 14 13:41:02 user nova-compute[73484]: DEBUG nova.compute.manager [None req-34a2fe7d-c988-4e33-bec6-37c5a40b1a71 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:41:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:03 user nova-compute[73484]: DEBUG nova.compute.manager [req-6b3b7502-1363-4f4c-8d39-eeeae8458604 req-68fca59a-e3dc-4ab7-a368-c8205493dc4a service nova] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Received event network-vif-unplugged-81a13981-b50f-4f1b-ac18-d4eea5f141fd {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:41:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6b3b7502-1363-4f4c-8d39-eeeae8458604 req-68fca59a-e3dc-4ab7-a368-c8205493dc4a service nova] Acquiring lock "7ac05f68-a20f-4a57-b990-ef0799aadc58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6b3b7502-1363-4f4c-8d39-eeeae8458604 req-68fca59a-e3dc-4ab7-a368-c8205493dc4a service nova] Lock "7ac05f68-a20f-4a57-b990-ef0799aadc58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6b3b7502-1363-4f4c-8d39-eeeae8458604 req-68fca59a-e3dc-4ab7-a368-c8205493dc4a service nova] Lock "7ac05f68-a20f-4a57-b990-ef0799aadc58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:03 user nova-compute[73484]: DEBUG nova.compute.manager [req-6b3b7502-1363-4f4c-8d39-eeeae8458604 req-68fca59a-e3dc-4ab7-a368-c8205493dc4a service nova] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] No waiting events found dispatching network-vif-unplugged-81a13981-b50f-4f1b-ac18-d4eea5f141fd {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:41:03 user nova-compute[73484]: DEBUG nova.compute.manager [req-6b3b7502-1363-4f4c-8d39-eeeae8458604 req-68fca59a-e3dc-4ab7-a368-c8205493dc4a service nova] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Received event network-vif-unplugged-81a13981-b50f-4f1b-ac18-d4eea5f141fd for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:41:03 user nova-compute[73484]: DEBUG nova.compute.manager [req-6b3b7502-1363-4f4c-8d39-eeeae8458604 req-68fca59a-e3dc-4ab7-a368-c8205493dc4a service nova] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Received event network-vif-plugged-81a13981-b50f-4f1b-ac18-d4eea5f141fd {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:41:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6b3b7502-1363-4f4c-8d39-eeeae8458604 req-68fca59a-e3dc-4ab7-a368-c8205493dc4a service nova] Acquiring lock "7ac05f68-a20f-4a57-b990-ef0799aadc58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6b3b7502-1363-4f4c-8d39-eeeae8458604 req-68fca59a-e3dc-4ab7-a368-c8205493dc4a service nova] Lock "7ac05f68-a20f-4a57-b990-ef0799aadc58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6b3b7502-1363-4f4c-8d39-eeeae8458604 req-68fca59a-e3dc-4ab7-a368-c8205493dc4a service nova] Lock "7ac05f68-a20f-4a57-b990-ef0799aadc58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:03 user nova-compute[73484]: DEBUG nova.compute.manager [req-6b3b7502-1363-4f4c-8d39-eeeae8458604 req-68fca59a-e3dc-4ab7-a368-c8205493dc4a service nova] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] No waiting events found dispatching network-vif-plugged-81a13981-b50f-4f1b-ac18-d4eea5f141fd {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:41:03 user nova-compute[73484]: WARNING nova.compute.manager [req-6b3b7502-1363-4f4c-8d39-eeeae8458604 req-68fca59a-e3dc-4ab7-a368-c8205493dc4a service nova] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Received unexpected event network-vif-plugged-81a13981-b50f-4f1b-ac18-d4eea5f141fd for instance with vm_state active and task_state deleting.
Aug 14 13:41:03 user nova-compute[73484]: DEBUG nova.compute.manager [req-6b3b7502-1363-4f4c-8d39-eeeae8458604 req-68fca59a-e3dc-4ab7-a368-c8205493dc4a service nova] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Received event network-vif-plugged-0a161ec7-dffc-474f-b741-381bf53615d4 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:41:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6b3b7502-1363-4f4c-8d39-eeeae8458604 req-68fca59a-e3dc-4ab7-a368-c8205493dc4a service nova] Acquiring lock "bd43e3a9-0413-4e55-b6a1-7f3f792ba872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6b3b7502-1363-4f4c-8d39-eeeae8458604 req-68fca59a-e3dc-4ab7-a368-c8205493dc4a service nova] Lock "bd43e3a9-0413-4e55-b6a1-7f3f792ba872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6b3b7502-1363-4f4c-8d39-eeeae8458604 req-68fca59a-e3dc-4ab7-a368-c8205493dc4a service nova] Lock "bd43e3a9-0413-4e55-b6a1-7f3f792ba872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:03 user nova-compute[73484]: DEBUG nova.compute.manager [req-6b3b7502-1363-4f4c-8d39-eeeae8458604 req-68fca59a-e3dc-4ab7-a368-c8205493dc4a service nova] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] No waiting events found dispatching network-vif-plugged-0a161ec7-dffc-474f-b741-381bf53615d4 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:41:03 user nova-compute[73484]: WARNING nova.compute.manager [req-6b3b7502-1363-4f4c-8d39-eeeae8458604 req-68fca59a-e3dc-4ab7-a368-c8205493dc4a service nova] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Received unexpected event network-vif-plugged-0a161ec7-dffc-474f-b741-381bf53615d4 for instance with vm_state building and task_state spawning.
Aug 14 13:41:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:04 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Instance destroyed successfully.
Aug 14 13:41:04 user nova-compute[73484]: DEBUG nova.objects.instance [None req-34a2fe7d-c988-4e33-bec6-37c5a40b1a71 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lazy-loading 'resources' on Instance uuid 7ac05f68-a20f-4a57-b990-ef0799aadc58 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:41:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-34a2fe7d-c988-4e33-bec6-37c5a40b1a71 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:37:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-573988650',display_name='tempest-TestVolumeSwap-server-573988650',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-573988650',id=8,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/Kq6cH5c92nxB4XNNjgfHLK8f5wuchIFW4En1j6BpQ5CqeKDSXErpNl/zQ5RkLwZNd8dQqjMvuMgYdM/N5qCqJNAyc232zVGK8QH4yY4NfKPUmhyba+y4ES33I7fw/8A==',key_name='tempest-keypair-1631220374',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:37:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02feed89293147398ae749494502ca78',ramdisk_id='',reservation_id='r-z5g5l0s9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-655788702',owner_user_name='tempest-TestVolumeSwap-655788702-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:37:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c17cf880b304d98bbbf47a495f09562',uuid=7ac05f68-a20f-4a57-b990-ef0799aadc58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81a13981-b50f-4f1b-ac18-d4eea5f141fd", "address": "fa:16:3e:6e:d0:0c", "network": {"id": "27abd91d-84d4-4660-8708-088648dcf2fd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-847318959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02feed89293147398ae749494502ca78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a13981-b5", "ovs_interfaceid": "81a13981-b50f-4f1b-ac18-d4eea5f141fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:41:04 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-34a2fe7d-c988-4e33-bec6-37c5a40b1a71 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Converting VIF {"id": "81a13981-b50f-4f1b-ac18-d4eea5f141fd", "address": "fa:16:3e:6e:d0:0c", "network": {"id": "27abd91d-84d4-4660-8708-088648dcf2fd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-847318959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02feed89293147398ae749494502ca78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a13981-b5", "ovs_interfaceid": "81a13981-b50f-4f1b-ac18-d4eea5f141fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:41:04 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-34a2fe7d-c988-4e33-bec6-37c5a40b1a71 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:d0:0c,bridge_name='br-int',has_traffic_filtering=True,id=81a13981-b50f-4f1b-ac18-d4eea5f141fd,network=Network(27abd91d-84d4-4660-8708-088648dcf2fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a13981-b5') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:41:04 user nova-compute[73484]: DEBUG os_vif [None req-34a2fe7d-c988-4e33-bec6-37c5a40b1a71 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:d0:0c,bridge_name='br-int',has_traffic_filtering=True,id=81a13981-b50f-4f1b-ac18-d4eea5f141fd,network=Network(27abd91d-84d4-4660-8708-088648dcf2fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a13981-b5') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:41:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81a13981-b5, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:41:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:41:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:04 user nova-compute[73484]: INFO os_vif [None req-34a2fe7d-c988-4e33-bec6-37c5a40b1a71 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:d0:0c,bridge_name='br-int',has_traffic_filtering=True,id=81a13981-b50f-4f1b-ac18-d4eea5f141fd,network=Network(27abd91d-84d4-4660-8708-088648dcf2fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a13981-b5')
Aug 14 13:41:04 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-34a2fe7d-c988-4e33-bec6-37c5a40b1a71 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Deleting instance files /opt/stack/data/nova/instances/7ac05f68-a20f-4a57-b990-ef0799aadc58_del
Aug 14 13:41:04 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-34a2fe7d-c988-4e33-bec6-37c5a40b1a71 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Deletion of /opt/stack/data/nova/instances/7ac05f68-a20f-4a57-b990-ef0799aadc58_del complete
Aug 14 13:41:04 user nova-compute[73484]: INFO nova.compute.manager [None req-34a2fe7d-c988-4e33-bec6-37c5a40b1a71 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Took 2.23 seconds to destroy the instance on the hypervisor.
Aug 14 13:41:04 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-34a2fe7d-c988-4e33-bec6-37c5a40b1a71 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:41:04 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:41:04 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:41:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Removed pending event for 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 due to event {{(pid=73484) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 13:41:04 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020464.607457, 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:41:04 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] VM Resumed (Lifecycle Event)
Aug 14 13:41:04 user nova-compute[73484]: DEBUG nova.compute.manager [None req-8083aec0-5147-4e2e-9b93-07a07cbc5fd0 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:41:04 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:41:04 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:41:04 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 13:41:04 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020464.614519, 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:41:04 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] VM Started (Lifecycle Event)
Aug 14 13:41:04 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:41:04 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:41:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:05 user nova-compute[73484]: DEBUG nova.compute.manager [req-bc6908a7-8ea3-4ef9-8d8e-848561af0011 req-ec4a8e5e-e94c-46b5-b22e-2c64168766c6 service nova] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Received event network-vif-plugged-0a161ec7-dffc-474f-b741-381bf53615d4 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:41:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-bc6908a7-8ea3-4ef9-8d8e-848561af0011 req-ec4a8e5e-e94c-46b5-b22e-2c64168766c6 service nova] Acquiring lock "bd43e3a9-0413-4e55-b6a1-7f3f792ba872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-bc6908a7-8ea3-4ef9-8d8e-848561af0011 req-ec4a8e5e-e94c-46b5-b22e-2c64168766c6 service nova] Lock "bd43e3a9-0413-4e55-b6a1-7f3f792ba872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-bc6908a7-8ea3-4ef9-8d8e-848561af0011 req-ec4a8e5e-e94c-46b5-b22e-2c64168766c6 service nova] Lock "bd43e3a9-0413-4e55-b6a1-7f3f792ba872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:05 user nova-compute[73484]: DEBUG nova.compute.manager [req-bc6908a7-8ea3-4ef9-8d8e-848561af0011 req-ec4a8e5e-e94c-46b5-b22e-2c64168766c6 service nova] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] No waiting events found dispatching network-vif-plugged-0a161ec7-dffc-474f-b741-381bf53615d4 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:41:05 user nova-compute[73484]: WARNING nova.compute.manager [req-bc6908a7-8ea3-4ef9-8d8e-848561af0011 req-ec4a8e5e-e94c-46b5-b22e-2c64168766c6 service nova] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Received unexpected event network-vif-plugged-0a161ec7-dffc-474f-b741-381bf53615d4 for instance with vm_state building and task_state spawning.
Aug 14 13:41:05 user nova-compute[73484]: DEBUG nova.compute.manager [req-bc6908a7-8ea3-4ef9-8d8e-848561af0011 req-ec4a8e5e-e94c-46b5-b22e-2c64168766c6 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received event network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:41:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-bc6908a7-8ea3-4ef9-8d8e-848561af0011 req-ec4a8e5e-e94c-46b5-b22e-2c64168766c6 service nova] Acquiring lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-bc6908a7-8ea3-4ef9-8d8e-848561af0011 req-ec4a8e5e-e94c-46b5-b22e-2c64168766c6 service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-bc6908a7-8ea3-4ef9-8d8e-848561af0011 req-ec4a8e5e-e94c-46b5-b22e-2c64168766c6 service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:05 user nova-compute[73484]: DEBUG nova.compute.manager [req-bc6908a7-8ea3-4ef9-8d8e-848561af0011 req-ec4a8e5e-e94c-46b5-b22e-2c64168766c6 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] No waiting events found dispatching network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:41:05 user nova-compute[73484]: WARNING nova.compute.manager [req-bc6908a7-8ea3-4ef9-8d8e-848561af0011 req-ec4a8e5e-e94c-46b5-b22e-2c64168766c6 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received unexpected event network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a for instance with vm_state stopped and task_state powering-on.
Aug 14 13:41:05 user nova-compute[73484]: DEBUG nova.compute.manager [req-bc6908a7-8ea3-4ef9-8d8e-848561af0011 req-ec4a8e5e-e94c-46b5-b22e-2c64168766c6 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received event network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:41:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-bc6908a7-8ea3-4ef9-8d8e-848561af0011 req-ec4a8e5e-e94c-46b5-b22e-2c64168766c6 service nova] Acquiring lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-bc6908a7-8ea3-4ef9-8d8e-848561af0011 req-ec4a8e5e-e94c-46b5-b22e-2c64168766c6 service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-bc6908a7-8ea3-4ef9-8d8e-848561af0011 req-ec4a8e5e-e94c-46b5-b22e-2c64168766c6 service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:05 user nova-compute[73484]: DEBUG nova.compute.manager [req-bc6908a7-8ea3-4ef9-8d8e-848561af0011 req-ec4a8e5e-e94c-46b5-b22e-2c64168766c6 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] No waiting events found dispatching network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:41:05 user nova-compute[73484]: WARNING nova.compute.manager [req-bc6908a7-8ea3-4ef9-8d8e-848561af0011 req-ec4a8e5e-e94c-46b5-b22e-2c64168766c6 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received unexpected event network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a for instance with vm_state stopped and task_state powering-on.
Aug 14 13:41:06 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:41:06 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Took 1.65 seconds to deallocate network for instance.
Aug 14 13:41:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-34a2fe7d-c988-4e33-bec6-37c5a40b1a71 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-34a2fe7d-c988-4e33-bec6-37c5a40b1a71 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:06 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-34a2fe7d-c988-4e33-bec6-37c5a40b1a71 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:41:06 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-34a2fe7d-c988-4e33-bec6-37c5a40b1a71 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:41:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-34a2fe7d-c988-4e33-bec6-37c5a40b1a71 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.439s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:06 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-34a2fe7d-c988-4e33-bec6-37c5a40b1a71 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Deleted allocations for instance 7ac05f68-a20f-4a57-b990-ef0799aadc58
Aug 14 13:41:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-34a2fe7d-c988-4e33-bec6-37c5a40b1a71 tempest-TestVolumeSwap-655788702 tempest-TestVolumeSwap-655788702-project-member] Lock "7ac05f68-a20f-4a57-b990-ef0799aadc58" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.576s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:06 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020466.9743598, bd43e3a9-0413-4e55-b6a1-7f3f792ba872 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:41:06 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] VM Resumed (Lifecycle Event)
Aug 14 13:41:06 user nova-compute[73484]: DEBUG nova.compute.manager [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:41:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:41:06 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Instance spawned successfully.
Aug 14 13:41:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:41:06 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:41:07 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:41:07 user nova-compute[73484]: DEBUG nova.compute.manager [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:41:07 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:41:07 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:41:07 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:41:07 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:41:07 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:41:07 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:41:07 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:41:07 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020466.9821343, bd43e3a9-0413-4e55-b6a1-7f3f792ba872 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:41:07 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] VM Started (Lifecycle Event)
Aug 14 13:41:07 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Instance rebooted successfully.
Aug 14 13:41:07 user nova-compute[73484]: DEBUG nova.compute.manager [None req-cb02a424-32af-4b95-9c5d-d8074b5fb807 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:41:07 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:41:07 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:41:07 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:41:07 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020467.015832, 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:41:07 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] VM Resumed (Lifecycle Event)
Aug 14 13:41:07 user nova-compute[73484]: INFO nova.compute.manager [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Took 9.55 seconds to spawn the instance on the hypervisor.
Aug 14 13:41:07 user nova-compute[73484]: DEBUG nova.compute.manager [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:41:07 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:41:07 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:41:07 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020467.016375, 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:41:07 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] VM Started (Lifecycle Event)
Aug 14 13:41:07 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:41:07 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:41:07 user nova-compute[73484]: INFO nova.compute.manager [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Took 11.67 seconds to build instance.
Aug 14 13:41:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ad0d4686-8ec0-46c5-bc03-f10d818c9b7b tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "bd43e3a9-0413-4e55-b6a1-7f3f792ba872" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.827s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:07 user nova-compute[73484]: DEBUG nova.compute.manager [req-97e084a0-ed2b-4d0e-b2a6-24c2024083ab req-11f4ce2a-0dd9-49f6-ad09-ad4f6718e69d service nova] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Received event network-vif-deleted-81a13981-b50f-4f1b-ac18-d4eea5f141fd {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:41:08 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:19 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692020464.1540303, 7ac05f68-a20f-4a57-b990-ef0799aadc58 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:41:19 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] VM Stopped (Lifecycle Event)
Aug 14 13:41:19 user nova-compute[73484]: DEBUG nova.compute.manager [None req-d150de5d-b9d9-4b76-bea5-e12f861f18a9 None None] [instance: 7ac05f68-a20f-4a57-b990-ef0799aadc58] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:41:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:22 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "8220a084-e402-435a-b6a7-ffd94f91a211" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "8220a084-e402-435a-b6a7-ffd94f91a211" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:31 user nova-compute[73484]: DEBUG nova.compute.manager [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:41:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:32 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:41:32 user nova-compute[73484]: INFO nova.compute.claims [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Claim successful on node user
Aug 14 13:41:32 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:41:32 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:41:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:32 user nova-compute[73484]: DEBUG nova.compute.manager [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:41:32 user nova-compute[73484]: DEBUG nova.compute.manager [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:41:32 user nova-compute[73484]: DEBUG nova.network.neutron [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:41:32 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:41:32 user nova-compute[73484]: DEBUG nova.compute.manager [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:41:32 user nova-compute[73484]: DEBUG nova.compute.manager [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:41:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:41:32 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Creating image(s)
Aug 14 13:41:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "/opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "/opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "/opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:32 user nova-compute[73484]: DEBUG nova.policy [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bda36df8b1f64c7894bfee5da258c1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1ccc7c1aaf497da5f1d325d79e9301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:41:32 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:41:32 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 13:41:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.200s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-b889688d-13dd-4f7b-bfef-26dc5347fd6e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:41:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-b889688d-13dd-4f7b-bfef-26dc5347fd6e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:41:33 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 13:41:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.189s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk 1073741824" returned: 0 in 0.049s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.183s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:33 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:41:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:33 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Cannot resize image /opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:41:33 user nova-compute[73484]: DEBUG nova.objects.instance [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lazy-loading 'migration_context' on Instance uuid 8220a084-e402-435a-b6a7-ffd94f91a211 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:41:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:41:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Ensure instance console log exists: /opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:41:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:35 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Updating instance_info_cache with network_info: [{"id": "cd94675b-f6af-48b1-a32f-0a39549f404d", "address": "fa:16:3e:7d:02:29", "network": {"id": "988c9059-476e-4558-8e68-3cfe68a53a09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1683768593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a95ec66f3424934bdff0335e262cc9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd94675b-f6", "ovs_interfaceid": "cd94675b-f6af-48b1-a32f-0a39549f404d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:41:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-b889688d-13dd-4f7b-bfef-26dc5347fd6e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:41:35 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 13:41:35 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:41:35 user nova-compute[73484]: DEBUG nova.network.neutron [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Successfully created port: 3ef63421-a4aa-4126-b8ee-c141b2ef10cb {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:41:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:35 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:41:35 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:41:35 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 13:41:35 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:41:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:35 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 13:41:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:41:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:41:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:41:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:37 user nova-compute[73484]: INFO nova.compute.manager [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Rescuing
Aug 14 13:41:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "refresh_cache-a9d4ec42-3db9-439b-87a7-02bcaab514a4" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:41:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquired lock "refresh_cache-a9d4ec42-3db9-439b-87a7-02bcaab514a4" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:41:37 user nova-compute[73484]: DEBUG nova.network.neutron [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:41:37 user nova-compute[73484]: DEBUG nova.network.neutron [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Successfully updated port: 3ef63421-a4aa-4126-b8ee-c141b2ef10cb {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:41:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "refresh_cache-8220a084-e402-435a-b6a7-ffd94f91a211" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:41:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquired lock "refresh_cache-8220a084-e402-435a-b6a7-ffd94f91a211" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:41:37 user nova-compute[73484]: DEBUG nova.network.neutron [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:41:37 user nova-compute[73484]: DEBUG nova.compute.manager [req-64c1d84b-7d33-429e-a1b4-4140bb64c93a req-5acba502-b202-471b-b0bb-1f3c9b4daa45 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Received event network-changed-3ef63421-a4aa-4126-b8ee-c141b2ef10cb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:41:37 user nova-compute[73484]: DEBUG nova.compute.manager [req-64c1d84b-7d33-429e-a1b4-4140bb64c93a req-5acba502-b202-471b-b0bb-1f3c9b4daa45 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Refreshing instance network info cache due to event network-changed-3ef63421-a4aa-4126-b8ee-c141b2ef10cb. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:41:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-64c1d84b-7d33-429e-a1b4-4140bb64c93a req-5acba502-b202-471b-b0bb-1f3c9b4daa45 service nova] Acquiring lock "refresh_cache-8220a084-e402-435a-b6a7-ffd94f91a211" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:41:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:37 user nova-compute[73484]: DEBUG nova.network.neutron [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG nova.network.neutron [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Updating instance_info_cache with network_info: [{"id": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "address": "fa:16:3e:ca:70:43", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef63421-a4", "ovs_interfaceid": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Releasing lock "refresh_cache-8220a084-e402-435a-b6a7-ffd94f91a211" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG nova.compute.manager [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Instance network_info: |[{"id": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "address": "fa:16:3e:ca:70:43", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef63421-a4", "ovs_interfaceid": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-64c1d84b-7d33-429e-a1b4-4140bb64c93a req-5acba502-b202-471b-b0bb-1f3c9b4daa45 service nova] Acquired lock "refresh_cache-8220a084-e402-435a-b6a7-ffd94f91a211" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG nova.network.neutron [req-64c1d84b-7d33-429e-a1b4-4140bb64c93a req-5acba502-b202-471b-b0bb-1f3c9b4daa45 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Refreshing network info cache for port 3ef63421-a4aa-4126-b8ee-c141b2ef10cb {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Start _get_guest_xml network_info=[{"id": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "address": "fa:16:3e:ca:70:43", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef63421-a4", "ovs_interfaceid": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:41:38 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:41:38 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:41:38 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:41:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1500691485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1500691485',id=17,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbZYzDLzDUqAfp9/0tMMWal0Npb7Q9VW764vBVt/78de6sGHrTc6QryY/PPWtnTrkZNOrBVy1sS2Lv9880nGFfXr7m+xb6JqE7SCtrvvtov8Bx57jr2o0U2QK23gjDKkw==',key_name='tempest-keypair-1575579439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c1ccc7c1aaf497da5f1d325d79e9301',ramdisk_id='',reservation_id='r-j80xfzw1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1730232968',owner_user_name='tempest-AttachVolumeShelveTestJSON-1730232968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:41:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bda36df8b1f64c7894bfee5da258c1e6',uuid=8220a084-e402-435a-b6a7-ffd94f91a211,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "address": "fa:16:3e:ca:70:43", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef63421-a4", "ovs_interfaceid": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Converting VIF {"id": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "address": "fa:16:3e:ca:70:43", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef63421-a4", "ovs_interfaceid": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:70:43,bridge_name='br-int',has_traffic_filtering=True,id=3ef63421-a4aa-4126-b8ee-c141b2ef10cb,network=Network(cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ef63421-a4') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG nova.objects.instance [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lazy-loading 'pci_devices' on Instance uuid 8220a084-e402-435a-b6a7-ffd94f91a211 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856807c9-af22-4be7-834e-2d7003329f8c/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:41:38 user nova-compute[73484]:   <uuid>8220a084-e402-435a-b6a7-ffd94f91a211</uuid>
Aug 14 13:41:38 user nova-compute[73484]:   <name>instance-00000011</name>
Aug 14 13:41:38 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:41:38 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:41:38 user nova-compute[73484]:   <metadata>
Aug 14 13:41:38 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:41:38 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:41:38 user nova-compute[73484]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1500691485</nova:name>
Aug 14 13:41:38 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:41:38</nova:creationTime>
Aug 14 13:41:38 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:41:38 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:41:38 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:41:38 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:41:38 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:41:38 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:41:38 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:41:38 user nova-compute[73484]:       <nova:owner>
Aug 14 13:41:38 user nova-compute[73484]:         <nova:user uuid="bda36df8b1f64c7894bfee5da258c1e6">tempest-AttachVolumeShelveTestJSON-1730232968-project-member</nova:user>
Aug 14 13:41:38 user nova-compute[73484]:         <nova:project uuid="0c1ccc7c1aaf497da5f1d325d79e9301">tempest-AttachVolumeShelveTestJSON-1730232968</nova:project>
Aug 14 13:41:38 user nova-compute[73484]:       </nova:owner>
Aug 14 13:41:38 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:41:38 user nova-compute[73484]:       <nova:ports>
Aug 14 13:41:38 user nova-compute[73484]:         <nova:port uuid="3ef63421-a4aa-4126-b8ee-c141b2ef10cb">
Aug 14 13:41:38 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 13:41:38 user nova-compute[73484]:         </nova:port>
Aug 14 13:41:38 user nova-compute[73484]:       </nova:ports>
Aug 14 13:41:38 user nova-compute[73484]:     </nova:instance>
Aug 14 13:41:38 user nova-compute[73484]:   </metadata>
Aug 14 13:41:38 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:41:38 user nova-compute[73484]:     <system>
Aug 14 13:41:38 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:41:38 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:41:38 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:41:38 user nova-compute[73484]:       <entry name="serial">8220a084-e402-435a-b6a7-ffd94f91a211</entry>
Aug 14 13:41:38 user nova-compute[73484]:       <entry name="uuid">8220a084-e402-435a-b6a7-ffd94f91a211</entry>
Aug 14 13:41:38 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:41:38 user nova-compute[73484]:     </system>
Aug 14 13:41:38 user nova-compute[73484]:   </sysinfo>
Aug 14 13:41:38 user nova-compute[73484]:   <os>
Aug 14 13:41:38 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:41:38 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:41:38 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:41:38 user nova-compute[73484]:   </os>
Aug 14 13:41:38 user nova-compute[73484]:   <features>
Aug 14 13:41:38 user nova-compute[73484]:     <acpi/>
Aug 14 13:41:38 user nova-compute[73484]:     <apic/>
Aug 14 13:41:38 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:41:38 user nova-compute[73484]:   </features>
Aug 14 13:41:38 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:41:38 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:41:38 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:41:38 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:41:38 user nova-compute[73484]:   </clock>
Aug 14 13:41:38 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:41:38 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:41:38 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:41:38 user nova-compute[73484]:   </cpu>
Aug 14 13:41:38 user nova-compute[73484]:   <devices>
Aug 14 13:41:38 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:41:38 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:41:38 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk"/>
Aug 14 13:41:38 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:41:38 user nova-compute[73484]:     </disk>
Aug 14 13:41:38 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:41:38 user nova-compute[73484]:       <mac address="fa:16:3e:ca:70:43"/>
Aug 14 13:41:38 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:41:38 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:41:38 user nova-compute[73484]:       <target dev="tap3ef63421-a4"/>
Aug 14 13:41:38 user nova-compute[73484]:     </interface>
Aug 14 13:41:38 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:41:38 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/console.log" append="off"/>
Aug 14 13:41:38 user nova-compute[73484]:     </serial>
Aug 14 13:41:38 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:41:38 user nova-compute[73484]:     <video>
Aug 14 13:41:38 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:41:38 user nova-compute[73484]:     </video>
Aug 14 13:41:38 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:41:38 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:41:38 user nova-compute[73484]:     </rng>
Aug 14 13:41:38 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:41:38 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:41:38 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:41:38 user nova-compute[73484]:     </memballoon>
Aug 14 13:41:38 user nova-compute[73484]:   </devices>
Aug 14 13:41:38 user nova-compute[73484]: </domain>
Aug 14 13:41:38 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:41:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1500691485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1500691485',id=17,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbZYzDLzDUqAfp9/0tMMWal0Npb7Q9VW764vBVt/78de6sGHrTc6QryY/PPWtnTrkZNOrBVy1sS2Lv9880nGFfXr7m+xb6JqE7SCtrvvtov8Bx57jr2o0U2QK23gjDKkw==',key_name='tempest-keypair-1575579439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c1ccc7c1aaf497da5f1d325d79e9301',ramdisk_id='',reservation_id='r-j80xfzw1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1730232968',owner_user_name='tempest-AttachVolumeShelveTestJSON-1730232968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:41:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bda36df8b1f64c7894bfee5da258c1e6',uuid=8220a084-e402-435a-b6a7-ffd94f91a211,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "address": "fa:16:3e:ca:70:43", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef63421-a4", "ovs_interfaceid": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Converting VIF {"id": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "address": "fa:16:3e:ca:70:43", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef63421-a4", "ovs_interfaceid": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:70:43,bridge_name='br-int',has_traffic_filtering=True,id=3ef63421-a4aa-4126-b8ee-c141b2ef10cb,network=Network(cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ef63421-a4') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG os_vif [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:70:43,bridge_name='br-int',has_traffic_filtering=True,id=3ef63421-a4aa-4126-b8ee-c141b2ef10cb,network=Network(cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ef63421-a4') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG nova.network.neutron [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Updating instance_info_cache with network_info: [{"id": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "address": "fa:16:3e:a8:f5:8b", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa109f4ac-a7", "ovs_interfaceid": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ef63421-a4, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3ef63421-a4, col_values=(('external_ids', {'iface-id': '3ef63421-a4aa-4126-b8ee-c141b2ef10cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:70:43', 'vm-uuid': '8220a084-e402-435a-b6a7-ffd94f91a211'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:41:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:38 user nova-compute[73484]: INFO os_vif [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:70:43,bridge_name='br-int',has_traffic_filtering=True,id=3ef63421-a4aa-4126-b8ee-c141b2ef10cb,network=Network(cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ef63421-a4')
Aug 14 13:41:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Releasing lock "refresh_cache-a9d4ec42-3db9-439b-87a7-02bcaab514a4" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:41:39 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:41:39 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] No VIF found with MAC fa:16:3e:ca:70:43, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:41:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856807c9-af22-4be7-834e-2d7003329f8c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856807c9-af22-4be7-834e-2d7003329f8c/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/856807c9-af22-4be7-834e-2d7003329f8c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d01b50-8888-4def-a617-5b4e77a45837/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-62b19ed0-dfa4-493e-aba1-2396fd8436c2 req-8abd60cb-2fa4-4ce9-a100-601c85177f53 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Received event network-vif-unplugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:41:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-62b19ed0-dfa4-493e-aba1-2396fd8436c2 req-8abd60cb-2fa4-4ce9-a100-601c85177f53 service nova] Acquiring lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-62b19ed0-dfa4-493e-aba1-2396fd8436c2 req-8abd60cb-2fa4-4ce9-a100-601c85177f53 service nova] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-62b19ed0-dfa4-493e-aba1-2396fd8436c2 req-8abd60cb-2fa4-4ce9-a100-601c85177f53 service nova] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-62b19ed0-dfa4-493e-aba1-2396fd8436c2 req-8abd60cb-2fa4-4ce9-a100-601c85177f53 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] No waiting events found dispatching network-vif-unplugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:41:39 user nova-compute[73484]: WARNING nova.compute.manager [req-62b19ed0-dfa4-493e-aba1-2396fd8436c2 req-8abd60cb-2fa4-4ce9-a100-601c85177f53 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Received unexpected event network-vif-unplugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 for instance with vm_state active and task_state rescuing.
Aug 14 13:41:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d01b50-8888-4def-a617-5b4e77a45837/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d01b50-8888-4def-a617-5b4e77a45837/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:39 user nova-compute[73484]: DEBUG nova.network.neutron [req-64c1d84b-7d33-429e-a1b4-4140bb64c93a req-5acba502-b202-471b-b0bb-1f3c9b4daa45 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Updated VIF entry in instance network info cache for port 3ef63421-a4aa-4126-b8ee-c141b2ef10cb. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:41:39 user nova-compute[73484]: DEBUG nova.network.neutron [req-64c1d84b-7d33-429e-a1b4-4140bb64c93a req-5acba502-b202-471b-b0bb-1f3c9b4daa45 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Updating instance_info_cache with network_info: [{"id": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "address": "fa:16:3e:ca:70:43", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef63421-a4", "ovs_interfaceid": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:41:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-64c1d84b-7d33-429e-a1b4-4140bb64c93a req-5acba502-b202-471b-b0bb-1f3c9b4daa45 service nova] Releasing lock "refresh_cache-8220a084-e402-435a-b6a7-ffd94f91a211" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:41:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20d01b50-8888-4def-a617-5b4e77a45837/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:40 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:41:40 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:41:40 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=7199MB free_disk=25.510120391845703GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 13:41:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:40 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Instance destroyed successfully.
Aug 14 13:41:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:40 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Attempting a stable device rescue
Aug 14 13:41:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73484) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 13:41:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Instance directory exists: not creating {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 13:41:40 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Creating image(s)
Aug 14 13:41:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9d4ec42-3db9-439b-87a7-02bcaab514a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "/opt/stack/data/nova/instances/a9d4ec42-3db9-439b-87a7-02bcaab514a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "/opt/stack/data/nova/instances/a9d4ec42-3db9-439b-87a7-02bcaab514a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:40 user nova-compute[73484]: DEBUG nova.objects.instance [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lazy-loading 'trusted_certs' on Instance uuid a9d4ec42-3db9-439b-87a7-02bcaab514a4 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:41:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "79388acd31d915b4e649b7ca311af9a3498c102e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "79388acd31d915b4e649b7ca311af9a3498c102e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.005s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:40 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance f4f7788c-fcca-47c1-b5b8-72892253982d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:41:40 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:41:40 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:41:40 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 07bac569-8b2c-4555-b4d5-a74f7384630b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:41:40 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance b889688d-13dd-4f7b-bfef-26dc5347fd6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:41:40 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance eaaccbea-d453-4943-9663-949c66029d87 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:41:40 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance a9d4ec42-3db9-439b-87a7-02bcaab514a4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:41:40 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 856807c9-af22-4be7-834e-2d7003329f8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:41:40 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 20d01b50-8888-4def-a617-5b4e77a45837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:41:40 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance ed239af5-980e-42d3-8ebd-ca100ccb2708 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:41:40 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance bd43e3a9-0413-4e55-b6a1-7f3f792ba872 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:41:40 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 8220a084-e402-435a-b6a7-ffd94f91a211 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:41:40 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 13:41:40 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 13:41:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79388acd31d915b4e649b7ca311af9a3498c102e.part --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:41 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:41 user nova-compute[73484]: DEBUG nova.compute.manager [req-8c3ae98e-55bc-4f4f-a9be-bf1b24a48476 req-4ba1490a-72d4-4732-9c42-2d730ec07825 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Received event network-vif-plugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:41:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8c3ae98e-55bc-4f4f-a9be-bf1b24a48476 req-4ba1490a-72d4-4732-9c42-2d730ec07825 service nova] Acquiring lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8c3ae98e-55bc-4f4f-a9be-bf1b24a48476 req-4ba1490a-72d4-4732-9c42-2d730ec07825 service nova] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8c3ae98e-55bc-4f4f-a9be-bf1b24a48476 req-4ba1490a-72d4-4732-9c42-2d730ec07825 service nova] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:41 user nova-compute[73484]: DEBUG nova.compute.manager [req-8c3ae98e-55bc-4f4f-a9be-bf1b24a48476 req-4ba1490a-72d4-4732-9c42-2d730ec07825 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] No waiting events found dispatching network-vif-plugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:41:41 user nova-compute[73484]: WARNING nova.compute.manager [req-8c3ae98e-55bc-4f4f-a9be-bf1b24a48476 req-4ba1490a-72d4-4732-9c42-2d730ec07825 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Received unexpected event network-vif-plugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 for instance with vm_state active and task_state rescuing.
Aug 14 13:41:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79388acd31d915b4e649b7ca311af9a3498c102e.part --force-share --output=json" returned: 0 in 0.192s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:41 user nova-compute[73484]: DEBUG nova.virt.images [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] 09869a8c-a92c-4bdf-9b40-25934268470a was qcow2, converting to raw {{(pid=73484) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 13:41:41 user nova-compute[73484]: DEBUG nova.privsep.utils [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73484) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 13:41:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/79388acd31d915b4e649b7ca311af9a3498c102e.part /opt/stack/data/nova/instances/_base/79388acd31d915b4e649b7ca311af9a3498c102e.converted {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:42 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:41:42 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:41:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 13:41:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.840s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/79388acd31d915b4e649b7ca311af9a3498c102e.part /opt/stack/data/nova/instances/_base/79388acd31d915b4e649b7ca311af9a3498c102e.converted" returned: 0 in 0.556s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79388acd31d915b4e649b7ca311af9a3498c102e.converted --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79388acd31d915b4e649b7ca311af9a3498c102e.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "79388acd31d915b4e649b7ca311af9a3498c102e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.901s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "79388acd31d915b4e649b7ca311af9a3498c102e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "79388acd31d915b4e649b7ca311af9a3498c102e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79388acd31d915b4e649b7ca311af9a3498c102e --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79388acd31d915b4e649b7ca311af9a3498c102e --force-share --output=json" returned: 0 in 0.192s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/79388acd31d915b4e649b7ca311af9a3498c102e,backing_fmt=raw /opt/stack/data/nova/instances/a9d4ec42-3db9-439b-87a7-02bcaab514a4/disk.rescue {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/79388acd31d915b4e649b7ca311af9a3498c102e,backing_fmt=raw /opt/stack/data/nova/instances/a9d4ec42-3db9-439b-87a7-02bcaab514a4/disk.rescue" returned: 0 in 0.056s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "79388acd31d915b4e649b7ca311af9a3498c102e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:42 user nova-compute[73484]: DEBUG nova.objects.instance [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lazy-loading 'migration_context' on Instance uuid a9d4ec42-3db9-439b-87a7-02bcaab514a4 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Start _get_guest_xml network_info=[{"id": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "address": "fa:16:3e:a8:f5:8b", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "vif_mac": "fa:16:3e:a8:f5:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa109f4ac-a7", "ovs_interfaceid": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '09869a8c-a92c-4bdf-9b40-25934268470a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6ae62a28-0b8d-44de-a48a-65049f67232f', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzLZCdIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'a9d4ec42-3db9-439b-87a7-02bcaab514a4', 'attached_at': '', 'detached_at': '', 'volume_id': 'aac0dffc-1c43-44e8-adff-0463af08c68d', 'serial': 'aac0dffc-1c43-44e8-adff-0463af08c68d'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.objects.instance [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lazy-loading 'resources' on Instance uuid a9d4ec42-3db9-439b-87a7-02bcaab514a4 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.objects.instance [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lazy-loading 'numa_topology' on Instance uuid a9d4ec42-3db9-439b-87a7-02bcaab514a4 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:41:43 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:41:43 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.objects.instance [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lazy-loading 'vcpu_model' on Instance uuid a9d4ec42-3db9-439b-87a7-02bcaab514a4 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzLZCdIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:41:43 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:41:43 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:41:43 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:41:43 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:41:43 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020503.0947545, 8220a084-e402-435a-b6a7-ffd94f91a211 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:41:43 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] VM Resumed (Lifecycle Event)
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.compute.manager [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:43 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Instance spawned successfully.
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[130cacfb-08ae-4e0c-bd20-0417dc6d7d99]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = EzLZCdIX\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 14 13:41:43 user nova-compute[73484]: node.name = iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d
Aug 14 13:41:43 user nova-compute[73484]: node.tpgt = -1
Aug 14 13:41:43 user nova-compute[73484]: node.startup = automatic
Aug 14 13:41:43 user nova-compute[73484]: node.leading_login = No
Aug 14 13:41:43 user nova-compute[73484]: iface.iscsi_ifacename = default
Aug 14 13:41:43 user nova-compute[73484]: iface.net_ifacename = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.ipaddress = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.prefix_len = 0
Aug 14 13:41:43 user nova-compute[73484]: iface.hwaddress = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.transport_name = tcp
Aug 14 13:41:43 user nova-compute[73484]: iface.initiatorname = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.state = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.vlan_id = 0
Aug 14 13:41:43 user nova-compute[73484]: iface.vlan_priority = 0
Aug 14 13:41:43 user nova-compute[73484]: iface.vlan_state = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.iface_num = 0
Aug 14 13:41:43 user nova-compute[73484]: iface.mtu = 0
Aug 14 13:41:43 user nova-compute[73484]: iface.port = 0
Aug 14 13:41:43 user nova-compute[73484]: iface.bootproto = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.subnet_mask = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.gateway = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.dhcp_alt_client_id_state = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.dhcp_alt_client_id = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.dhcp_dns = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.dhcp_learn_iqn = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.dhcp_req_vendor_id_state = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.dhcp_vendor_id_state = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.dhcp_vendor_id = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.dhcp_slp_da = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.fragmentation = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.gratuitous_arp = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.incoming_forwarding = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.tos_state = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.tos = 0
Aug 14 13:41:43 user nova-compute[73484]: iface.ttl = 0
Aug 14 13:41:43 user nova-compute[73484]: iface.delayed_ack = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.tcp_nagle = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.tcp_wsf_state = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.tcp_wsf = 0
Aug 14 13:41:43 user nova-compute[73484]: iface.tcp_timer_scale = 0
Aug 14 13:41:43 user nova-compute[73484]: iface.tcp_timestamp = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.redirect = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.def_task_mgmt_timeout = 0
Aug 14 13:41:43 user nova-compute[73484]: iface.header_digest = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.data_digest = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.immediate_data = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.initial_r2t = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.data_seq_inorder = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.data_pdu_inorder = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.erl = 0
Aug 14 13:41:43 user nova-compute[73484]: iface.max_receive_data_len = 0
Aug 14 13:41:43 user nova-compute[73484]: iface.first_burst_len = 0
Aug 14 13:41:43 user nova-compute[73484]: iface.max_outstanding_r2t = 0
Aug 14 13:41:43 user nova-compute[73484]: iface.max_burst_len = 0
Aug 14 13:41:43 user nova-compute[73484]: iface.chap_auth = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.bidi_chap = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.strict_login_compliance = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.discovery_auth = <empty>
Aug 14 13:41:43 user nova-compute[73484]: iface.discovery_logout = <empty>
Aug 14 13:41:43 user nova-compute[73484]: node.discovery_address = <empty>
Aug 14 13:41:43 user nova-compute[73484]: node.discovery_port = 0
Aug 14 13:41:43 user nova-compute[73484]: node.discovery_type = static
Aug 14 13:41:43 user nova-compute[73484]: node.session.initial_cmdsn = 0
Aug 14 13:41:43 user nova-compute[73484]: node.session.initial_login_retry_max = 8
Aug 14 13:41:43 user nova-compute[73484]: node.session.xmit_thread_priority = -20
Aug 14 13:41:43 user nova-compute[73484]: node.session.cmds_max = 128
Aug 14 13:41:43 user nova-compute[73484]: node.session.queue_depth = 32
Aug 14 13:41:43 user nova-compute[73484]: node.session.nr_sessions = 1
Aug 14 13:41:43 user nova-compute[73484]: node.session.auth.authmethod = CHAP
Aug 14 13:41:43 user nova-compute[73484]: node.session.auth.username = EzLZCdIX
Aug 14 13:41:43 user nova-compute[73484]: node.session.auth.password = ***
Aug 14 13:41:43 user nova-compute[73484]: node.session.auth.username_in = <empty>
Aug 14 13:41:43 user nova-compute[73484]: node.session.auth.password_in = <empty>
Aug 14 13:41:43 user nova-compute[73484]: node.session.auth.chap_algs = MD5
Aug 14 13:41:43 user nova-compute[73484]: node.session.timeo.replacement_timeout = 120
Aug 14 13:41:43 user nova-compute[73484]: node.session.err_timeo.abort_timeout = 15
Aug 14 13:41:43 user nova-compute[73484]: node.session.err_timeo.lu_reset_timeout = 30
Aug 14 13:41:43 user nova-compute[73484]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 14 13:41:43 user nova-compute[73484]: node.session.err_timeo.host_reset_timeout = 60
Aug 14 13:41:43 user nova-compute[73484]: node.session.iscsi.FastAbort = Yes
Aug 14 13:41:43 user nova-compute[73484]: node.session.iscsi.InitialR2T = No
Aug 14 13:41:43 user nova-compute[73484]: node.session.iscsi.ImmediateData = Yes
Aug 14 13:41:43 user nova-compute[73484]: node.session.iscsi.FirstBurstLength = 262144
Aug 14 13:41:43 user nova-compute[73484]: node.session.iscsi.MaxBurstLength = 16776192
Aug 14 13:41:43 user nova-compute[73484]: node.session.iscsi.DefaultTime2Retain = 0
Aug 14 13:41:43 user nova-compute[73484]: node.session.iscsi.DefaultTime2Wait = 2
Aug 14 13:41:43 user nova-compute[73484]: node.session.iscsi.MaxConnections = 1
Aug 14 13:41:43 user nova-compute[73484]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 14 13:41:43 user nova-compute[73484]: node.session.iscsi.ERL = 0
Aug 14 13:41:43 user nova-compute[73484]: node.session.scan = manual
Aug 14 13:41:43 user nova-compute[73484]: node.session.reopen_max = 0
Aug 14 13:41:43 user nova-compute[73484]: node.conn[0].address = 172.16.0.220
Aug 14 13:41:43 user nova-compute[73484]: node.conn[0].port = 3260
Aug 14 13:41:43 user nova-compute[73484]: node.conn[0].startup = manual
Aug 14 13:41:43 user nova-compute[73484]: node.conn[0].tcp.window_size = 524288
Aug 14 13:41:43 user nova-compute[73484]: node.conn[0].tcp.type_of_service = 0
Aug 14 13:41:43 user nova-compute[73484]: node.conn[0].timeo.logout_timeout = 15
Aug 14 13:41:43 user nova-compute[73484]: node.conn[0].timeo.login_timeout = 15
Aug 14 13:41:43 user nova-compute[73484]: node.conn[0].timeo.auth_timeout = 45
Aug 14 13:41:43 user nova-compute[73484]: node.conn[0].timeo.noop_out_interval = 5
Aug 14 13:41:43 user nova-compute[73484]: node.conn[0].timeo.noop_out_timeout = 5
Aug 14 13:41:43 user nova-compute[73484]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 14 13:41:43 user nova-compute[73484]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 14 13:41:43 user nova-compute[73484]: node.conn[0].iscsi.HeaderDigest = None
Aug 14 13:41:43 user nova-compute[73484]: node.conn[0].iscsi.DataDigest = None
Aug 14 13:41:43 user nova-compute[73484]: node.conn[0].iscsi.IFMarker = No
Aug 14 13:41:43 user nova-compute[73484]: node.conn[0].iscsi.OFMarker = No
Aug 14 13:41:43 user nova-compute[73484]: # END RECORD
Aug 14 13:41:43 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:41:43 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020503.1110253, 8220a084-e402-435a-b6a7-ffd94f91a211 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:41:43 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] VM Started (Lifecycle Event)
Aug 14 13:41:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5782dea-8609-452f-9a9b-8858488940aa]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c275aa95-06f8-4e12-a459-89fa9f5afeec]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EzLZCdIX {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EzLZCdIX" returned: 0 in 0.033s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ade364c-9b78-4211-8316-f3d1143d2f1a]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EzLZCdIX'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:43 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:41:43 user nova-compute[73484]: INFO nova.compute.manager [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Took 10.50 seconds to spawn the instance on the hypervisor.
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.compute.manager [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Acquiring lock "1c48c0d4-7d10-4086-b30f-61e71f358622" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Lock "1c48c0d4-7d10-4086-b30f-61e71f358622" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff062d12-7d38-4596-b928-1772f4f6fa13]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.compute.manager [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[29596ea3-ea68-480a-b461-a6d7ccb49e67]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:41:43 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:41:43 user nova-compute[73484]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:41:43 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:41:43 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:41:43 user nova-compute[73484]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:41:43 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.216s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] HCTL ('33', '0', '0', 0) found on session 17 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b8f1ff-e797-4df5-a6f2-d23a642d3441]: (4, ('0 0 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Searching for a device in session 17 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzLZCdIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.258s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] <== connect_volume: return (259ms) {'type': 'block', 'scsi_wwn': '26162303666646438', 'path': '/dev/sdb'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162303666646438', 'path': '/dev/sdb'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:41:43 user nova-compute[73484]: INFO nova.compute.manager [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Took 11.35 seconds to build instance.
Aug 14 13:41:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-746bf074-ea91-49ab-9d47-0e9ce51d0b11 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "8220a084-e402-435a-b6a7-ffd94f91a211" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.453s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:39:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-276871641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-276871641',id=12,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:40:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c7f2c51c0f84bf1aedcf493a9ff860f',ramdisk_id='',reservation_id='r-zx07pb5m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-830908511',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:40:16Z,user_data=None,user_id='5a0f55ad018d4c0ca587d8bdd40df4c8',uuid=a9d4ec42-3db9-439b-87a7-02bcaab514a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "address": "fa:16:3e:a8:f5:8b", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "vif_mac": "fa:16:3e:a8:f5:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa109f4ac-a7", "ovs_interfaceid": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Converting VIF {"id": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "address": "fa:16:3e:a8:f5:8b", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "vif_mac": "fa:16:3e:a8:f5:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa109f4ac-a7", "ovs_interfaceid": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:f5:8b,bridge_name='br-int',has_traffic_filtering=True,id=a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26,network=Network(4ec437fc-4371-48d6-8026-b64423fbc0ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa109f4ac-a7') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.objects.instance [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lazy-loading 'pci_devices' on Instance uuid a9d4ec42-3db9-439b-87a7-02bcaab514a4 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:41:43 user nova-compute[73484]: INFO nova.compute.claims [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Claim successful on node user
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:41:43 user nova-compute[73484]:   <uuid>a9d4ec42-3db9-439b-87a7-02bcaab514a4</uuid>
Aug 14 13:41:43 user nova-compute[73484]:   <name>instance-0000000c</name>
Aug 14 13:41:43 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:41:43 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:41:43 user nova-compute[73484]:   <metadata>
Aug 14 13:41:43 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:41:43 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:41:43 user nova-compute[73484]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-276871641</nova:name>
Aug 14 13:41:43 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:41:43</nova:creationTime>
Aug 14 13:41:43 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:41:43 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:41:43 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:41:43 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:41:43 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:41:43 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:41:43 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:41:43 user nova-compute[73484]:       <nova:owner>
Aug 14 13:41:43 user nova-compute[73484]:         <nova:user uuid="5a0f55ad018d4c0ca587d8bdd40df4c8">tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member</nova:user>
Aug 14 13:41:43 user nova-compute[73484]:         <nova:project uuid="2c7f2c51c0f84bf1aedcf493a9ff860f">tempest-ServerBootFromVolumeStableRescueTest-830908511</nova:project>
Aug 14 13:41:43 user nova-compute[73484]:       </nova:owner>
Aug 14 13:41:43 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:41:43 user nova-compute[73484]:       <nova:ports>
Aug 14 13:41:43 user nova-compute[73484]:         <nova:port uuid="a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26">
Aug 14 13:41:43 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 13:41:43 user nova-compute[73484]:         </nova:port>
Aug 14 13:41:43 user nova-compute[73484]:       </nova:ports>
Aug 14 13:41:43 user nova-compute[73484]:     </nova:instance>
Aug 14 13:41:43 user nova-compute[73484]:   </metadata>
Aug 14 13:41:43 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:41:43 user nova-compute[73484]:     <system>
Aug 14 13:41:43 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:41:43 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:41:43 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:41:43 user nova-compute[73484]:       <entry name="serial">a9d4ec42-3db9-439b-87a7-02bcaab514a4</entry>
Aug 14 13:41:43 user nova-compute[73484]:       <entry name="uuid">a9d4ec42-3db9-439b-87a7-02bcaab514a4</entry>
Aug 14 13:41:43 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:41:43 user nova-compute[73484]:     </system>
Aug 14 13:41:43 user nova-compute[73484]:   </sysinfo>
Aug 14 13:41:43 user nova-compute[73484]:   <os>
Aug 14 13:41:43 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:41:43 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:41:43 user nova-compute[73484]:   </os>
Aug 14 13:41:43 user nova-compute[73484]:   <features>
Aug 14 13:41:43 user nova-compute[73484]:     <acpi/>
Aug 14 13:41:43 user nova-compute[73484]:     <apic/>
Aug 14 13:41:43 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:41:43 user nova-compute[73484]:   </features>
Aug 14 13:41:43 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:41:43 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:41:43 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:41:43 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:41:43 user nova-compute[73484]:   </clock>
Aug 14 13:41:43 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:41:43 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:41:43 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:41:43 user nova-compute[73484]:   </cpu>
Aug 14 13:41:43 user nova-compute[73484]:   <devices>
Aug 14 13:41:43 user nova-compute[73484]:     <disk type="block" device="disk">
Aug 14 13:41:43 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:41:43 user nova-compute[73484]:       <source dev="/dev/sdb"/>
Aug 14 13:41:43 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:41:43 user nova-compute[73484]:       <serial>aac0dffc-1c43-44e8-adff-0463af08c68d</serial>
Aug 14 13:41:43 user nova-compute[73484]:     </disk>
Aug 14 13:41:43 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:41:43 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:41:43 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/a9d4ec42-3db9-439b-87a7-02bcaab514a4/disk.rescue"/>
Aug 14 13:41:43 user nova-compute[73484]:       <target dev="vdb" bus="virtio"/>
Aug 14 13:41:43 user nova-compute[73484]:       <boot order="1"/>
Aug 14 13:41:43 user nova-compute[73484]:     </disk>
Aug 14 13:41:43 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:41:43 user nova-compute[73484]:       <mac address="fa:16:3e:a8:f5:8b"/>
Aug 14 13:41:43 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:41:43 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:41:43 user nova-compute[73484]:       <target dev="tapa109f4ac-a7"/>
Aug 14 13:41:43 user nova-compute[73484]:     </interface>
Aug 14 13:41:43 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:41:43 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/a9d4ec42-3db9-439b-87a7-02bcaab514a4/console.log" append="off"/>
Aug 14 13:41:43 user nova-compute[73484]:     </serial>
Aug 14 13:41:43 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:41:43 user nova-compute[73484]:     <video>
Aug 14 13:41:43 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:41:43 user nova-compute[73484]:     </video>
Aug 14 13:41:43 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:41:43 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:41:43 user nova-compute[73484]:     </rng>
Aug 14 13:41:43 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:41:43 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:41:43 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:41:43 user nova-compute[73484]:     </memballoon>
Aug 14 13:41:43 user nova-compute[73484]:   </devices>
Aug 14 13:41:43 user nova-compute[73484]: </domain>
Aug 14 13:41:43 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:41:43 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Instance destroyed successfully.
Aug 14 13:41:43 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] No VIF found with MAC fa:16:3e:a8:f5:8b, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG nova.compute.manager [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:41:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:44 user nova-compute[73484]: DEBUG nova.compute.manager [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:41:44 user nova-compute[73484]: DEBUG nova.network.neutron [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:41:44 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:41:44 user nova-compute[73484]: DEBUG nova.compute.manager [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:41:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-56304618-e27f-4219-a835-5090c778e5c0 tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Acquiring lock "856807c9-af22-4be7-834e-2d7003329f8c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-56304618-e27f-4219-a835-5090c778e5c0 tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Lock "856807c9-af22-4be7-834e-2d7003329f8c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-56304618-e27f-4219-a835-5090c778e5c0 tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Acquiring lock "856807c9-af22-4be7-834e-2d7003329f8c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-56304618-e27f-4219-a835-5090c778e5c0 tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Lock "856807c9-af22-4be7-834e-2d7003329f8c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-56304618-e27f-4219-a835-5090c778e5c0 tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Lock "856807c9-af22-4be7-834e-2d7003329f8c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:44 user nova-compute[73484]: INFO nova.compute.manager [None req-56304618-e27f-4219-a835-5090c778e5c0 tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Terminating instance
Aug 14 13:41:44 user nova-compute[73484]: DEBUG nova.policy [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec7bc3cba1744dd4b8c3bda4b21046ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f289d1ed47534aeb867493f618d25e73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:41:44 user nova-compute[73484]: DEBUG nova.compute.manager [None req-56304618-e27f-4219-a835-5090c778e5c0 tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:41:44 user nova-compute[73484]: DEBUG nova.compute.manager [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:41:44 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:41:44 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Creating image(s)
Aug 14 13:41:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c48c0d4-7d10-4086-b30f-61e71f358622/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Lock "/opt/stack/data/nova/instances/1c48c0d4-7d10-4086-b30f-61e71f358622/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Lock "/opt/stack/data/nova/instances/1c48c0d4-7d10-4086-b30f-61e71f358622/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.226s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.186s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/1c48c0d4-7d10-4086-b30f-61e71f358622/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/1c48c0d4-7d10-4086-b30f-61e71f358622/disk 1073741824" returned: 0 in 0.058s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.235s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:45 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c48c0d4-7d10-4086-b30f-61e71f358622/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:41:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c48c0d4-7d10-4086-b30f-61e71f358622/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:41:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c48c0d4-7d10-4086-b30f-61e71f358622/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:41:45 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Cannot resize image /opt/stack/data/nova/instances/1c48c0d4-7d10-4086-b30f-61e71f358622/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:41:45 user nova-compute[73484]: DEBUG nova.objects.instance [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Lazy-loading 'migration_context' on Instance uuid 1c48c0d4-7d10-4086-b30f-61e71f358622 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:41:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:45 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:41:45 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Ensure instance console log exists: /opt/stack/data/nova/instances/1c48c0d4-7d10-4086-b30f-61e71f358622/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:41:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:45 user nova-compute[73484]: DEBUG nova.network.neutron [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Successfully created port: e4f351b4-1dd3-4d2b-ae56-dd96cda44d26 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:41:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:45 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Instance destroyed successfully.
Aug 14 13:41:45 user nova-compute[73484]: DEBUG nova.objects.instance [None req-56304618-e27f-4219-a835-5090c778e5c0 tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Lazy-loading 'resources' on Instance uuid 856807c9-af22-4be7-834e-2d7003329f8c {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:41:45 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-56304618-e27f-4219-a835-5090c778e5c0 tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:39:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2017245773',display_name='tempest-VolumesNegativeTest-instance-2017245773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2017245773',id=13,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:40:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2bd52d9b486b418687c2c40a72449b92',ramdisk_id='',reservation_id='r-019mb11d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-559064245',owner_user_name='tempest-VolumesNegativeTest-559064245-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:40:02Z,user_data=None,user_id='b10546863791489591e53a730bb66b18',uuid=856807c9-af22-4be7-834e-2d7003329f8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59f1948e-70b8-4051-bda8-44296770add6", "address": "fa:16:3e:c8:e6:56", "network": {"id": "25df0ef0-3c04-4a7d-840e-6f556ebd1dbc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a23940f0738942409fd00984c52e7e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f1948e-70", "ovs_interfaceid": "59f1948e-70b8-4051-bda8-44296770add6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:41:45 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-56304618-e27f-4219-a835-5090c778e5c0 tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Converting VIF {"id": "59f1948e-70b8-4051-bda8-44296770add6", "address": "fa:16:3e:c8:e6:56", "network": {"id": "25df0ef0-3c04-4a7d-840e-6f556ebd1dbc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a23940f0738942409fd00984c52e7e65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59f1948e-70", "ovs_interfaceid": "59f1948e-70b8-4051-bda8-44296770add6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:41:45 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-56304618-e27f-4219-a835-5090c778e5c0 tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:e6:56,bridge_name='br-int',has_traffic_filtering=True,id=59f1948e-70b8-4051-bda8-44296770add6,network=Network(25df0ef0-3c04-4a7d-840e-6f556ebd1dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59f1948e-70') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:41:45 user nova-compute[73484]: DEBUG os_vif [None req-56304618-e27f-4219-a835-5090c778e5c0 tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:e6:56,bridge_name='br-int',has_traffic_filtering=True,id=59f1948e-70b8-4051-bda8-44296770add6,network=Network(25df0ef0-3c04-4a7d-840e-6f556ebd1dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59f1948e-70') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:41:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59f1948e-70, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:41:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:41:45 user nova-compute[73484]: INFO os_vif [None req-56304618-e27f-4219-a835-5090c778e5c0 tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:e6:56,bridge_name='br-int',has_traffic_filtering=True,id=59f1948e-70b8-4051-bda8-44296770add6,network=Network(25df0ef0-3c04-4a7d-840e-6f556ebd1dbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59f1948e-70')
Aug 14 13:41:45 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-56304618-e27f-4219-a835-5090c778e5c0 tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Deleting instance files /opt/stack/data/nova/instances/856807c9-af22-4be7-834e-2d7003329f8c_del
Aug 14 13:41:45 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-56304618-e27f-4219-a835-5090c778e5c0 tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Deletion of /opt/stack/data/nova/instances/856807c9-af22-4be7-834e-2d7003329f8c_del complete
Aug 14 13:41:45 user nova-compute[73484]: INFO nova.compute.manager [None req-56304618-e27f-4219-a835-5090c778e5c0 tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Took 1.36 seconds to destroy the instance on the hypervisor.
Aug 14 13:41:45 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-56304618-e27f-4219-a835-5090c778e5c0 tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:41:45 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:41:45 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:41:47 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:41:47 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Took 1.72 seconds to deallocate network for instance.
Aug 14 13:41:47 user nova-compute[73484]: DEBUG nova.compute.manager [req-26d95b7c-2181-4088-8b53-8965fa5fa887 req-707ca517-3b45-456e-b8a2-94e42ba0687d service nova] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Received event network-vif-deleted-59f1948e-70b8-4051-bda8-44296770add6 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:41:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-56304618-e27f-4219-a835-5090c778e5c0 tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-56304618-e27f-4219-a835-5090c778e5c0 tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Removed pending event for a9d4ec42-3db9-439b-87a7-02bcaab514a4 due to event {{(pid=73484) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 13:41:47 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020507.7356884, a9d4ec42-3db9-439b-87a7-02bcaab514a4 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:41:47 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] VM Resumed (Lifecycle Event)
Aug 14 13:41:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-1be3f96c-f0d0-4167-b0eb-114c2c3b96d2 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:41:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:41:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:41:47 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 13:41:47 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020507.7370095, a9d4ec42-3db9-439b-87a7-02bcaab514a4 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:41:47 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] VM Started (Lifecycle Event)
Aug 14 13:41:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:41:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:41:47 user nova-compute[73484]: DEBUG nova.network.neutron [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Successfully updated port: e4f351b4-1dd3-4d2b-ae56-dd96cda44d26 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:41:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Acquiring lock "refresh_cache-1c48c0d4-7d10-4086-b30f-61e71f358622" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:41:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Acquired lock "refresh_cache-1c48c0d4-7d10-4086-b30f-61e71f358622" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:41:47 user nova-compute[73484]: DEBUG nova.network.neutron [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:41:48 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-56304618-e27f-4219-a835-5090c778e5c0 tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:41:48 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-56304618-e27f-4219-a835-5090c778e5c0 tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:41:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-56304618-e27f-4219-a835-5090c778e5c0 tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.479s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:48 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-56304618-e27f-4219-a835-5090c778e5c0 tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Deleted allocations for instance 856807c9-af22-4be7-834e-2d7003329f8c
Aug 14 13:41:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-56304618-e27f-4219-a835-5090c778e5c0 tempest-VolumesNegativeTest-559064245 tempest-VolumesNegativeTest-559064245-project-member] Lock "856807c9-af22-4be7-834e-2d7003329f8c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.948s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:48 user nova-compute[73484]: DEBUG nova.network.neutron [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:41:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:48 user nova-compute[73484]: DEBUG nova.network.neutron [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Updating instance_info_cache with network_info: [{"id": "e4f351b4-1dd3-4d2b-ae56-dd96cda44d26", "address": "fa:16:3e:c1:7a:84", "network": {"id": "6d30d7cf-8241-42c2-8618-d5531c996de7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1252938421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f289d1ed47534aeb867493f618d25e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4f351b4-1d", "ovs_interfaceid": "e4f351b4-1dd3-4d2b-ae56-dd96cda44d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:41:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Releasing lock "refresh_cache-1c48c0d4-7d10-4086-b30f-61e71f358622" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:41:48 user nova-compute[73484]: DEBUG nova.compute.manager [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Instance network_info: |[{"id": "e4f351b4-1dd3-4d2b-ae56-dd96cda44d26", "address": "fa:16:3e:c1:7a:84", "network": {"id": "6d30d7cf-8241-42c2-8618-d5531c996de7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1252938421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f289d1ed47534aeb867493f618d25e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4f351b4-1d", "ovs_interfaceid": "e4f351b4-1dd3-4d2b-ae56-dd96cda44d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Start _get_guest_xml network_info=[{"id": "e4f351b4-1dd3-4d2b-ae56-dd96cda44d26", "address": "fa:16:3e:c1:7a:84", "network": {"id": "6d30d7cf-8241-42c2-8618-d5531c996de7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1252938421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f289d1ed47534aeb867493f618d25e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4f351b4-1d", "ovs_interfaceid": "e4f351b4-1dd3-4d2b-ae56-dd96cda44d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:41:49 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:41:49 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:41:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-822383854',display_name='tempest-DeleteServersTestJSON-server-822383854',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-822383854',id=18,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f289d1ed47534aeb867493f618d25e73',ramdisk_id='',reservation_id='r-medz9qls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1793376884',owner_user_name='tempest-DeleteServersTestJSON-1793376884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:41:44Z,user_data=None,user_id='ec7bc3cba1744dd4b8c3bda4b21046ce',uuid=1c48c0d4-7d10-4086-b30f-61e71f358622,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4f351b4-1dd3-4d2b-ae56-dd96cda44d26", "address": "fa:16:3e:c1:7a:84", "network": {"id": "6d30d7cf-8241-42c2-8618-d5531c996de7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1252938421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f289d1ed47534aeb867493f618d25e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4f351b4-1d", "ovs_interfaceid": "e4f351b4-1dd3-4d2b-ae56-dd96cda44d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Converting VIF {"id": "e4f351b4-1dd3-4d2b-ae56-dd96cda44d26", "address": "fa:16:3e:c1:7a:84", "network": {"id": "6d30d7cf-8241-42c2-8618-d5531c996de7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1252938421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f289d1ed47534aeb867493f618d25e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4f351b4-1d", "ovs_interfaceid": "e4f351b4-1dd3-4d2b-ae56-dd96cda44d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:7a:84,bridge_name='br-int',has_traffic_filtering=True,id=e4f351b4-1dd3-4d2b-ae56-dd96cda44d26,network=Network(6d30d7cf-8241-42c2-8618-d5531c996de7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4f351b4-1d') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.objects.instance [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c48c0d4-7d10-4086-b30f-61e71f358622 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:41:49 user nova-compute[73484]:   <uuid>1c48c0d4-7d10-4086-b30f-61e71f358622</uuid>
Aug 14 13:41:49 user nova-compute[73484]:   <name>instance-00000012</name>
Aug 14 13:41:49 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:41:49 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:41:49 user nova-compute[73484]:   <metadata>
Aug 14 13:41:49 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:41:49 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:41:49 user nova-compute[73484]:       <nova:name>tempest-DeleteServersTestJSON-server-822383854</nova:name>
Aug 14 13:41:49 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:41:49</nova:creationTime>
Aug 14 13:41:49 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:41:49 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:41:49 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:41:49 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:41:49 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:41:49 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:41:49 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:41:49 user nova-compute[73484]:       <nova:owner>
Aug 14 13:41:49 user nova-compute[73484]:         <nova:user uuid="ec7bc3cba1744dd4b8c3bda4b21046ce">tempest-DeleteServersTestJSON-1793376884-project-member</nova:user>
Aug 14 13:41:49 user nova-compute[73484]:         <nova:project uuid="f289d1ed47534aeb867493f618d25e73">tempest-DeleteServersTestJSON-1793376884</nova:project>
Aug 14 13:41:49 user nova-compute[73484]:       </nova:owner>
Aug 14 13:41:49 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:41:49 user nova-compute[73484]:       <nova:ports>
Aug 14 13:41:49 user nova-compute[73484]:         <nova:port uuid="e4f351b4-1dd3-4d2b-ae56-dd96cda44d26">
Aug 14 13:41:49 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 13:41:49 user nova-compute[73484]:         </nova:port>
Aug 14 13:41:49 user nova-compute[73484]:       </nova:ports>
Aug 14 13:41:49 user nova-compute[73484]:     </nova:instance>
Aug 14 13:41:49 user nova-compute[73484]:   </metadata>
Aug 14 13:41:49 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:41:49 user nova-compute[73484]:     <system>
Aug 14 13:41:49 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:41:49 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:41:49 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:41:49 user nova-compute[73484]:       <entry name="serial">1c48c0d4-7d10-4086-b30f-61e71f358622</entry>
Aug 14 13:41:49 user nova-compute[73484]:       <entry name="uuid">1c48c0d4-7d10-4086-b30f-61e71f358622</entry>
Aug 14 13:41:49 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:41:49 user nova-compute[73484]:     </system>
Aug 14 13:41:49 user nova-compute[73484]:   </sysinfo>
Aug 14 13:41:49 user nova-compute[73484]:   <os>
Aug 14 13:41:49 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:41:49 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:41:49 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:41:49 user nova-compute[73484]:   </os>
Aug 14 13:41:49 user nova-compute[73484]:   <features>
Aug 14 13:41:49 user nova-compute[73484]:     <acpi/>
Aug 14 13:41:49 user nova-compute[73484]:     <apic/>
Aug 14 13:41:49 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:41:49 user nova-compute[73484]:   </features>
Aug 14 13:41:49 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:41:49 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:41:49 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:41:49 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:41:49 user nova-compute[73484]:   </clock>
Aug 14 13:41:49 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:41:49 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:41:49 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:41:49 user nova-compute[73484]:   </cpu>
Aug 14 13:41:49 user nova-compute[73484]:   <devices>
Aug 14 13:41:49 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:41:49 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:41:49 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/1c48c0d4-7d10-4086-b30f-61e71f358622/disk"/>
Aug 14 13:41:49 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:41:49 user nova-compute[73484]:     </disk>
Aug 14 13:41:49 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:41:49 user nova-compute[73484]:       <mac address="fa:16:3e:c1:7a:84"/>
Aug 14 13:41:49 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:41:49 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:41:49 user nova-compute[73484]:       <target dev="tape4f351b4-1d"/>
Aug 14 13:41:49 user nova-compute[73484]:     </interface>
Aug 14 13:41:49 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:41:49 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/1c48c0d4-7d10-4086-b30f-61e71f358622/console.log" append="off"/>
Aug 14 13:41:49 user nova-compute[73484]:     </serial>
Aug 14 13:41:49 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:41:49 user nova-compute[73484]:     <video>
Aug 14 13:41:49 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:41:49 user nova-compute[73484]:     </video>
Aug 14 13:41:49 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:41:49 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:41:49 user nova-compute[73484]:     </rng>
Aug 14 13:41:49 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:41:49 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:41:49 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:41:49 user nova-compute[73484]:     </memballoon>
Aug 14 13:41:49 user nova-compute[73484]:   </devices>
Aug 14 13:41:49 user nova-compute[73484]: </domain>
Aug 14 13:41:49 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:41:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-822383854',display_name='tempest-DeleteServersTestJSON-server-822383854',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-822383854',id=18,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f289d1ed47534aeb867493f618d25e73',ramdisk_id='',reservation_id='r-medz9qls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1793376884',owner_user_name='tempest-DeleteServersTestJSON-1793376884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:41:44Z,user_data=None,user_id='ec7bc3cba1744dd4b8c3bda4b21046ce',uuid=1c48c0d4-7d10-4086-b30f-61e71f358622,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4f351b4-1dd3-4d2b-ae56-dd96cda44d26", "address": "fa:16:3e:c1:7a:84", "network": {"id": "6d30d7cf-8241-42c2-8618-d5531c996de7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1252938421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f289d1ed47534aeb867493f618d25e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4f351b4-1d", "ovs_interfaceid": "e4f351b4-1dd3-4d2b-ae56-dd96cda44d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Converting VIF {"id": "e4f351b4-1dd3-4d2b-ae56-dd96cda44d26", "address": "fa:16:3e:c1:7a:84", "network": {"id": "6d30d7cf-8241-42c2-8618-d5531c996de7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1252938421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f289d1ed47534aeb867493f618d25e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4f351b4-1d", "ovs_interfaceid": "e4f351b4-1dd3-4d2b-ae56-dd96cda44d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:7a:84,bridge_name='br-int',has_traffic_filtering=True,id=e4f351b4-1dd3-4d2b-ae56-dd96cda44d26,network=Network(6d30d7cf-8241-42c2-8618-d5531c996de7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4f351b4-1d') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG os_vif [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:7a:84,bridge_name='br-int',has_traffic_filtering=True,id=e4f351b4-1dd3-4d2b-ae56-dd96cda44d26,network=Network(6d30d7cf-8241-42c2-8618-d5531c996de7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4f351b4-1d') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4f351b4-1d, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape4f351b4-1d, col_values=(('external_ids', {'iface-id': 'e4f351b4-1dd3-4d2b-ae56-dd96cda44d26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:7a:84', 'vm-uuid': '1c48c0d4-7d10-4086-b30f-61e71f358622'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:49 user nova-compute[73484]: INFO os_vif [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:7a:84,bridge_name='br-int',has_traffic_filtering=True,id=e4f351b4-1dd3-4d2b-ae56-dd96cda44d26,network=Network(6d30d7cf-8241-42c2-8618-d5531c996de7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4f351b4-1d')
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] No VIF found with MAC fa:16:3e:c1:7a:84, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.compute.manager [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Received event network-vif-plugged-3ef63421-a4aa-4126-b8ee-c141b2ef10cb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] Acquiring lock "8220a084-e402-435a-b6a7-ffd94f91a211-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] Lock "8220a084-e402-435a-b6a7-ffd94f91a211-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] Lock "8220a084-e402-435a-b6a7-ffd94f91a211-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.compute.manager [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] No waiting events found dispatching network-vif-plugged-3ef63421-a4aa-4126-b8ee-c141b2ef10cb {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:41:49 user nova-compute[73484]: WARNING nova.compute.manager [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Received unexpected event network-vif-plugged-3ef63421-a4aa-4126-b8ee-c141b2ef10cb for instance with vm_state active and task_state None.
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.compute.manager [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Received event network-changed-e4f351b4-1dd3-4d2b-ae56-dd96cda44d26 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.compute.manager [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Refreshing instance network info cache due to event network-changed-e4f351b4-1dd3-4d2b-ae56-dd96cda44d26. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] Acquiring lock "refresh_cache-1c48c0d4-7d10-4086-b30f-61e71f358622" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] Acquired lock "refresh_cache-1c48c0d4-7d10-4086-b30f-61e71f358622" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:41:49 user nova-compute[73484]: DEBUG nova.network.neutron [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Refreshing network info cache for port e4f351b4-1dd3-4d2b-ae56-dd96cda44d26 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:41:50 user nova-compute[73484]: DEBUG nova.network.neutron [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Updated VIF entry in instance network info cache for port e4f351b4-1dd3-4d2b-ae56-dd96cda44d26. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:41:50 user nova-compute[73484]: DEBUG nova.network.neutron [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Updating instance_info_cache with network_info: [{"id": "e4f351b4-1dd3-4d2b-ae56-dd96cda44d26", "address": "fa:16:3e:c1:7a:84", "network": {"id": "6d30d7cf-8241-42c2-8618-d5531c996de7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1252938421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f289d1ed47534aeb867493f618d25e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4f351b4-1d", "ovs_interfaceid": "e4f351b4-1dd3-4d2b-ae56-dd96cda44d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:41:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] Releasing lock "refresh_cache-1c48c0d4-7d10-4086-b30f-61e71f358622" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:41:50 user nova-compute[73484]: DEBUG nova.compute.manager [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Received event network-vif-plugged-3ef63421-a4aa-4126-b8ee-c141b2ef10cb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:41:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] Acquiring lock "8220a084-e402-435a-b6a7-ffd94f91a211-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] Lock "8220a084-e402-435a-b6a7-ffd94f91a211-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] Lock "8220a084-e402-435a-b6a7-ffd94f91a211-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:50 user nova-compute[73484]: DEBUG nova.compute.manager [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] No waiting events found dispatching network-vif-plugged-3ef63421-a4aa-4126-b8ee-c141b2ef10cb {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:41:50 user nova-compute[73484]: WARNING nova.compute.manager [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Received unexpected event network-vif-plugged-3ef63421-a4aa-4126-b8ee-c141b2ef10cb for instance with vm_state active and task_state None.
Aug 14 13:41:50 user nova-compute[73484]: DEBUG nova.compute.manager [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Received event network-vif-plugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:41:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] Acquiring lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:50 user nova-compute[73484]: DEBUG nova.compute.manager [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] No waiting events found dispatching network-vif-plugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:41:50 user nova-compute[73484]: WARNING nova.compute.manager [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Received unexpected event network-vif-plugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 for instance with vm_state rescued and task_state None.
Aug 14 13:41:50 user nova-compute[73484]: DEBUG nova.compute.manager [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Received event network-vif-plugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:41:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] Acquiring lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:50 user nova-compute[73484]: DEBUG nova.compute.manager [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] No waiting events found dispatching network-vif-plugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:41:50 user nova-compute[73484]: WARNING nova.compute.manager [req-8817d03f-dee4-435f-a799-864cdfae3e29 req-1c7dcac1-0d68-4823-a718-da8bd681e262 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Received unexpected event network-vif-plugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 for instance with vm_state rescued and task_state None.
Aug 14 13:41:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:52 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:53 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020513.0606635, 1c48c0d4-7d10-4086-b30f-61e71f358622 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:41:53 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] VM Resumed (Lifecycle Event)
Aug 14 13:41:53 user nova-compute[73484]: DEBUG nova.compute.manager [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:41:53 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:41:53 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Instance spawned successfully.
Aug 14 13:41:53 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:41:53 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:41:53 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:41:53 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:41:53 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:41:53 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:41:53 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:41:53 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:41:53 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:41:53 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:41:53 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020513.060943, 1c48c0d4-7d10-4086-b30f-61e71f358622 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:41:53 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] VM Started (Lifecycle Event)
Aug 14 13:41:53 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:41:53 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:41:53 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:41:53 user nova-compute[73484]: INFO nova.compute.manager [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Took 8.91 seconds to spawn the instance on the hypervisor.
Aug 14 13:41:53 user nova-compute[73484]: DEBUG nova.compute.manager [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:41:53 user nova-compute[73484]: INFO nova.compute.manager [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Took 9.95 seconds to build instance.
Aug 14 13:41:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-51220f95-f748-479d-a5f9-c0fdc58685fe tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Lock "1c48c0d4-7d10-4086-b30f-61e71f358622" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.073s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:54 user nova-compute[73484]: DEBUG nova.compute.manager [req-b750431d-e403-40d7-89c3-89dd5f375905 req-0c34c612-8f25-4427-ade7-bf4fa3f5e105 service nova] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Received event network-vif-plugged-e4f351b4-1dd3-4d2b-ae56-dd96cda44d26 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:41:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b750431d-e403-40d7-89c3-89dd5f375905 req-0c34c612-8f25-4427-ade7-bf4fa3f5e105 service nova] Acquiring lock "1c48c0d4-7d10-4086-b30f-61e71f358622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b750431d-e403-40d7-89c3-89dd5f375905 req-0c34c612-8f25-4427-ade7-bf4fa3f5e105 service nova] Lock "1c48c0d4-7d10-4086-b30f-61e71f358622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b750431d-e403-40d7-89c3-89dd5f375905 req-0c34c612-8f25-4427-ade7-bf4fa3f5e105 service nova] Lock "1c48c0d4-7d10-4086-b30f-61e71f358622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:54 user nova-compute[73484]: DEBUG nova.compute.manager [req-b750431d-e403-40d7-89c3-89dd5f375905 req-0c34c612-8f25-4427-ade7-bf4fa3f5e105 service nova] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] No waiting events found dispatching network-vif-plugged-e4f351b4-1dd3-4d2b-ae56-dd96cda44d26 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:41:54 user nova-compute[73484]: WARNING nova.compute.manager [req-b750431d-e403-40d7-89c3-89dd5f375905 req-0c34c612-8f25-4427-ade7-bf4fa3f5e105 service nova] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Received unexpected event network-vif-plugged-e4f351b4-1dd3-4d2b-ae56-dd96cda44d26 for instance with vm_state active and task_state None.
Aug 14 13:41:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:56 user nova-compute[73484]: DEBUG nova.compute.manager [req-3e839d6e-9537-4273-9db4-5bc3ea1f9580 req-fda0a466-a050-4b48-808a-73ba84b4f1d5 service nova] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Received event network-vif-plugged-e4f351b4-1dd3-4d2b-ae56-dd96cda44d26 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:41:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3e839d6e-9537-4273-9db4-5bc3ea1f9580 req-fda0a466-a050-4b48-808a-73ba84b4f1d5 service nova] Acquiring lock "1c48c0d4-7d10-4086-b30f-61e71f358622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:41:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3e839d6e-9537-4273-9db4-5bc3ea1f9580 req-fda0a466-a050-4b48-808a-73ba84b4f1d5 service nova] Lock "1c48c0d4-7d10-4086-b30f-61e71f358622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:41:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3e839d6e-9537-4273-9db4-5bc3ea1f9580 req-fda0a466-a050-4b48-808a-73ba84b4f1d5 service nova] Lock "1c48c0d4-7d10-4086-b30f-61e71f358622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:41:56 user nova-compute[73484]: DEBUG nova.compute.manager [req-3e839d6e-9537-4273-9db4-5bc3ea1f9580 req-fda0a466-a050-4b48-808a-73ba84b4f1d5 service nova] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] No waiting events found dispatching network-vif-plugged-e4f351b4-1dd3-4d2b-ae56-dd96cda44d26 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:41:56 user nova-compute[73484]: WARNING nova.compute.manager [req-3e839d6e-9537-4273-9db4-5bc3ea1f9580 req-fda0a466-a050-4b48-808a-73ba84b4f1d5 service nova] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Received unexpected event network-vif-plugged-e4f351b4-1dd3-4d2b-ae56-dd96cda44d26 for instance with vm_state active and task_state None.
Aug 14 13:41:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:41:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:00 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692020505.5421479, 856807c9-af22-4be7-834e-2d7003329f8c => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:42:00 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] VM Stopped (Lifecycle Event)
Aug 14 13:42:00 user nova-compute[73484]: DEBUG nova.compute.manager [None req-c98c87fd-2131-4754-bb16-028dfc72fd62 None None] [instance: 856807c9-af22-4be7-834e-2d7003329f8c] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:42:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:08 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-4f4da793-592e-49bc-a3bf-b6d1473275b4 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Acquiring lock "20d01b50-8888-4def-a617-5b4e77a45837" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-4f4da793-592e-49bc-a3bf-b6d1473275b4 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "20d01b50-8888-4def-a617-5b4e77a45837" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-4f4da793-592e-49bc-a3bf-b6d1473275b4 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Acquiring lock "20d01b50-8888-4def-a617-5b4e77a45837-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-4f4da793-592e-49bc-a3bf-b6d1473275b4 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "20d01b50-8888-4def-a617-5b4e77a45837-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-4f4da793-592e-49bc-a3bf-b6d1473275b4 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "20d01b50-8888-4def-a617-5b4e77a45837-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:22 user nova-compute[73484]: INFO nova.compute.manager [None req-4f4da793-592e-49bc-a3bf-b6d1473275b4 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Terminating instance
Aug 14 13:42:22 user nova-compute[73484]: DEBUG nova.compute.manager [None req-4f4da793-592e-49bc-a3bf-b6d1473275b4 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:42:22 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:22 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:22 user nova-compute[73484]: DEBUG nova.compute.manager [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:42:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:22 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:42:22 user nova-compute[73484]: INFO nova.compute.claims [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Claim successful on node user
Aug 14 13:42:22 user nova-compute[73484]: DEBUG nova.compute.manager [req-e14b0672-ff6f-4bde-b468-0c01078b6400 req-1f0cd88f-ae8b-4a79-bc6e-c67219e2b3c2 service nova] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Received event network-vif-unplugged-ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:42:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e14b0672-ff6f-4bde-b468-0c01078b6400 req-1f0cd88f-ae8b-4a79-bc6e-c67219e2b3c2 service nova] Acquiring lock "20d01b50-8888-4def-a617-5b4e77a45837-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e14b0672-ff6f-4bde-b468-0c01078b6400 req-1f0cd88f-ae8b-4a79-bc6e-c67219e2b3c2 service nova] Lock "20d01b50-8888-4def-a617-5b4e77a45837-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e14b0672-ff6f-4bde-b468-0c01078b6400 req-1f0cd88f-ae8b-4a79-bc6e-c67219e2b3c2 service nova] Lock "20d01b50-8888-4def-a617-5b4e77a45837-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:22 user nova-compute[73484]: DEBUG nova.compute.manager [req-e14b0672-ff6f-4bde-b468-0c01078b6400 req-1f0cd88f-ae8b-4a79-bc6e-c67219e2b3c2 service nova] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] No waiting events found dispatching network-vif-unplugged-ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:42:22 user nova-compute[73484]: DEBUG nova.compute.manager [req-e14b0672-ff6f-4bde-b468-0c01078b6400 req-1f0cd88f-ae8b-4a79-bc6e-c67219e2b3c2 service nova] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Received event network-vif-unplugged-ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:42:22 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:22 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:23 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Instance destroyed successfully.
Aug 14 13:42:23 user nova-compute[73484]: DEBUG nova.objects.instance [None req-4f4da793-592e-49bc-a3bf-b6d1473275b4 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lazy-loading 'resources' on Instance uuid 20d01b50-8888-4def-a617-5b4e77a45837 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-4f4da793-592e-49bc-a3bf-b6d1473275b4 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2129585793',display_name='tempest-VolumesAdminNegativeTest-server-2129585793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2129585793',id=14,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:40:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a95ec66f3424934bdff0335e262cc9e',ramdisk_id='',reservation_id='r-3bl1mn1n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-730276289',owner_user_name='tempest-VolumesAdminNegativeTest-730276289-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:40:28Z,user_data=None,user_id='6d89860cdc284bc898c650b2a6fc3a2a',uuid=20d01b50-8888-4def-a617-5b4e77a45837,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be", "address": "fa:16:3e:c8:81:2b", "network": {"id": "988c9059-476e-4558-8e68-3cfe68a53a09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1683768593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a95ec66f3424934bdff0335e262cc9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee6fbdc8-24", "ovs_interfaceid": "ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-4f4da793-592e-49bc-a3bf-b6d1473275b4 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Converting VIF {"id": "ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be", "address": "fa:16:3e:c8:81:2b", "network": {"id": "988c9059-476e-4558-8e68-3cfe68a53a09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1683768593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a95ec66f3424934bdff0335e262cc9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee6fbdc8-24", "ovs_interfaceid": "ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-4f4da793-592e-49bc-a3bf-b6d1473275b4 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:81:2b,bridge_name='br-int',has_traffic_filtering=True,id=ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be,network=Network(988c9059-476e-4558-8e68-3cfe68a53a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee6fbdc8-24') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG os_vif [None req-4f4da793-592e-49bc-a3bf-b6d1473275b4 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:81:2b,bridge_name='br-int',has_traffic_filtering=True,id=ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be,network=Network(988c9059-476e-4558-8e68-3cfe68a53a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee6fbdc8-24') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee6fbdc8-24, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:42:23 user nova-compute[73484]: INFO os_vif [None req-4f4da793-592e-49bc-a3bf-b6d1473275b4 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:81:2b,bridge_name='br-int',has_traffic_filtering=True,id=ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be,network=Network(988c9059-476e-4558-8e68-3cfe68a53a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee6fbdc8-24')
Aug 14 13:42:23 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-4f4da793-592e-49bc-a3bf-b6d1473275b4 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Deleting instance files /opt/stack/data/nova/instances/20d01b50-8888-4def-a617-5b4e77a45837_del
Aug 14 13:42:23 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-4f4da793-592e-49bc-a3bf-b6d1473275b4 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Deletion of /opt/stack/data/nova/instances/20d01b50-8888-4def-a617-5b4e77a45837_del complete
Aug 14 13:42:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.577s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG nova.compute.manager [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:42:23 user nova-compute[73484]: INFO nova.compute.manager [None req-4f4da793-592e-49bc-a3bf-b6d1473275b4 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 14 13:42:23 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-4f4da793-592e-49bc-a3bf-b6d1473275b4 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG nova.compute.manager [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG nova.network.neutron [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:42:23 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:42:23 user nova-compute[73484]: DEBUG nova.compute.manager [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:42:23 user nova-compute[73484]: INFO nova.virt.block_device [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Booting with volume 044c4ce7-3e17-43b4-8d37-7d9b371bad8a at /dev/vda
Aug 14 13:42:23 user nova-compute[73484]: DEBUG os_brick.utils [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[510c040a-294d-42fa-9d2d-44b5b0a90ec9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[29aab230-3a44-41aa-82ce-3e8326e445ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[af89add6-d70a-4b12-9e8f-372c15c5911f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1efc55-2054-4be3-8610-1d81f3892b03]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:42:23 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:42:23 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f9d787-c8f4-405d-8cdd-713d52f5f349]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG os_brick.utils [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Updating existing volume attachment record: 9d888231-e1bf-47af-9aa4-2cf3add9fa79 {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:24 user nova-compute[73484]: DEBUG nova.policy [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '729ad05102d7403e8aaa34a6c17f1a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8d4635233ed41bca48d5dc2a709b076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:42:24 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:42:24 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Took 1.34 seconds to deallocate network for instance.
Aug 14 13:42:24 user nova-compute[73484]: DEBUG nova.compute.manager [req-49a9d1e2-66fc-4986-a1c2-5d014febf57f req-90daf75e-f363-4685-bdf7-302fec9192af service nova] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Received event network-vif-deleted-ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:42:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-4f4da793-592e-49bc-a3bf-b6d1473275b4 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-4f4da793-592e-49bc-a3bf-b6d1473275b4 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:24 user nova-compute[73484]: DEBUG nova.compute.manager [req-9f28c4f8-72ed-4eba-9f56-ebc49ac2ac12 req-5c7b77c0-93ff-453f-bbea-e59232b5bad0 service nova] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Received event network-vif-plugged-ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:42:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-9f28c4f8-72ed-4eba-9f56-ebc49ac2ac12 req-5c7b77c0-93ff-453f-bbea-e59232b5bad0 service nova] Acquiring lock "20d01b50-8888-4def-a617-5b4e77a45837-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-9f28c4f8-72ed-4eba-9f56-ebc49ac2ac12 req-5c7b77c0-93ff-453f-bbea-e59232b5bad0 service nova] Lock "20d01b50-8888-4def-a617-5b4e77a45837-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-9f28c4f8-72ed-4eba-9f56-ebc49ac2ac12 req-5c7b77c0-93ff-453f-bbea-e59232b5bad0 service nova] Lock "20d01b50-8888-4def-a617-5b4e77a45837-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:24 user nova-compute[73484]: DEBUG nova.compute.manager [req-9f28c4f8-72ed-4eba-9f56-ebc49ac2ac12 req-5c7b77c0-93ff-453f-bbea-e59232b5bad0 service nova] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] No waiting events found dispatching network-vif-plugged-ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:42:24 user nova-compute[73484]: WARNING nova.compute.manager [req-9f28c4f8-72ed-4eba-9f56-ebc49ac2ac12 req-5c7b77c0-93ff-453f-bbea-e59232b5bad0 service nova] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Received unexpected event network-vif-plugged-ee6fbdc8-24ff-47b4-8f05-9f5c758ad6be for instance with vm_state deleted and task_state None.
Aug 14 13:42:25 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-4f4da793-592e-49bc-a3bf-b6d1473275b4 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:42:25 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-4f4da793-592e-49bc-a3bf-b6d1473275b4 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:42:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-4f4da793-592e-49bc-a3bf-b6d1473275b4 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.544s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:25 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-4f4da793-592e-49bc-a3bf-b6d1473275b4 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Deleted allocations for instance 20d01b50-8888-4def-a617-5b4e77a45837
Aug 14 13:42:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-4f4da793-592e-49bc-a3bf-b6d1473275b4 tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "20d01b50-8888-4def-a617-5b4e77a45837" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.036s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:25 user nova-compute[73484]: DEBUG nova.network.neutron [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Successfully created port: ec36c6e8-45d2-469b-b874-e9d3a10314f9 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:42:26 user nova-compute[73484]: DEBUG nova.network.neutron [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Successfully created port: e1ddd484-97b4-4cfe-be1e-a3be0128bfdb {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:42:27 user nova-compute[73484]: DEBUG nova.network.neutron [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Successfully created port: f8f67d05-60f1-4a23-afdb-f26e4d8976ed {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:42:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquiring lock "09ba29fd-8161-485c-ba6d-71d24ab086bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:27 user nova-compute[73484]: DEBUG nova.compute.manager [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:42:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:27 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:42:27 user nova-compute[73484]: INFO nova.compute.claims [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Claim successful on node user
Aug 14 13:42:27 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:42:27 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:42:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:27 user nova-compute[73484]: DEBUG nova.compute.manager [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:42:27 user nova-compute[73484]: DEBUG nova.compute.manager [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:42:27 user nova-compute[73484]: DEBUG nova.network.neutron [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:42:27 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:42:28 user nova-compute[73484]: DEBUG nova.policy [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55e77cc182bc4ec79429025c6a9f14af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07a8a61d3f14061b44b8f37968c54e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:42:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:42:28 user nova-compute[73484]: DEBUG nova.network.neutron [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Successfully created port: b192f20f-10a5-4370-8e81-4a6faa679942 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:42:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:42:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:42:28 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Creating image(s)
Aug 14 13:42:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquiring lock "/opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "/opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "/opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:28 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:28 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.188s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:28 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:28 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.178s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:28 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:28 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk 1073741824" returned: 0 in 0.049s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:28 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:28 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:42:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73484) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 13:42:28 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.175s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:28 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Checking if we can resize image /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:42:28 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:29 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Cannot resize image /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:42:29 user nova-compute[73484]: DEBUG nova.objects.instance [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lazy-loading 'migration_context' on Instance uuid 09ba29fd-8161-485c-ba6d-71d24ab086bc {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:42:29 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:42:29 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Ensure instance console log exists: /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:42:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:29 user nova-compute[73484]: DEBUG nova.network.neutron [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Successfully created port: 0b54646a-71ed-4087-adf7-66645e7d2907 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:42:29 user nova-compute[73484]: DEBUG nova.network.neutron [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Successfully created port: da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.network.neutron [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Successfully updated port: 0b54646a-71ed-4087-adf7-66645e7d2907 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.network.neutron [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Successfully updated port: ec36c6e8-45d2-469b-b874-e9d3a10314f9 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquiring lock "refresh_cache-09ba29fd-8161-485c-ba6d-71d24ab086bc" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquired lock "refresh_cache-09ba29fd-8161-485c-ba6d-71d24ab086bc" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.network.neutron [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.compute.manager [req-1c54b8fb-4620-4355-a7d7-9782abc52951 req-b419b8ce-c7cb-4233-859e-7e1a55947b36 service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Received event network-changed-0b54646a-71ed-4087-adf7-66645e7d2907 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.compute.manager [req-1c54b8fb-4620-4355-a7d7-9782abc52951 req-b419b8ce-c7cb-4233-859e-7e1a55947b36 service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Refreshing instance network info cache due to event network-changed-0b54646a-71ed-4087-adf7-66645e7d2907. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1c54b8fb-4620-4355-a7d7-9782abc52951 req-b419b8ce-c7cb-4233-859e-7e1a55947b36 service nova] Acquiring lock "refresh_cache-09ba29fd-8161-485c-ba6d-71d24ab086bc" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.network.neutron [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.network.neutron [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Updating instance_info_cache with network_info: [{"id": "0b54646a-71ed-4087-adf7-66645e7d2907", "address": "fa:16:3e:30:6a:b2", "network": {"id": "a417bb93-b1ed-47a4-be83-6679c2ea34b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872770450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07a8a61d3f14061b44b8f37968c54e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b54646a-71", "ovs_interfaceid": "0b54646a-71ed-4087-adf7-66645e7d2907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Releasing lock "refresh_cache-09ba29fd-8161-485c-ba6d-71d24ab086bc" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.compute.manager [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Instance network_info: |[{"id": "0b54646a-71ed-4087-adf7-66645e7d2907", "address": "fa:16:3e:30:6a:b2", "network": {"id": "a417bb93-b1ed-47a4-be83-6679c2ea34b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872770450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07a8a61d3f14061b44b8f37968c54e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b54646a-71", "ovs_interfaceid": "0b54646a-71ed-4087-adf7-66645e7d2907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1c54b8fb-4620-4355-a7d7-9782abc52951 req-b419b8ce-c7cb-4233-859e-7e1a55947b36 service nova] Acquired lock "refresh_cache-09ba29fd-8161-485c-ba6d-71d24ab086bc" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.network.neutron [req-1c54b8fb-4620-4355-a7d7-9782abc52951 req-b419b8ce-c7cb-4233-859e-7e1a55947b36 service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Refreshing network info cache for port 0b54646a-71ed-4087-adf7-66645e7d2907 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Start _get_guest_xml network_info=[{"id": "0b54646a-71ed-4087-adf7-66645e7d2907", "address": "fa:16:3e:30:6a:b2", "network": {"id": "a417bb93-b1ed-47a4-be83-6679c2ea34b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872770450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07a8a61d3f14061b44b8f37968c54e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b54646a-71", "ovs_interfaceid": "0b54646a-71ed-4087-adf7-66645e7d2907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:42:31 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:42:31 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:42:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1361765687',display_name='tempest-ServerActionsTestOtherB-server-1361765687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1361765687',id=20,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF57s7WDcr5LrA3gfxfpgDNJt6UZ/rZhkiS+Nfi/DIO/C85ZFU7Y17ny/O/CEqdXEP2/mm1AA46PPquOjl5qC1/2wZc0eZa1Tjpvt/2IPyALMO4YPxf1Hkqx4YMdA9qx2g==',key_name='tempest-keypair-345523160',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a07a8a61d3f14061b44b8f37968c54e9',ramdisk_id='',reservation_id='r-b3zcr056',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1221611824',owner_user_name='tempest-ServerActionsTestOtherB-1221611824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:42:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55e77cc182bc4ec79429025c6a9f14af',uuid=09ba29fd-8161-485c-ba6d-71d24ab086bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b54646a-71ed-4087-adf7-66645e7d2907", "address": "fa:16:3e:30:6a:b2", "network": {"id": "a417bb93-b1ed-47a4-be83-6679c2ea34b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872770450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07a8a61d3f14061b44b8f37968c54e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b54646a-71", "ovs_interfaceid": "0b54646a-71ed-4087-adf7-66645e7d2907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Converting VIF {"id": "0b54646a-71ed-4087-adf7-66645e7d2907", "address": "fa:16:3e:30:6a:b2", "network": {"id": "a417bb93-b1ed-47a4-be83-6679c2ea34b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872770450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07a8a61d3f14061b44b8f37968c54e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b54646a-71", "ovs_interfaceid": "0b54646a-71ed-4087-adf7-66645e7d2907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:6a:b2,bridge_name='br-int',has_traffic_filtering=True,id=0b54646a-71ed-4087-adf7-66645e7d2907,network=Network(a417bb93-b1ed-47a4-be83-6679c2ea34b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b54646a-71') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.objects.instance [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lazy-loading 'pci_devices' on Instance uuid 09ba29fd-8161-485c-ba6d-71d24ab086bc {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:42:31 user nova-compute[73484]:   <uuid>09ba29fd-8161-485c-ba6d-71d24ab086bc</uuid>
Aug 14 13:42:31 user nova-compute[73484]:   <name>instance-00000014</name>
Aug 14 13:42:31 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:42:31 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:42:31 user nova-compute[73484]:   <metadata>
Aug 14 13:42:31 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:42:31 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:42:31 user nova-compute[73484]:       <nova:name>tempest-ServerActionsTestOtherB-server-1361765687</nova:name>
Aug 14 13:42:31 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:42:31</nova:creationTime>
Aug 14 13:42:31 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:42:31 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:42:31 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:42:31 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:42:31 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:42:31 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:42:31 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:42:31 user nova-compute[73484]:       <nova:owner>
Aug 14 13:42:31 user nova-compute[73484]:         <nova:user uuid="55e77cc182bc4ec79429025c6a9f14af">tempest-ServerActionsTestOtherB-1221611824-project-member</nova:user>
Aug 14 13:42:31 user nova-compute[73484]:         <nova:project uuid="a07a8a61d3f14061b44b8f37968c54e9">tempest-ServerActionsTestOtherB-1221611824</nova:project>
Aug 14 13:42:31 user nova-compute[73484]:       </nova:owner>
Aug 14 13:42:31 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:42:31 user nova-compute[73484]:       <nova:ports>
Aug 14 13:42:31 user nova-compute[73484]:         <nova:port uuid="0b54646a-71ed-4087-adf7-66645e7d2907">
Aug 14 13:42:31 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 13:42:31 user nova-compute[73484]:         </nova:port>
Aug 14 13:42:31 user nova-compute[73484]:       </nova:ports>
Aug 14 13:42:31 user nova-compute[73484]:     </nova:instance>
Aug 14 13:42:31 user nova-compute[73484]:   </metadata>
Aug 14 13:42:31 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:42:31 user nova-compute[73484]:     <system>
Aug 14 13:42:31 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:42:31 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:42:31 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:42:31 user nova-compute[73484]:       <entry name="serial">09ba29fd-8161-485c-ba6d-71d24ab086bc</entry>
Aug 14 13:42:31 user nova-compute[73484]:       <entry name="uuid">09ba29fd-8161-485c-ba6d-71d24ab086bc</entry>
Aug 14 13:42:31 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:42:31 user nova-compute[73484]:     </system>
Aug 14 13:42:31 user nova-compute[73484]:   </sysinfo>
Aug 14 13:42:31 user nova-compute[73484]:   <os>
Aug 14 13:42:31 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:42:31 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:42:31 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:42:31 user nova-compute[73484]:   </os>
Aug 14 13:42:31 user nova-compute[73484]:   <features>
Aug 14 13:42:31 user nova-compute[73484]:     <acpi/>
Aug 14 13:42:31 user nova-compute[73484]:     <apic/>
Aug 14 13:42:31 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:42:31 user nova-compute[73484]:   </features>
Aug 14 13:42:31 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:42:31 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:42:31 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:42:31 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:42:31 user nova-compute[73484]:   </clock>
Aug 14 13:42:31 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:42:31 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:42:31 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:42:31 user nova-compute[73484]:   </cpu>
Aug 14 13:42:31 user nova-compute[73484]:   <devices>
Aug 14 13:42:31 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:42:31 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:42:31 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk"/>
Aug 14 13:42:31 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:42:31 user nova-compute[73484]:     </disk>
Aug 14 13:42:31 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:42:31 user nova-compute[73484]:       <mac address="fa:16:3e:30:6a:b2"/>
Aug 14 13:42:31 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:42:31 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:42:31 user nova-compute[73484]:       <target dev="tap0b54646a-71"/>
Aug 14 13:42:31 user nova-compute[73484]:     </interface>
Aug 14 13:42:31 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:42:31 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/console.log" append="off"/>
Aug 14 13:42:31 user nova-compute[73484]:     </serial>
Aug 14 13:42:31 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:42:31 user nova-compute[73484]:     <video>
Aug 14 13:42:31 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:42:31 user nova-compute[73484]:     </video>
Aug 14 13:42:31 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:42:31 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:42:31 user nova-compute[73484]:     </rng>
Aug 14 13:42:31 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:42:31 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:42:31 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:42:31 user nova-compute[73484]:     </memballoon>
Aug 14 13:42:31 user nova-compute[73484]:   </devices>
Aug 14 13:42:31 user nova-compute[73484]: </domain>
Aug 14 13:42:31 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:42:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1361765687',display_name='tempest-ServerActionsTestOtherB-server-1361765687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1361765687',id=20,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF57s7WDcr5LrA3gfxfpgDNJt6UZ/rZhkiS+Nfi/DIO/C85ZFU7Y17ny/O/CEqdXEP2/mm1AA46PPquOjl5qC1/2wZc0eZa1Tjpvt/2IPyALMO4YPxf1Hkqx4YMdA9qx2g==',key_name='tempest-keypair-345523160',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a07a8a61d3f14061b44b8f37968c54e9',ramdisk_id='',reservation_id='r-b3zcr056',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1221611824',owner_user_name='tempest-ServerActionsTestOtherB-1221611824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:42:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55e77cc182bc4ec79429025c6a9f14af',uuid=09ba29fd-8161-485c-ba6d-71d24ab086bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b54646a-71ed-4087-adf7-66645e7d2907", "address": "fa:16:3e:30:6a:b2", "network": {"id": "a417bb93-b1ed-47a4-be83-6679c2ea34b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872770450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07a8a61d3f14061b44b8f37968c54e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b54646a-71", "ovs_interfaceid": "0b54646a-71ed-4087-adf7-66645e7d2907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Converting VIF {"id": "0b54646a-71ed-4087-adf7-66645e7d2907", "address": "fa:16:3e:30:6a:b2", "network": {"id": "a417bb93-b1ed-47a4-be83-6679c2ea34b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872770450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07a8a61d3f14061b44b8f37968c54e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b54646a-71", "ovs_interfaceid": "0b54646a-71ed-4087-adf7-66645e7d2907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:6a:b2,bridge_name='br-int',has_traffic_filtering=True,id=0b54646a-71ed-4087-adf7-66645e7d2907,network=Network(a417bb93-b1ed-47a4-be83-6679c2ea34b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b54646a-71') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG os_vif [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:6a:b2,bridge_name='br-int',has_traffic_filtering=True,id=0b54646a-71ed-4087-adf7-66645e7d2907,network=Network(a417bb93-b1ed-47a4-be83-6679c2ea34b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b54646a-71') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b54646a-71, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0b54646a-71, col_values=(('external_ids', {'iface-id': '0b54646a-71ed-4087-adf7-66645e7d2907', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:6a:b2', 'vm-uuid': '09ba29fd-8161-485c-ba6d-71d24ab086bc'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:31 user nova-compute[73484]: INFO os_vif [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:6a:b2,bridge_name='br-int',has_traffic_filtering=True,id=0b54646a-71ed-4087-adf7-66645e7d2907,network=Network(a417bb93-b1ed-47a4-be83-6679c2ea34b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b54646a-71')
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:42:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] No VIF found with MAC fa:16:3e:30:6a:b2, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:42:32 user nova-compute[73484]: DEBUG nova.network.neutron [req-1c54b8fb-4620-4355-a7d7-9782abc52951 req-b419b8ce-c7cb-4233-859e-7e1a55947b36 service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Updated VIF entry in instance network info cache for port 0b54646a-71ed-4087-adf7-66645e7d2907. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:42:32 user nova-compute[73484]: DEBUG nova.network.neutron [req-1c54b8fb-4620-4355-a7d7-9782abc52951 req-b419b8ce-c7cb-4233-859e-7e1a55947b36 service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Updating instance_info_cache with network_info: [{"id": "0b54646a-71ed-4087-adf7-66645e7d2907", "address": "fa:16:3e:30:6a:b2", "network": {"id": "a417bb93-b1ed-47a4-be83-6679c2ea34b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872770450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07a8a61d3f14061b44b8f37968c54e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b54646a-71", "ovs_interfaceid": "0b54646a-71ed-4087-adf7-66645e7d2907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:42:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1c54b8fb-4620-4355-a7d7-9782abc52951 req-b419b8ce-c7cb-4233-859e-7e1a55947b36 service nova] Releasing lock "refresh_cache-09ba29fd-8161-485c-ba6d-71d24ab086bc" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:42:32 user nova-compute[73484]: DEBUG nova.network.neutron [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Successfully updated port: 5259f8bf-c556-4ac0-9587-1633b3cf47e4 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:42:32 user nova-compute[73484]: INFO nova.virt.block_device [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Booting with volume 67a997e7-86e6-47a2-b8f1-7f783c53f9d3 at /dev/vdb
Aug 14 13:42:32 user nova-compute[73484]: DEBUG os_brick.utils [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:42:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6ea51c-fac4-45e8-9af1-426a927c3728]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87be45d-ec12-4649-8d17-be9fe6b4a429]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5fd296-da12-4b76-8b71-dcfb8df05e05]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6deecd41-d42f-4988-9315-8d610068fb51]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:42:33 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:42:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46a6107-d7d8-4126-80a2-59d9b5217ffb]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG os_brick.utils [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Updating existing volume attachment record: 2d9d64a4-8782-448c-a1e9-b53c2b5d6a45 {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG nova.compute.manager [req-20f5af20-cce9-4a4c-b63b-294fb3b1e257 req-0c2e79e9-8beb-492f-9d25-51364b190659 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-changed-ec36c6e8-45d2-469b-b874-e9d3a10314f9 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG nova.compute.manager [req-20f5af20-cce9-4a4c-b63b-294fb3b1e257 req-0c2e79e9-8beb-492f-9d25-51364b190659 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Refreshing instance network info cache due to event network-changed-ec36c6e8-45d2-469b-b874-e9d3a10314f9. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-20f5af20-cce9-4a4c-b63b-294fb3b1e257 req-0c2e79e9-8beb-492f-9d25-51364b190659 service nova] Acquiring lock "refresh_cache-8a3b8885-1940-4a92-82f4-c65c84bbf11e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-20f5af20-cce9-4a4c-b63b-294fb3b1e257 req-0c2e79e9-8beb-492f-9d25-51364b190659 service nova] Acquired lock "refresh_cache-8a3b8885-1940-4a92-82f4-c65c84bbf11e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG nova.network.neutron [req-20f5af20-cce9-4a4c-b63b-294fb3b1e257 req-0c2e79e9-8beb-492f-9d25-51364b190659 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Refreshing network info cache for port ec36c6e8-45d2-469b-b874-e9d3a10314f9 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG nova.network.neutron [req-20f5af20-cce9-4a4c-b63b-294fb3b1e257 req-0c2e79e9-8beb-492f-9d25-51364b190659 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG nova.network.neutron [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Successfully updated port: 45079f89-4586-4c56-824b-cf112200e102 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Rebuilding the list of instances to heal {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG nova.network.neutron [req-20f5af20-cce9-4a4c-b63b-294fb3b1e257 req-0c2e79e9-8beb-492f-9d25-51364b190659 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-20f5af20-cce9-4a4c-b63b-294fb3b1e257 req-0c2e79e9-8beb-492f-9d25-51364b190659 service nova] Releasing lock "refresh_cache-8a3b8885-1940-4a92-82f4-c65c84bbf11e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG nova.compute.manager [req-20f5af20-cce9-4a4c-b63b-294fb3b1e257 req-0c2e79e9-8beb-492f-9d25-51364b190659 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-changed-5259f8bf-c556-4ac0-9587-1633b3cf47e4 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG nova.compute.manager [req-20f5af20-cce9-4a4c-b63b-294fb3b1e257 req-0c2e79e9-8beb-492f-9d25-51364b190659 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Refreshing instance network info cache due to event network-changed-5259f8bf-c556-4ac0-9587-1633b3cf47e4. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-20f5af20-cce9-4a4c-b63b-294fb3b1e257 req-0c2e79e9-8beb-492f-9d25-51364b190659 service nova] Acquiring lock "refresh_cache-8a3b8885-1940-4a92-82f4-c65c84bbf11e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-20f5af20-cce9-4a4c-b63b-294fb3b1e257 req-0c2e79e9-8beb-492f-9d25-51364b190659 service nova] Acquired lock "refresh_cache-8a3b8885-1940-4a92-82f4-c65c84bbf11e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG nova.network.neutron [req-20f5af20-cce9-4a4c-b63b-294fb3b1e257 req-0c2e79e9-8beb-492f-9d25-51364b190659 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Refreshing network info cache for port 5259f8bf-c556-4ac0-9587-1633b3cf47e4 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Skipping network cache update for instance because it is Building. {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 14 13:42:33 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Skipping network cache update for instance because it is Building. {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 14 13:42:34 user nova-compute[73484]: DEBUG nova.network.neutron [req-20f5af20-cce9-4a4c-b63b-294fb3b1e257 req-0c2e79e9-8beb-492f-9d25-51364b190659 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:42:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-f4f7788c-fcca-47c1-b5b8-72892253982d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:42:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-f4f7788c-fcca-47c1-b5b8-72892253982d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:42:34 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 13:42:34 user nova-compute[73484]: DEBUG nova.objects.instance [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lazy-loading 'info_cache' on Instance uuid f4f7788c-fcca-47c1-b5b8-72892253982d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:42:34 user nova-compute[73484]: DEBUG nova.network.neutron [req-20f5af20-cce9-4a4c-b63b-294fb3b1e257 req-0c2e79e9-8beb-492f-9d25-51364b190659 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:42:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-20f5af20-cce9-4a4c-b63b-294fb3b1e257 req-0c2e79e9-8beb-492f-9d25-51364b190659 service nova] Releasing lock "refresh_cache-8a3b8885-1940-4a92-82f4-c65c84bbf11e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020555.2690122, 09ba29fd-8161-485c-ba6d-71d24ab086bc => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:42:35 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] VM Resumed (Lifecycle Event)
Aug 14 13:42:35 user nova-compute[73484]: DEBUG nova.compute.manager [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:42:35 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Instance spawned successfully.
Aug 14 13:42:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG nova.compute.manager [req-028488bb-eca6-4abf-8f3d-67149fe881b1 req-124a1eed-608d-43c3-87d0-ef6441fe35eb service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Received event network-vif-plugged-0b54646a-71ed-4087-adf7-66645e7d2907 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-028488bb-eca6-4abf-8f3d-67149fe881b1 req-124a1eed-608d-43c3-87d0-ef6441fe35eb service nova] Acquiring lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-028488bb-eca6-4abf-8f3d-67149fe881b1 req-124a1eed-608d-43c3-87d0-ef6441fe35eb service nova] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-028488bb-eca6-4abf-8f3d-67149fe881b1 req-124a1eed-608d-43c3-87d0-ef6441fe35eb service nova] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG nova.compute.manager [req-028488bb-eca6-4abf-8f3d-67149fe881b1 req-124a1eed-608d-43c3-87d0-ef6441fe35eb service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] No waiting events found dispatching network-vif-plugged-0b54646a-71ed-4087-adf7-66645e7d2907 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:42:35 user nova-compute[73484]: WARNING nova.compute.manager [req-028488bb-eca6-4abf-8f3d-67149fe881b1 req-124a1eed-608d-43c3-87d0-ef6441fe35eb service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Received unexpected event network-vif-plugged-0b54646a-71ed-4087-adf7-66645e7d2907 for instance with vm_state building and task_state spawning.
Aug 14 13:42:35 user nova-compute[73484]: DEBUG nova.compute.manager [req-028488bb-eca6-4abf-8f3d-67149fe881b1 req-124a1eed-608d-43c3-87d0-ef6441fe35eb service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-changed-45079f89-4586-4c56-824b-cf112200e102 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG nova.compute.manager [req-028488bb-eca6-4abf-8f3d-67149fe881b1 req-124a1eed-608d-43c3-87d0-ef6441fe35eb service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Refreshing instance network info cache due to event network-changed-45079f89-4586-4c56-824b-cf112200e102. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-028488bb-eca6-4abf-8f3d-67149fe881b1 req-124a1eed-608d-43c3-87d0-ef6441fe35eb service nova] Acquiring lock "refresh_cache-8a3b8885-1940-4a92-82f4-c65c84bbf11e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-028488bb-eca6-4abf-8f3d-67149fe881b1 req-124a1eed-608d-43c3-87d0-ef6441fe35eb service nova] Acquired lock "refresh_cache-8a3b8885-1940-4a92-82f4-c65c84bbf11e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG nova.network.neutron [req-028488bb-eca6-4abf-8f3d-67149fe881b1 req-124a1eed-608d-43c3-87d0-ef6441fe35eb service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Refreshing network info cache for port 45079f89-4586-4c56-824b-cf112200e102 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:42:35 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:42:35 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020555.2712545, 09ba29fd-8161-485c-ba6d-71d24ab086bc => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:42:35 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] VM Started (Lifecycle Event)
Aug 14 13:42:35 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:42:35 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:42:35 user nova-compute[73484]: INFO nova.compute.manager [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Took 7.21 seconds to spawn the instance on the hypervisor.
Aug 14 13:42:35 user nova-compute[73484]: DEBUG nova.compute.manager [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:42:35 user nova-compute[73484]: INFO nova.compute.manager [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Took 8.25 seconds to build instance.
Aug 14 13:42:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1ddc6a6f-7a68-4d29-a22e-4f7a980c7585 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.354s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG nova.network.neutron [req-028488bb-eca6-4abf-8f3d-67149fe881b1 req-124a1eed-608d-43c3-87d0-ef6441fe35eb service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG nova.compute.manager [req-49be1044-704d-4ce1-b3c9-6ba5d011e06d req-33e04af6-79d2-4496-abfe-20616c369b85 service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Received event network-changed-cfbf4211-f3cb-49ad-98dd-68029d497e5f {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG nova.compute.manager [req-49be1044-704d-4ce1-b3c9-6ba5d011e06d req-33e04af6-79d2-4496-abfe-20616c369b85 service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Refreshing instance network info cache due to event network-changed-cfbf4211-f3cb-49ad-98dd-68029d497e5f. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-49be1044-704d-4ce1-b3c9-6ba5d011e06d req-33e04af6-79d2-4496-abfe-20616c369b85 service nova] Acquiring lock "refresh_cache-ed239af5-980e-42d3-8ebd-ca100ccb2708" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-49be1044-704d-4ce1-b3c9-6ba5d011e06d req-33e04af6-79d2-4496-abfe-20616c369b85 service nova] Acquired lock "refresh_cache-ed239af5-980e-42d3-8ebd-ca100ccb2708" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG nova.network.neutron [req-49be1044-704d-4ce1-b3c9-6ba5d011e06d req-33e04af6-79d2-4496-abfe-20616c369b85 service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Refreshing network info cache for port cfbf4211-f3cb-49ad-98dd-68029d497e5f {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Updating instance_info_cache with network_info: [{"id": "5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b", "address": "fa:16:3e:8b:e0:96", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc7ee1a-4f", "ovs_interfaceid": "5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-f4f7788c-fcca-47c1-b5b8-72892253982d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:35 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG nova.network.neutron [req-028488bb-eca6-4abf-8f3d-67149fe881b1 req-124a1eed-608d-43c3-87d0-ef6441fe35eb service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-028488bb-eca6-4abf-8f3d-67149fe881b1 req-124a1eed-608d-43c3-87d0-ef6441fe35eb service nova] Releasing lock "refresh_cache-8a3b8885-1940-4a92-82f4-c65c84bbf11e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG nova.compute.manager [req-028488bb-eca6-4abf-8f3d-67149fe881b1 req-124a1eed-608d-43c3-87d0-ef6441fe35eb service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Received event network-vif-plugged-0b54646a-71ed-4087-adf7-66645e7d2907 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-028488bb-eca6-4abf-8f3d-67149fe881b1 req-124a1eed-608d-43c3-87d0-ef6441fe35eb service nova] Acquiring lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-028488bb-eca6-4abf-8f3d-67149fe881b1 req-124a1eed-608d-43c3-87d0-ef6441fe35eb service nova] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-028488bb-eca6-4abf-8f3d-67149fe881b1 req-124a1eed-608d-43c3-87d0-ef6441fe35eb service nova] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG nova.compute.manager [req-028488bb-eca6-4abf-8f3d-67149fe881b1 req-124a1eed-608d-43c3-87d0-ef6441fe35eb service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] No waiting events found dispatching network-vif-plugged-0b54646a-71ed-4087-adf7-66645e7d2907 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:42:36 user nova-compute[73484]: WARNING nova.compute.manager [req-028488bb-eca6-4abf-8f3d-67149fe881b1 req-124a1eed-608d-43c3-87d0-ef6441fe35eb service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Received unexpected event network-vif-plugged-0b54646a-71ed-4087-adf7-66645e7d2907 for instance with vm_state building and task_state spawning.
Aug 14 13:42:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG nova.network.neutron [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Successfully updated port: e1ddd484-97b4-4cfe-be1e-a3be0128bfdb {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "ed239af5-980e-42d3-8ebd-ca100ccb2708" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "ed239af5-980e-42d3-8ebd-ca100ccb2708" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG nova.objects.instance [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lazy-loading 'flavor' on Instance uuid ed239af5-980e-42d3-8ebd-ca100ccb2708 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG nova.network.neutron [req-49be1044-704d-4ce1-b3c9-6ba5d011e06d req-33e04af6-79d2-4496-abfe-20616c369b85 service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Updated VIF entry in instance network info cache for port cfbf4211-f3cb-49ad-98dd-68029d497e5f. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG nova.network.neutron [req-49be1044-704d-4ce1-b3c9-6ba5d011e06d req-33e04af6-79d2-4496-abfe-20616c369b85 service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Updating instance_info_cache with network_info: [{"id": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "address": "fa:16:3e:c9:13:42", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbf4211-f3", "ovs_interfaceid": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-49be1044-704d-4ce1-b3c9-6ba5d011e06d req-33e04af6-79d2-4496-abfe-20616c369b85 service nova] Releasing lock "refresh_cache-ed239af5-980e-42d3-8ebd-ca100ccb2708" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "ed239af5-980e-42d3-8ebd-ca100ccb2708" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d4ec42-3db9-439b-87a7-02bcaab514a4/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d4ec42-3db9-439b-87a7-02bcaab514a4/disk.rescue --force-share --output=json" returned: 0 in 0.263s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d4ec42-3db9-439b-87a7-02bcaab514a4/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "ed239af5-980e-42d3-8ebd-ca100ccb2708" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "ed239af5-980e-42d3-8ebd-ca100ccb2708" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:36 user nova-compute[73484]: INFO nova.compute.manager [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Attaching volume ed64de01-c957-421a-9664-569069202f9b to /dev/vdb
Aug 14 13:42:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG os_brick.utils [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a5b906-67e2-48b4-9292-80b95ec9ad19]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce4f715-48b4-460d-8d29-4f42d9c769f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9d4ec42-3db9-439b-87a7-02bcaab514a4/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7054b8-6846-4fba-9eaf-50887a6f6bb8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d6c91e-629e-4bc9-aa9b-8ef24e8a7f5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:42:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:42:37 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:42:37 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee83e9af-a9b9-4a38-97c1-3184ecfc3567]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:42:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:42:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:42:37 user nova-compute[73484]: DEBUG os_brick.utils [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:42:37 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Updating existing volume attachment record: a3a8ddbf-7506-4c72-941f-48cf956b9316 {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:42:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:37 user nova-compute[73484]: DEBUG nova.network.neutron [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Successfully updated port: f8f67d05-60f1-4a23-afdb-f26e4d8976ed {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:42:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:37 user nova-compute[73484]: DEBUG nova.compute.manager [req-bf0e27c2-36eb-45a3-a699-823621c2d1d2 req-848dd45e-9118-49b2-a9de-3adba9eaa532 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-changed-e1ddd484-97b4-4cfe-be1e-a3be0128bfdb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:42:37 user nova-compute[73484]: DEBUG nova.compute.manager [req-bf0e27c2-36eb-45a3-a699-823621c2d1d2 req-848dd45e-9118-49b2-a9de-3adba9eaa532 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Refreshing instance network info cache due to event network-changed-e1ddd484-97b4-4cfe-be1e-a3be0128bfdb. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:42:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-bf0e27c2-36eb-45a3-a699-823621c2d1d2 req-848dd45e-9118-49b2-a9de-3adba9eaa532 service nova] Acquiring lock "refresh_cache-8a3b8885-1940-4a92-82f4-c65c84bbf11e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:42:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-bf0e27c2-36eb-45a3-a699-823621c2d1d2 req-848dd45e-9118-49b2-a9de-3adba9eaa532 service nova] Acquired lock "refresh_cache-8a3b8885-1940-4a92-82f4-c65c84bbf11e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:42:37 user nova-compute[73484]: DEBUG nova.network.neutron [req-bf0e27c2-36eb-45a3-a699-823621c2d1d2 req-848dd45e-9118-49b2-a9de-3adba9eaa532 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Refreshing network info cache for port e1ddd484-97b4-4cfe-be1e-a3be0128bfdb {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:42:37 user nova-compute[73484]: DEBUG nova.network.neutron [req-bf0e27c2-36eb-45a3-a699-823621c2d1d2 req-848dd45e-9118-49b2-a9de-3adba9eaa532 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:42:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:42:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:38 user nova-compute[73484]: DEBUG nova.network.neutron [req-bf0e27c2-36eb-45a3-a699-823621c2d1d2 req-848dd45e-9118-49b2-a9de-3adba9eaa532 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:42:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-bf0e27c2-36eb-45a3-a699-823621c2d1d2 req-848dd45e-9118-49b2-a9de-3adba9eaa532 service nova] Releasing lock "refresh_cache-8a3b8885-1940-4a92-82f4-c65c84bbf11e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:42:38 user nova-compute[73484]: DEBUG nova.compute.manager [req-bf0e27c2-36eb-45a3-a699-823621c2d1d2 req-848dd45e-9118-49b2-a9de-3adba9eaa532 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-changed-f8f67d05-60f1-4a23-afdb-f26e4d8976ed {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:42:38 user nova-compute[73484]: DEBUG nova.compute.manager [req-bf0e27c2-36eb-45a3-a699-823621c2d1d2 req-848dd45e-9118-49b2-a9de-3adba9eaa532 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Refreshing instance network info cache due to event network-changed-f8f67d05-60f1-4a23-afdb-f26e4d8976ed. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:42:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-bf0e27c2-36eb-45a3-a699-823621c2d1d2 req-848dd45e-9118-49b2-a9de-3adba9eaa532 service nova] Acquiring lock "refresh_cache-8a3b8885-1940-4a92-82f4-c65c84bbf11e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:42:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-bf0e27c2-36eb-45a3-a699-823621c2d1d2 req-848dd45e-9118-49b2-a9de-3adba9eaa532 service nova] Acquired lock "refresh_cache-8a3b8885-1940-4a92-82f4-c65c84bbf11e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:42:38 user nova-compute[73484]: DEBUG nova.network.neutron [req-bf0e27c2-36eb-45a3-a699-823621c2d1d2 req-848dd45e-9118-49b2-a9de-3adba9eaa532 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Refreshing network info cache for port f8f67d05-60f1-4a23-afdb-f26e4d8976ed {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:42:38 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692020543.1215332, 20d01b50-8888-4def-a617-5b4e77a45837 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:42:38 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] VM Stopped (Lifecycle Event)
Aug 14 13:42:38 user nova-compute[73484]: DEBUG nova.compute.manager [None req-bfa8d34e-8e86-4aa3-8b9a-443e85048025 None None] [instance: 20d01b50-8888-4def-a617-5b4e77a45837] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:42:38 user nova-compute[73484]: DEBUG nova.network.neutron [req-bf0e27c2-36eb-45a3-a699-823621c2d1d2 req-848dd45e-9118-49b2-a9de-3adba9eaa532 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:42:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:38 user nova-compute[73484]: DEBUG nova.network.neutron [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Successfully updated port: b192f20f-10a5-4370-8e81-4a6faa679942 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:42:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:38 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:42:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:38 user nova-compute[73484]: DEBUG nova.network.neutron [req-bf0e27c2-36eb-45a3-a699-823621c2d1d2 req-848dd45e-9118-49b2-a9de-3adba9eaa532 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:42:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-bf0e27c2-36eb-45a3-a699-823621c2d1d2 req-848dd45e-9118-49b2-a9de-3adba9eaa532 service nova] Releasing lock "refresh_cache-8a3b8885-1940-4a92-82f4-c65c84bbf11e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:42:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk.rescue --force-share --output=json" returned: 0 in 0.246s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:39 user nova-compute[73484]: DEBUG nova.network.neutron [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Successfully updated port: da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:42:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Acquiring lock "refresh_cache-8a3b8885-1940-4a92-82f4-c65c84bbf11e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:42:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Acquired lock "refresh_cache-8a3b8885-1940-4a92-82f4-c65c84bbf11e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:42:39 user nova-compute[73484]: DEBUG nova.network.neutron [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:42:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:39 user nova-compute[73484]: DEBUG nova.network.neutron [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:42:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-03be98ab-554b-47a4-ac2c-bf062a306603 req-e48d586d-d007-4fe9-a0d1-40b244d83eb7 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-changed-b192f20f-10a5-4370-8e81-4a6faa679942 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:42:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-03be98ab-554b-47a4-ac2c-bf062a306603 req-e48d586d-d007-4fe9-a0d1-40b244d83eb7 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Refreshing instance network info cache due to event network-changed-b192f20f-10a5-4370-8e81-4a6faa679942. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:42:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-03be98ab-554b-47a4-ac2c-bf062a306603 req-e48d586d-d007-4fe9-a0d1-40b244d83eb7 service nova] Acquiring lock "refresh_cache-8a3b8885-1940-4a92-82f4-c65c84bbf11e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:42:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c48c0d4-7d10-4086-b30f-61e71f358622/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c48c0d4-7d10-4086-b30f-61e71f358622/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c48c0d4-7d10-4086-b30f-61e71f358622/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c48c0d4-7d10-4086-b30f-61e71f358622/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:42 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:42 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:42:42 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:42:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=7028MB free_disk=25.398094177246094GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 13:42:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance f4f7788c-fcca-47c1-b5b8-72892253982d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:42:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:42:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:42:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 07bac569-8b2c-4555-b4d5-a74f7384630b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:42:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance b889688d-13dd-4f7b-bfef-26dc5347fd6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:42:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance eaaccbea-d453-4943-9663-949c66029d87 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:42:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance a9d4ec42-3db9-439b-87a7-02bcaab514a4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:42:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance ed239af5-980e-42d3-8ebd-ca100ccb2708 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:42:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance bd43e3a9-0413-4e55-b6a1-7f3f792ba872 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:42:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 8220a084-e402-435a-b6a7-ffd94f91a211 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:42:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 1c48c0d4-7d10-4086-b30f-61e71f358622 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:42:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 8a3b8885-1940-4a92-82f4-c65c84bbf11e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:42:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 09ba29fd-8161-485c-ba6d-71d24ab086bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:42:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 13:42:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 13:42:42 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Refreshing inventories for resource provider 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 13:42:42 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Updating ProviderTree inventory for provider 165d4635-93b4-49a6-879a-21c1324822ab from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 13:42:42 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Updating inventory in ProviderTree for provider 165d4635-93b4-49a6-879a-21c1324822ab with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 13:42:42 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Refreshing aggregate associations for resource provider 165d4635-93b4-49a6-879a-21c1324822ab, aggregates: None {{(pid=73484) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 13:42:42 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Refreshing trait associations for resource provider 165d4635-93b4-49a6-879a-21c1324822ab, traits: COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS {{(pid=73484) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 13:42:42 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:42:42 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:42:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 13:42:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.864s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:42 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:42:42 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Cleaning up deleted instances {{(pid=73484) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 13:42:42 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] There are 0 instances to clean {{(pid=73484) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 13:42:42 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG nova.network.neutron [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Updating instance_info_cache with network_info: [{"id": "ec36c6e8-45d2-469b-b874-e9d3a10314f9", "address": "fa:16:3e:bf:2c:42", "network": {"id": "cf1afc3e-d2cd-48ff-b311-1c7415960df4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-690860686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec36c6e8-45", "ovs_interfaceid": "ec36c6e8-45d2-469b-b874-e9d3a10314f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "address": "fa:16:3e:7c:c1:ab", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5259f8bf-c5", "ovs_interfaceid": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45079f89-4586-4c56-824b-cf112200e102", "address": "fa:16:3e:16:d7:b1", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45079f89-45", "ovs_interfaceid": "45079f89-4586-4c56-824b-cf112200e102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "address": "fa:16:3e:fe:36:1f", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ddd484-97", "ovs_interfaceid": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f8f67d05-60f1-4a23-afdb-f26e4d8976ed", "address": "fa:16:3e:c4:ff:42", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f67d05-60", "ovs_interfaceid": "f8f67d05-60f1-4a23-afdb-f26e4d8976ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b192f20f-10a5-4370-8e81-4a6faa679942", "address": "fa:16:3e:38:e6:44", "network": {"id": "1511c9d9-7c94-4100-811f-af762219ba90", "bridge": "br-int", "label": "tempest-device-tagging-net2-709970726", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb192f20f-10", "ovs_interfaceid": "b192f20f-10a5-4370-8e81-4a6faa679942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4", "address": "fa:16:3e:f2:f3:58", "network": {"id": "1511c9d9-7c94-4100-811f-af762219ba90", "bridge": "br-int", "label": "tempest-device-tagging-net2-709970726", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda15c9a3-5f", "ovs_interfaceid": "da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Releasing lock "refresh_cache-8a3b8885-1940-4a92-82f4-c65c84bbf11e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG nova.compute.manager [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Instance network_info: |[{"id": "ec36c6e8-45d2-469b-b874-e9d3a10314f9", "address": "fa:16:3e:bf:2c:42", "network": {"id": "cf1afc3e-d2cd-48ff-b311-1c7415960df4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-690860686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec36c6e8-45", "ovs_interfaceid": "ec36c6e8-45d2-469b-b874-e9d3a10314f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "address": "fa:16:3e:7c:c1:ab", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5259f8bf-c5", "ovs_interfaceid": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45079f89-4586-4c56-824b-cf112200e102", "address": "fa:16:3e:16:d7:b1", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45079f89-45", "ovs_interfaceid": "45079f89-4586-4c56-824b-cf112200e102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "address": "fa:16:3e:fe:36:1f", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ddd484-97", "ovs_interfaceid": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f8f67d05-60f1-4a23-afdb-f26e4d8976ed", "address": "fa:16:3e:c4:ff:42", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f67d05-60", "ovs_interfaceid": "f8f67d05-60f1-4a23-afdb-f26e4d8976ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b192f20f-10a5-4370-8e81-4a6faa679942", "address": "fa:16:3e:38:e6:44", "network": {"id": "1511c9d9-7c94-4100-811f-af762219ba90", "bridge": "br-int", "label": "tempest-device-tagging-net2-709970726", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb192f20f-10", "ovs_interfaceid": "b192f20f-10a5-4370-8e81-4a6faa679942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4", "address": "fa:16:3e:f2:f3:58", "network": {"id": "1511c9d9-7c94-4100-811f-af762219ba90", "bridge": "br-int", "label": "tempest-device-tagging-net2-709970726", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda15c9a3-5f", "ovs_interfaceid": "da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-03be98ab-554b-47a4-ac2c-bf062a306603 req-e48d586d-d007-4fe9-a0d1-40b244d83eb7 service nova] Acquired lock "refresh_cache-8a3b8885-1940-4a92-82f4-c65c84bbf11e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG nova.network.neutron [req-03be98ab-554b-47a4-ac2c-bf062a306603 req-e48d586d-d007-4fe9-a0d1-40b244d83eb7 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Refreshing network info cache for port b192f20f-10a5-4370-8e81-4a6faa679942 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:42:43 user nova-compute[73484]: INFO nova.virt.block_device [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Booting with volume b5662fa5-2d57-4576-baf1-6ebdd75d0467 at /dev/vdc
Aug 14 13:42:43 user nova-compute[73484]: DEBUG os_brick.utils [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[009f5301-d343-4f5c-8ba3-291da3e1b0d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf37ce2-2f97-4326-870a-f9b422598750]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[cceac96c-411f-4729-90bb-80b8d417f7dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7ca8b3-e4bc-44df-98e6-460132ca4e9a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:42:43 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:42:43 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[325affbb-ae47-4229-a57c-8ae53169fb8d]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG os_brick.utils [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Updating existing volume attachment record: 34438326-7829-48d9-bf84-040216526520 {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG nova.network.neutron [req-03be98ab-554b-47a4-ac2c-bf062a306603 req-e48d586d-d007-4fe9-a0d1-40b244d83eb7 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Updated VIF entry in instance network info cache for port b192f20f-10a5-4370-8e81-4a6faa679942. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG nova.network.neutron [req-03be98ab-554b-47a4-ac2c-bf062a306603 req-e48d586d-d007-4fe9-a0d1-40b244d83eb7 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Updating instance_info_cache with network_info: [{"id": "ec36c6e8-45d2-469b-b874-e9d3a10314f9", "address": "fa:16:3e:bf:2c:42", "network": {"id": "cf1afc3e-d2cd-48ff-b311-1c7415960df4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-690860686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec36c6e8-45", "ovs_interfaceid": "ec36c6e8-45d2-469b-b874-e9d3a10314f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "address": "fa:16:3e:7c:c1:ab", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5259f8bf-c5", "ovs_interfaceid": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45079f89-4586-4c56-824b-cf112200e102", "address": "fa:16:3e:16:d7:b1", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45079f89-45", "ovs_interfaceid": "45079f89-4586-4c56-824b-cf112200e102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "address": "fa:16:3e:fe:36:1f", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ddd484-97", "ovs_interfaceid": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f8f67d05-60f1-4a23-afdb-f26e4d8976ed", "address": "fa:16:3e:c4:ff:42", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f67d05-60", "ovs_interfaceid": "f8f67d05-60f1-4a23-afdb-f26e4d8976ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b192f20f-10a5-4370-8e81-4a6faa679942", "address": "fa:16:3e:38:e6:44", "network": {"id": "1511c9d9-7c94-4100-811f-af762219ba90", "bridge": "br-int", "label": "tempest-device-tagging-net2-709970726", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb192f20f-10", "ovs_interfaceid": "b192f20f-10a5-4370-8e81-4a6faa679942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4", "address": "fa:16:3e:f2:f3:58", "network": {"id": "1511c9d9-7c94-4100-811f-af762219ba90", "bridge": "br-int", "label": "tempest-device-tagging-net2-709970726", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda15c9a3-5f", "ovs_interfaceid": "da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-03be98ab-554b-47a4-ac2c-bf062a306603 req-e48d586d-d007-4fe9-a0d1-40b244d83eb7 service nova] Releasing lock "refresh_cache-8a3b8885-1940-4a92-82f4-c65c84bbf11e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG nova.compute.manager [req-03be98ab-554b-47a4-ac2c-bf062a306603 req-e48d586d-d007-4fe9-a0d1-40b244d83eb7 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-changed-da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG nova.compute.manager [req-03be98ab-554b-47a4-ac2c-bf062a306603 req-e48d586d-d007-4fe9-a0d1-40b244d83eb7 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Refreshing instance network info cache due to event network-changed-da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-03be98ab-554b-47a4-ac2c-bf062a306603 req-e48d586d-d007-4fe9-a0d1-40b244d83eb7 service nova] Acquiring lock "refresh_cache-8a3b8885-1940-4a92-82f4-c65c84bbf11e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-03be98ab-554b-47a4-ac2c-bf062a306603 req-e48d586d-d007-4fe9-a0d1-40b244d83eb7 service nova] Acquired lock "refresh_cache-8a3b8885-1940-4a92-82f4-c65c84bbf11e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG nova.network.neutron [req-03be98ab-554b-47a4-ac2c-bf062a306603 req-e48d586d-d007-4fe9-a0d1-40b244d83eb7 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Refreshing network info cache for port da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:42:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:44 user nova-compute[73484]: DEBUG nova.network.neutron [req-03be98ab-554b-47a4-ac2c-bf062a306603 req-e48d586d-d007-4fe9-a0d1-40b244d83eb7 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Updated VIF entry in instance network info cache for port da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:42:44 user nova-compute[73484]: DEBUG nova.network.neutron [req-03be98ab-554b-47a4-ac2c-bf062a306603 req-e48d586d-d007-4fe9-a0d1-40b244d83eb7 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Updating instance_info_cache with network_info: [{"id": "ec36c6e8-45d2-469b-b874-e9d3a10314f9", "address": "fa:16:3e:bf:2c:42", "network": {"id": "cf1afc3e-d2cd-48ff-b311-1c7415960df4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-690860686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec36c6e8-45", "ovs_interfaceid": "ec36c6e8-45d2-469b-b874-e9d3a10314f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "address": "fa:16:3e:7c:c1:ab", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5259f8bf-c5", "ovs_interfaceid": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45079f89-4586-4c56-824b-cf112200e102", "address": "fa:16:3e:16:d7:b1", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45079f89-45", "ovs_interfaceid": "45079f89-4586-4c56-824b-cf112200e102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "address": "fa:16:3e:fe:36:1f", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ddd484-97", "ovs_interfaceid": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f8f67d05-60f1-4a23-afdb-f26e4d8976ed", "address": "fa:16:3e:c4:ff:42", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f67d05-60", "ovs_interfaceid": "f8f67d05-60f1-4a23-afdb-f26e4d8976ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b192f20f-10a5-4370-8e81-4a6faa679942", "address": "fa:16:3e:38:e6:44", "network": {"id": "1511c9d9-7c94-4100-811f-af762219ba90", "bridge": "br-int", "label": "tempest-device-tagging-net2-709970726", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb192f20f-10", "ovs_interfaceid": "b192f20f-10a5-4370-8e81-4a6faa679942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4", "address": "fa:16:3e:f2:f3:58", "network": {"id": "1511c9d9-7c94-4100-811f-af762219ba90", "bridge": "br-int", "label": "tempest-device-tagging-net2-709970726", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda15c9a3-5f", "ovs_interfaceid": "da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:42:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-03be98ab-554b-47a4-ac2c-bf062a306603 req-e48d586d-d007-4fe9-a0d1-40b244d83eb7 service nova] Releasing lock "refresh_cache-8a3b8885-1940-4a92-82f4-c65c84bbf11e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:42:44 user nova-compute[73484]: INFO nova.compute.manager [None req-0473ca3f-3008-430f-a434-1074ee0ebbe9 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Unrescuing
Aug 14 13:42:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0473ca3f-3008-430f-a434-1074ee0ebbe9 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Acquiring lock "refresh_cache-66e161f1-2f3b-4777-9a0d-5f4d62e850d5" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:42:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0473ca3f-3008-430f-a434-1074ee0ebbe9 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Acquired lock "refresh_cache-66e161f1-2f3b-4777-9a0d-5f4d62e850d5" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:42:44 user nova-compute[73484]: DEBUG nova.network.neutron [None req-0473ca3f-3008-430f-a434-1074ee0ebbe9 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:42:45 user nova-compute[73484]: DEBUG nova.network.neutron [None req-0473ca3f-3008-430f-a434-1074ee0ebbe9 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Updating instance_info_cache with network_info: [{"id": "290c0b61-ba11-4074-a7f2-cb172a576a19", "address": "fa:16:3e:69:2f:ce", "network": {"id": "2306cc91-8443-4c0e-b5a6-3883766b686a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-577320480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ea5214248845418e322d18d298c449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap290c0b61-ba", "ovs_interfaceid": "290c0b61-ba11-4074-a7f2-cb172a576a19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:42:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0473ca3f-3008-430f-a434-1074ee0ebbe9 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Releasing lock "refresh_cache-66e161f1-2f3b-4777-9a0d-5f4d62e850d5" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:42:45 user nova-compute[73484]: DEBUG nova.objects.instance [None req-0473ca3f-3008-430f-a434-1074ee0ebbe9 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lazy-loading 'flavor' on Instance uuid 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:42:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:45 user nova-compute[73484]: DEBUG nova.compute.manager [req-50e41669-d8e4-4cdf-bb2a-fd87ef59fca7 req-61706980-0c19-46cc-b232-9bdbea279bf9 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Received event network-vif-unplugged-290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:42:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-50e41669-d8e4-4cdf-bb2a-fd87ef59fca7 req-61706980-0c19-46cc-b232-9bdbea279bf9 service nova] Acquiring lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-50e41669-d8e4-4cdf-bb2a-fd87ef59fca7 req-61706980-0c19-46cc-b232-9bdbea279bf9 service nova] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-50e41669-d8e4-4cdf-bb2a-fd87ef59fca7 req-61706980-0c19-46cc-b232-9bdbea279bf9 service nova] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:45 user nova-compute[73484]: DEBUG nova.compute.manager [req-50e41669-d8e4-4cdf-bb2a-fd87ef59fca7 req-61706980-0c19-46cc-b232-9bdbea279bf9 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] No waiting events found dispatching network-vif-unplugged-290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:42:45 user nova-compute[73484]: WARNING nova.compute.manager [req-50e41669-d8e4-4cdf-bb2a-fd87ef59fca7 req-61706980-0c19-46cc-b232-9bdbea279bf9 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Received unexpected event network-vif-unplugged-290c0b61-ba11-4074-a7f2-cb172a576a19 for instance with vm_state rescued and task_state unrescuing.
Aug 14 13:42:46 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:42:46 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:42:46 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:42:46 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:42:46 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Instance destroyed successfully.
Aug 14 13:42:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:46 user nova-compute[73484]: DEBUG nova.compute.manager [req-80f0cd12-55d5-4280-88c6-7b7c336230a4 req-25e9acf3-500e-40ef-b64b-5a79854cf3a0 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Received event network-changed-290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:42:46 user nova-compute[73484]: DEBUG nova.compute.manager [req-80f0cd12-55d5-4280-88c6-7b7c336230a4 req-25e9acf3-500e-40ef-b64b-5a79854cf3a0 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Refreshing instance network info cache due to event network-changed-290c0b61-ba11-4074-a7f2-cb172a576a19. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:42:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-80f0cd12-55d5-4280-88c6-7b7c336230a4 req-25e9acf3-500e-40ef-b64b-5a79854cf3a0 service nova] Acquiring lock "refresh_cache-66e161f1-2f3b-4777-9a0d-5f4d62e850d5" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:42:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-80f0cd12-55d5-4280-88c6-7b7c336230a4 req-25e9acf3-500e-40ef-b64b-5a79854cf3a0 service nova] Acquired lock "refresh_cache-66e161f1-2f3b-4777-9a0d-5f4d62e850d5" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:42:46 user nova-compute[73484]: DEBUG nova.network.neutron [req-80f0cd12-55d5-4280-88c6-7b7c336230a4 req-25e9acf3-500e-40ef-b64b-5a79854cf3a0 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Refreshing network info cache for port 290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG nova.network.neutron [req-80f0cd12-55d5-4280-88c6-7b7c336230a4 req-25e9acf3-500e-40ef-b64b-5a79854cf3a0 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Updated VIF entry in instance network info cache for port 290c0b61-ba11-4074-a7f2-cb172a576a19. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG nova.network.neutron [req-80f0cd12-55d5-4280-88c6-7b7c336230a4 req-25e9acf3-500e-40ef-b64b-5a79854cf3a0 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Updating instance_info_cache with network_info: [{"id": "290c0b61-ba11-4074-a7f2-cb172a576a19", "address": "fa:16:3e:69:2f:ce", "network": {"id": "2306cc91-8443-4c0e-b5a6-3883766b686a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-577320480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ea5214248845418e322d18d298c449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap290c0b61-ba", "ovs_interfaceid": "290c0b61-ba11-4074-a7f2-cb172a576a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:47 user nova-compute[73484]: INFO nova.compute.manager [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Detaching volume a9a47272-145b-4612-b657-2ff1d153dcbd
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-80f0cd12-55d5-4280-88c6-7b7c336230a4 req-25e9acf3-500e-40ef-b64b-5a79854cf3a0 service nova] Releasing lock "refresh_cache-66e161f1-2f3b-4777-9a0d-5f4d62e850d5" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:42:47 user nova-compute[73484]: INFO nova.virt.block_device [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Attempting to driver detach volume a9a47272-145b-4612-b657-2ff1d153dcbd from mountpoint /dev/vdb
Aug 14 13:42:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Attempting to detach device vdb from instance 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 from the persistent domain config. {{(pid=73484) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:42:47 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:42:47 user nova-compute[73484]:   <source dev="/dev/sdd"/>
Aug 14 13:42:47 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:42:47 user nova-compute[73484]:   <serial>a9a47272-145b-4612-b657-2ff1d153dcbd</serial>
Aug 14 13:42:47 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 13:42:47 user nova-compute[73484]: </disk>
Aug 14 13:42:47 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:42:47 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Successfully detached device vdb from instance 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 from the persistent domain config.
Aug 14 13:42:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 from the live domain config. {{(pid=73484) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:42:47 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:42:47 user nova-compute[73484]:   <source dev="/dev/sdd"/>
Aug 14 13:42:47 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:42:47 user nova-compute[73484]:   <serial>a9a47272-145b-4612-b657-2ff1d153dcbd</serial>
Aug 14 13:42:47 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 13:42:47 user nova-compute[73484]: </disk>
Aug 14 13:42:47 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Acquiring lock "29855792-6422-4626-ae64-923c346b1eb9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "29855792-6422-4626-ae64-923c346b1eb9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:42:47 user nova-compute[73484]: INFO nova.compute.claims [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Claim successful on node user
Aug 14 13:42:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNEtDAag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:42:47 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:42:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:42:47 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:42:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:42:47 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd3ffa9-d428-416b-8325-b928c9f83b15]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:42:47 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ce3ae8-5743-4a92-8edd-4c999d2a6a6f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b] added
Aug 14 13:42:47 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba6969d-146d-4a9a-bc22-2f49db8bed91]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[177e6e0b-4dca-4440-b37b-bc075325ed29]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mNEtDAag {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mNEtDAag" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6772ac-3b23-457f-9d0a-128033ff9ef9]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mNEtDAag'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e481da-1583-400b-8e64-f705fd8898ff]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eef91fd-009f-412f-996c-34bd126cdf67]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:42:47 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:42:47 user nova-compute[73484]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:42:47 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:42:47 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:42:47 user nova-compute[73484]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:42:47 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG nova.compute.manager [req-d2a7c3e8-3fad-4787-afe6-d785f6fd927c req-bbe6a5db-6824-4e8d-b2ec-bdf93770aa77 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Received event network-vif-plugged-290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d2a7c3e8-3fad-4787-afe6-d785f6fd927c req-bbe6a5db-6824-4e8d-b2ec-bdf93770aa77 service nova] Acquiring lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d2a7c3e8-3fad-4787-afe6-d785f6fd927c req-bbe6a5db-6824-4e8d-b2ec-bdf93770aa77 service nova] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d2a7c3e8-3fad-4787-afe6-d785f6fd927c req-bbe6a5db-6824-4e8d-b2ec-bdf93770aa77 service nova] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG nova.compute.manager [req-d2a7c3e8-3fad-4787-afe6-d785f6fd927c req-bbe6a5db-6824-4e8d-b2ec-bdf93770aa77 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] No waiting events found dispatching network-vif-plugged-290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:42:47 user nova-compute[73484]: WARNING nova.compute.manager [req-d2a7c3e8-3fad-4787-afe6-d785f6fd927c req-bbe6a5db-6824-4e8d-b2ec-bdf93770aa77 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Received unexpected event network-vif-plugged-290c0b61-ba11-4074-a7f2-cb172a576a19 for instance with vm_state rescued and task_state unrescuing.
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --login" returned: 0 in 0.109s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b5842a-0637-4463-be71-9efc30b61993]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Received event <DeviceRemovedEvent: 1692020567.9835248, 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73484) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b, portal: 172.16.0.220,3260]
Aug 14 13:42:47 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b, portal: 172.16.0.220,3260] successful.
Aug 14 13:42:47 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 {{(pid=73484) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 13:42:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:47 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Successfully detached device vdb from instance 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 from the live domain config.
Aug 14 13:42:48 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IbnmokSX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:42:48 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:42:48 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c188ccdf-c5f7-4c94-9127-e9634ba60aad]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[271dd527-5c07-46be-98f2-cd43cbddc37c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:42:48 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:42:48 user nova-compute[73484]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:42:48 user nova-compute[73484]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:42:48 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:42:48 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:42:48 user nova-compute[73484]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:42:48 user nova-compute[73484]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:42:48 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.440s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37250fa-b06c-4471-88a1-bc0b5e1eaedb]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNEtDAag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.855s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG nova.network.neutron [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG nova.compute.manager [req-3f7b1587-9363-412f-8164-68bc7cf0eab5 req-d33fb921-861d-4a03-ad2a-b1379b04b9da service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Received event network-changed-290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG nova.compute.manager [req-3f7b1587-9363-412f-8164-68bc7cf0eab5 req-d33fb921-861d-4a03-ad2a-b1379b04b9da service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Refreshing instance network info cache due to event network-changed-290c0b61-ba11-4074-a7f2-cb172a576a19. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3f7b1587-9363-412f-8164-68bc7cf0eab5 req-d33fb921-861d-4a03-ad2a-b1379b04b9da service nova] Acquiring lock "refresh_cache-66e161f1-2f3b-4777-9a0d-5f4d62e850d5" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3f7b1587-9363-412f-8164-68bc7cf0eab5 req-d33fb921-861d-4a03-ad2a-b1379b04b9da service nova] Acquired lock "refresh_cache-66e161f1-2f3b-4777-9a0d-5f4d62e850d5" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG nova.network.neutron [req-3f7b1587-9363-412f-8164-68bc7cf0eab5 req-d33fb921-861d-4a03-ad2a-b1379b04b9da service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Refreshing network info cache for port 290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:42:48 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:42:48 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG nova.policy [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33fea6b1b7dd4b2297bac12011f57a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ff7afafc2d4b1fa74902cdf0ce08d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:42:48 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Creating image(s)
Aug 14 13:42:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Acquiring lock "/opt/stack/data/nova/instances/29855792-6422-4626-ae64-923c346b1eb9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "/opt/stack/data/nova/instances/29855792-6422-4626-ae64-923c346b1eb9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "/opt/stack/data/nova/instances/29855792-6422-4626-ae64-923c346b1eb9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.201s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.490s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] <== connect_volume: return (1495ms) {'type': 'block', 'scsi_wwn': '23733663832333038', 'path': '/dev/sde'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733663832333038', 'path': '/dev/sde'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.115s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG nova.objects.instance [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lazy-loading 'flavor' on Instance uuid ed239af5-980e-42d3-8ebd-ca100ccb2708 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e10fa0-499a-4602-b5fb-3186d1458f9a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d571b99d-e411-4d63-8a14-a599cf67ac82]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 13:42:49 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:42:49 user nova-compute[73484]:   <source dev="/dev/sde"/>
Aug 14 13:42:49 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:42:49 user nova-compute[73484]:   <serial>ed64de01-c957-421a-9664-569069202f9b</serial>
Aug 14 13:42:49 user nova-compute[73484]: </disk>
Aug 14 13:42:49 user nova-compute[73484]:  {{(pid=73484) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:42:49 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:42:49 user nova-compute[73484]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:42:49 user nova-compute[73484]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:42:49 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:42:49 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:42:49 user nova-compute[73484]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd (non-flash)
Aug 14 13:42:49 user nova-compute[73484]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:42:49 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc458334040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd'): ({'sdd'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Removing single pathed devices sdd {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bd6fdc-593a-4096-bb3e-6792ed3024ff]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21302ef-8891-4058-a88e-13acb2c96bf3]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Flushing IO for device /dev/sdd {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5c1d0d-eeda-403e-a454-5099f6aa774b]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.253s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/29855792-6422-4626-ae64-923c346b1eb9/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG nova.network.neutron [req-3f7b1587-9363-412f-8164-68bc7cf0eab5 req-d33fb921-861d-4a03-ad2a-b1379b04b9da service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Updated VIF entry in instance network info cache for port 290c0b61-ba11-4074-a7f2-cb172a576a19. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG nova.network.neutron [req-3f7b1587-9363-412f-8164-68bc7cf0eab5 req-d33fb921-861d-4a03-ad2a-b1379b04b9da service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Updating instance_info_cache with network_info: [{"id": "290c0b61-ba11-4074-a7f2-cb172a576a19", "address": "fa:16:3e:69:2f:ce", "network": {"id": "2306cc91-8443-4c0e-b5a6-3883766b686a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-577320480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ea5214248845418e322d18d298c449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap290c0b61-ba", "ovs_interfaceid": "290c0b61-ba11-4074-a7f2-cb172a576a19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[68710cb7-7900-4fb6-a7c8-c5eda02c3a00]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] SCSI volumes sdd have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/29855792-6422-4626-ae64-923c346b1eb9/disk 1073741824" returned: 0 in 0.093s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3f7b1587-9363-412f-8164-68bc7cf0eab5 req-d33fb921-861d-4a03-ad2a-b1379b04b9da service nova] Releasing lock "refresh_cache-66e161f1-2f3b-4777-9a0d-5f4d62e850d5" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.352s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb68700-edaf-46f3-ae8f-fd1e2d22ac8c]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[692cae17-3c46-4c9b-a8cc-ffba12c9cc67]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd, portal: 172.16.0.220,3260]
Aug 14 13:42:49 user nova-compute[73484]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd, portal: 172.16.0.220,3260] successful.
Aug 14 13:42:49 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9a47272-145b-4612-b657-2ff1d153dcbd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[86118da3-b058-4699-ae19-282346383ac9]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.457s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] <== disconnect_volume: return (1572ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.210s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Checking if we can resize image /opt/stack/data/nova/instances/29855792-6422-4626-ae64-923c346b1eb9/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29855792-6422-4626-ae64-923c346b1eb9/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG nova.network.neutron [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Successfully created port: 2c48d537-2b53-4807-a789-e7444e76ca45 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] No VIF found with MAC fa:16:3e:c9:13:42, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29855792-6422-4626-ae64-923c346b1eb9/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Cannot resize image /opt/stack/data/nova/instances/29855792-6422-4626-ae64-923c346b1eb9/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG nova.objects.instance [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lazy-loading 'migration_context' on Instance uuid 29855792-6422-4626-ae64-923c346b1eb9 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Ensure instance console log exists: /opt/stack/data/nova/instances/29855792-6422-4626-ae64-923c346b1eb9/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b83ca4ac-4f36-42fd-942f-81715c9c9fa0 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "ed239af5-980e-42d3-8ebd-ca100ccb2708" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.249s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:50 user nova-compute[73484]: DEBUG nova.compute.manager [req-cf3d3a94-101a-41f4-b837-0463c1ac3651 req-8255a739-c7b8-4dcc-a6e1-cb7f087e7f0a service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Received event network-vif-plugged-290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:42:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-cf3d3a94-101a-41f4-b837-0463c1ac3651 req-8255a739-c7b8-4dcc-a6e1-cb7f087e7f0a service nova] Acquiring lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-cf3d3a94-101a-41f4-b837-0463c1ac3651 req-8255a739-c7b8-4dcc-a6e1-cb7f087e7f0a service nova] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-cf3d3a94-101a-41f4-b837-0463c1ac3651 req-8255a739-c7b8-4dcc-a6e1-cb7f087e7f0a service nova] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:50 user nova-compute[73484]: DEBUG nova.compute.manager [req-cf3d3a94-101a-41f4-b837-0463c1ac3651 req-8255a739-c7b8-4dcc-a6e1-cb7f087e7f0a service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] No waiting events found dispatching network-vif-plugged-290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:42:50 user nova-compute[73484]: WARNING nova.compute.manager [req-cf3d3a94-101a-41f4-b837-0463c1ac3651 req-8255a739-c7b8-4dcc-a6e1-cb7f087e7f0a service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Received unexpected event network-vif-plugged-290c0b61-ba11-4074-a7f2-cb172a576a19 for instance with vm_state rescued and task_state unrescuing.
Aug 14 13:42:50 user nova-compute[73484]: DEBUG nova.compute.manager [req-cf3d3a94-101a-41f4-b837-0463c1ac3651 req-8255a739-c7b8-4dcc-a6e1-cb7f087e7f0a service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Received event network-vif-plugged-290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:42:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-cf3d3a94-101a-41f4-b837-0463c1ac3651 req-8255a739-c7b8-4dcc-a6e1-cb7f087e7f0a service nova] Acquiring lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-cf3d3a94-101a-41f4-b837-0463c1ac3651 req-8255a739-c7b8-4dcc-a6e1-cb7f087e7f0a service nova] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-cf3d3a94-101a-41f4-b837-0463c1ac3651 req-8255a739-c7b8-4dcc-a6e1-cb7f087e7f0a service nova] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:50 user nova-compute[73484]: DEBUG nova.compute.manager [req-cf3d3a94-101a-41f4-b837-0463c1ac3651 req-8255a739-c7b8-4dcc-a6e1-cb7f087e7f0a service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] No waiting events found dispatching network-vif-plugged-290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:42:50 user nova-compute[73484]: WARNING nova.compute.manager [req-cf3d3a94-101a-41f4-b837-0463c1ac3651 req-8255a739-c7b8-4dcc-a6e1-cb7f087e7f0a service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Received unexpected event network-vif-plugged-290c0b61-ba11-4074-a7f2-cb172a576a19 for instance with vm_state rescued and task_state unrescuing.
Aug 14 13:42:50 user nova-compute[73484]: DEBUG nova.objects.instance [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'flavor' on Instance uuid 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:42:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-05ca012a-004a-4126-8e7e-7b90a792c017 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.549s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:50 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Removed pending event for 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 due to event {{(pid=73484) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 13:42:50 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020570.6520553, 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:42:50 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] VM Resumed (Lifecycle Event)
Aug 14 13:42:50 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0473ca3f-3008-430f-a434-1074ee0ebbe9 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:42:50 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:42:50 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:42:50 user nova-compute[73484]: DEBUG nova.network.neutron [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Successfully updated port: 2c48d537-2b53-4807-a789-e7444e76ca45 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:42:50 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 13:42:50 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020570.6539028, 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:42:50 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] VM Started (Lifecycle Event)
Aug 14 13:42:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Acquiring lock "refresh_cache-29855792-6422-4626-ae64-923c346b1eb9" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:42:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Acquired lock "refresh_cache-29855792-6422-4626-ae64-923c346b1eb9" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:42:50 user nova-compute[73484]: DEBUG nova.network.neutron [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:42:50 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:42:50 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:42:50 user nova-compute[73484]: DEBUG nova.network.neutron [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.network.neutron [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Updating instance_info_cache with network_info: [{"id": "2c48d537-2b53-4807-a789-e7444e76ca45", "address": "fa:16:3e:80:b2:13", "network": {"id": "893008ed-2c71-42ba-bf31-28baba1b8c2c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1936284602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ff7afafc2d4b1fa74902cdf0ce08d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c48d537-2b", "ovs_interfaceid": "2c48d537-2b53-4807-a789-e7444e76ca45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Releasing lock "refresh_cache-29855792-6422-4626-ae64-923c346b1eb9" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Instance network_info: |[{"id": "2c48d537-2b53-4807-a789-e7444e76ca45", "address": "fa:16:3e:80:b2:13", "network": {"id": "893008ed-2c71-42ba-bf31-28baba1b8c2c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1936284602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ff7afafc2d4b1fa74902cdf0ce08d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c48d537-2b", "ovs_interfaceid": "2c48d537-2b53-4807-a789-e7444e76ca45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Start _get_guest_xml network_info=[{"id": "2c48d537-2b53-4807-a789-e7444e76ca45", "address": "fa:16:3e:80:b2:13", "network": {"id": "893008ed-2c71-42ba-bf31-28baba1b8c2c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1936284602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ff7afafc2d4b1fa74902cdf0ce08d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c48d537-2b", "ovs_interfaceid": "2c48d537-2b53-4807-a789-e7444e76ca45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:42:51 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:42:51 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:42:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1103453138',display_name='tempest-ServersNegativeTestJSON-server-1103453138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1103453138',id=21,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76ff7afafc2d4b1fa74902cdf0ce08d6',ramdisk_id='',reservation_id='r-clk068qh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-287955364',owner_user_name='tempest-ServersNegativeTestJSON-287955364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:42:48Z,user_data=None,user_id='33fea6b1b7dd4b2297bac12011f57a17',uuid=29855792-6422-4626-ae64-923c346b1eb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c48d537-2b53-4807-a789-e7444e76ca45", "address": "fa:16:3e:80:b2:13", "network": {"id": "893008ed-2c71-42ba-bf31-28baba1b8c2c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1936284602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ff7afafc2d4b1fa74902cdf0ce08d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c48d537-2b", "ovs_interfaceid": "2c48d537-2b53-4807-a789-e7444e76ca45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Converting VIF {"id": "2c48d537-2b53-4807-a789-e7444e76ca45", "address": "fa:16:3e:80:b2:13", "network": {"id": "893008ed-2c71-42ba-bf31-28baba1b8c2c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1936284602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ff7afafc2d4b1fa74902cdf0ce08d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c48d537-2b", "ovs_interfaceid": "2c48d537-2b53-4807-a789-e7444e76ca45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:b2:13,bridge_name='br-int',has_traffic_filtering=True,id=2c48d537-2b53-4807-a789-e7444e76ca45,network=Network(893008ed-2c71-42ba-bf31-28baba1b8c2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c48d537-2b') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.objects.instance [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lazy-loading 'pci_devices' on Instance uuid 29855792-6422-4626-ae64-923c346b1eb9 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:42:51 user nova-compute[73484]:   <uuid>29855792-6422-4626-ae64-923c346b1eb9</uuid>
Aug 14 13:42:51 user nova-compute[73484]:   <name>instance-00000015</name>
Aug 14 13:42:51 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:42:51 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:42:51 user nova-compute[73484]:   <metadata>
Aug 14 13:42:51 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:42:51 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:42:51 user nova-compute[73484]:       <nova:name>tempest-ServersNegativeTestJSON-server-1103453138</nova:name>
Aug 14 13:42:51 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:42:51</nova:creationTime>
Aug 14 13:42:51 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:42:51 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:42:51 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:42:51 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:42:51 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:42:51 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:42:51 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:42:51 user nova-compute[73484]:       <nova:owner>
Aug 14 13:42:51 user nova-compute[73484]:         <nova:user uuid="33fea6b1b7dd4b2297bac12011f57a17">tempest-ServersNegativeTestJSON-287955364-project-member</nova:user>
Aug 14 13:42:51 user nova-compute[73484]:         <nova:project uuid="76ff7afafc2d4b1fa74902cdf0ce08d6">tempest-ServersNegativeTestJSON-287955364</nova:project>
Aug 14 13:42:51 user nova-compute[73484]:       </nova:owner>
Aug 14 13:42:51 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:42:51 user nova-compute[73484]:       <nova:ports>
Aug 14 13:42:51 user nova-compute[73484]:         <nova:port uuid="2c48d537-2b53-4807-a789-e7444e76ca45">
Aug 14 13:42:51 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 13:42:51 user nova-compute[73484]:         </nova:port>
Aug 14 13:42:51 user nova-compute[73484]:       </nova:ports>
Aug 14 13:42:51 user nova-compute[73484]:     </nova:instance>
Aug 14 13:42:51 user nova-compute[73484]:   </metadata>
Aug 14 13:42:51 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:42:51 user nova-compute[73484]:     <system>
Aug 14 13:42:51 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:42:51 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:42:51 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:42:51 user nova-compute[73484]:       <entry name="serial">29855792-6422-4626-ae64-923c346b1eb9</entry>
Aug 14 13:42:51 user nova-compute[73484]:       <entry name="uuid">29855792-6422-4626-ae64-923c346b1eb9</entry>
Aug 14 13:42:51 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:42:51 user nova-compute[73484]:     </system>
Aug 14 13:42:51 user nova-compute[73484]:   </sysinfo>
Aug 14 13:42:51 user nova-compute[73484]:   <os>
Aug 14 13:42:51 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:42:51 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:42:51 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:42:51 user nova-compute[73484]:   </os>
Aug 14 13:42:51 user nova-compute[73484]:   <features>
Aug 14 13:42:51 user nova-compute[73484]:     <acpi/>
Aug 14 13:42:51 user nova-compute[73484]:     <apic/>
Aug 14 13:42:51 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:42:51 user nova-compute[73484]:   </features>
Aug 14 13:42:51 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:42:51 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:42:51 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:42:51 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:42:51 user nova-compute[73484]:   </clock>
Aug 14 13:42:51 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:42:51 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:42:51 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:42:51 user nova-compute[73484]:   </cpu>
Aug 14 13:42:51 user nova-compute[73484]:   <devices>
Aug 14 13:42:51 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:42:51 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:42:51 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/29855792-6422-4626-ae64-923c346b1eb9/disk"/>
Aug 14 13:42:51 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:42:51 user nova-compute[73484]:     </disk>
Aug 14 13:42:51 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:42:51 user nova-compute[73484]:       <mac address="fa:16:3e:80:b2:13"/>
Aug 14 13:42:51 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:42:51 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:42:51 user nova-compute[73484]:       <target dev="tap2c48d537-2b"/>
Aug 14 13:42:51 user nova-compute[73484]:     </interface>
Aug 14 13:42:51 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:42:51 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/29855792-6422-4626-ae64-923c346b1eb9/console.log" append="off"/>
Aug 14 13:42:51 user nova-compute[73484]:     </serial>
Aug 14 13:42:51 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:42:51 user nova-compute[73484]:     <video>
Aug 14 13:42:51 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:42:51 user nova-compute[73484]:     </video>
Aug 14 13:42:51 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:42:51 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:42:51 user nova-compute[73484]:     </rng>
Aug 14 13:42:51 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:42:51 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:42:51 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:42:51 user nova-compute[73484]:     </memballoon>
Aug 14 13:42:51 user nova-compute[73484]:   </devices>
Aug 14 13:42:51 user nova-compute[73484]: </domain>
Aug 14 13:42:51 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:42:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1103453138',display_name='tempest-ServersNegativeTestJSON-server-1103453138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1103453138',id=21,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76ff7afafc2d4b1fa74902cdf0ce08d6',ramdisk_id='',reservation_id='r-clk068qh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-287955364',owner_user_name='tempest-ServersNegativeTestJSON-287955364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:42:48Z,user_data=None,user_id='33fea6b1b7dd4b2297bac12011f57a17',uuid=29855792-6422-4626-ae64-923c346b1eb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c48d537-2b53-4807-a789-e7444e76ca45", "address": "fa:16:3e:80:b2:13", "network": {"id": "893008ed-2c71-42ba-bf31-28baba1b8c2c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1936284602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ff7afafc2d4b1fa74902cdf0ce08d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c48d537-2b", "ovs_interfaceid": "2c48d537-2b53-4807-a789-e7444e76ca45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Converting VIF {"id": "2c48d537-2b53-4807-a789-e7444e76ca45", "address": "fa:16:3e:80:b2:13", "network": {"id": "893008ed-2c71-42ba-bf31-28baba1b8c2c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1936284602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ff7afafc2d4b1fa74902cdf0ce08d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c48d537-2b", "ovs_interfaceid": "2c48d537-2b53-4807-a789-e7444e76ca45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:b2:13,bridge_name='br-int',has_traffic_filtering=True,id=2c48d537-2b53-4807-a789-e7444e76ca45,network=Network(893008ed-2c71-42ba-bf31-28baba1b8c2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c48d537-2b') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG os_vif [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:b2:13,bridge_name='br-int',has_traffic_filtering=True,id=2c48d537-2b53-4807-a789-e7444e76ca45,network=Network(893008ed-2c71-42ba-bf31-28baba1b8c2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c48d537-2b') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c48d537-2b, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2c48d537-2b, col_values=(('external_ids', {'iface-id': '2c48d537-2b53-4807-a789-e7444e76ca45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:b2:13', 'vm-uuid': '29855792-6422-4626-ae64-923c346b1eb9'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:51 user nova-compute[73484]: INFO os_vif [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:b2:13,bridge_name='br-int',has_traffic_filtering=True,id=2c48d537-2b53-4807-a789-e7444e76ca45,network=Network(893008ed-2c71-42ba-bf31-28baba1b8c2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c48d537-2b')
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] No VIF found with MAC fa:16:3e:80:b2:13, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-bc45fc45-0eb0-4f0c-bebf-6e97dcb169e4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-bc45fc45-0eb0-4f0c-bebf-6e97dcb169e4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.compute.manager [None req-bc45fc45-0eb0-4f0c-bebf-6e97dcb169e4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.compute.manager [None req-bc45fc45-0eb0-4f0c-bebf-6e97dcb169e4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73484) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG nova.objects.instance [None req-bc45fc45-0eb0-4f0c-bebf-6e97dcb169e4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'flavor' on Instance uuid 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:52 user nova-compute[73484]: INFO nova.compute.manager [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Rebuilding instance
Aug 14 13:42:52 user nova-compute[73484]: DEBUG nova.compute.manager [req-5c1a7f82-3d66-4609-9668-0eb626710911 req-7afd6204-7e77-4634-8d0f-8a9f90009d78 service nova] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Received event network-changed-2c48d537-2b53-4807-a789-e7444e76ca45 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:42:52 user nova-compute[73484]: DEBUG nova.compute.manager [req-5c1a7f82-3d66-4609-9668-0eb626710911 req-7afd6204-7e77-4634-8d0f-8a9f90009d78 service nova] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Refreshing instance network info cache due to event network-changed-2c48d537-2b53-4807-a789-e7444e76ca45. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:42:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5c1a7f82-3d66-4609-9668-0eb626710911 req-7afd6204-7e77-4634-8d0f-8a9f90009d78 service nova] Acquiring lock "refresh_cache-29855792-6422-4626-ae64-923c346b1eb9" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:42:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5c1a7f82-3d66-4609-9668-0eb626710911 req-7afd6204-7e77-4634-8d0f-8a9f90009d78 service nova] Acquired lock "refresh_cache-29855792-6422-4626-ae64-923c346b1eb9" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:42:52 user nova-compute[73484]: DEBUG nova.network.neutron [req-5c1a7f82-3d66-4609-9668-0eb626710911 req-7afd6204-7e77-4634-8d0f-8a9f90009d78 service nova] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Refreshing network info cache for port 2c48d537-2b53-4807-a789-e7444e76ca45 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:42:52 user nova-compute[73484]: DEBUG nova.objects.instance [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lazy-loading 'trusted_certs' on Instance uuid ed239af5-980e-42d3-8ebd-ca100ccb2708 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:42:52 user nova-compute[73484]: DEBUG nova.compute.manager [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:42:52 user nova-compute[73484]: DEBUG nova.objects.instance [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lazy-loading 'pci_requests' on Instance uuid ed239af5-980e-42d3-8ebd-ca100ccb2708 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:42:52 user nova-compute[73484]: DEBUG nova.objects.instance [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lazy-loading 'pci_devices' on Instance uuid ed239af5-980e-42d3-8ebd-ca100ccb2708 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:42:52 user nova-compute[73484]: DEBUG nova.objects.instance [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lazy-loading 'resources' on Instance uuid ed239af5-980e-42d3-8ebd-ca100ccb2708 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:42:52 user nova-compute[73484]: DEBUG nova.objects.instance [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lazy-loading 'migration_context' on Instance uuid ed239af5-980e-42d3-8ebd-ca100ccb2708 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:42:52 user nova-compute[73484]: DEBUG nova.objects.instance [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73484) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 14 13:42:52 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:52 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:52 user nova-compute[73484]: DEBUG nova.compute.manager [req-f26b8e4c-d964-4b61-9f65-9a3164c7447b req-136499f1-6397-4dcc-b3e5-d7d453e28634 service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Received event network-vif-unplugged-cfbf4211-f3cb-49ad-98dd-68029d497e5f {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:42:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f26b8e4c-d964-4b61-9f65-9a3164c7447b req-136499f1-6397-4dcc-b3e5-d7d453e28634 service nova] Acquiring lock "ed239af5-980e-42d3-8ebd-ca100ccb2708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f26b8e4c-d964-4b61-9f65-9a3164c7447b req-136499f1-6397-4dcc-b3e5-d7d453e28634 service nova] Lock "ed239af5-980e-42d3-8ebd-ca100ccb2708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f26b8e4c-d964-4b61-9f65-9a3164c7447b req-136499f1-6397-4dcc-b3e5-d7d453e28634 service nova] Lock "ed239af5-980e-42d3-8ebd-ca100ccb2708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:52 user nova-compute[73484]: DEBUG nova.compute.manager [req-f26b8e4c-d964-4b61-9f65-9a3164c7447b req-136499f1-6397-4dcc-b3e5-d7d453e28634 service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] No waiting events found dispatching network-vif-unplugged-cfbf4211-f3cb-49ad-98dd-68029d497e5f {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:42:52 user nova-compute[73484]: WARNING nova.compute.manager [req-f26b8e4c-d964-4b61-9f65-9a3164c7447b req-136499f1-6397-4dcc-b3e5-d7d453e28634 service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Received unexpected event network-vif-unplugged-cfbf4211-f3cb-49ad-98dd-68029d497e5f for instance with vm_state active and task_state rebuilding.
Aug 14 13:42:52 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:52 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:53 user nova-compute[73484]: DEBUG nova.network.neutron [req-5c1a7f82-3d66-4609-9668-0eb626710911 req-7afd6204-7e77-4634-8d0f-8a9f90009d78 service nova] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Updated VIF entry in instance network info cache for port 2c48d537-2b53-4807-a789-e7444e76ca45. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:42:53 user nova-compute[73484]: DEBUG nova.network.neutron [req-5c1a7f82-3d66-4609-9668-0eb626710911 req-7afd6204-7e77-4634-8d0f-8a9f90009d78 service nova] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Updating instance_info_cache with network_info: [{"id": "2c48d537-2b53-4807-a789-e7444e76ca45", "address": "fa:16:3e:80:b2:13", "network": {"id": "893008ed-2c71-42ba-bf31-28baba1b8c2c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1936284602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ff7afafc2d4b1fa74902cdf0ce08d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c48d537-2b", "ovs_interfaceid": "2c48d537-2b53-4807-a789-e7444e76ca45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:42:53 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Instance destroyed successfully.
Aug 14 13:42:53 user nova-compute[73484]: DEBUG nova.compute.manager [None req-bc45fc45-0eb0-4f0c-bebf-6e97dcb169e4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:42:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5c1a7f82-3d66-4609-9668-0eb626710911 req-7afd6204-7e77-4634-8d0f-8a9f90009d78 service nova] Releasing lock "refresh_cache-29855792-6422-4626-ae64-923c346b1eb9" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:42:53 user nova-compute[73484]: DEBUG nova.compute.manager [req-5c1a7f82-3d66-4609-9668-0eb626710911 req-7afd6204-7e77-4634-8d0f-8a9f90009d78 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received event network-vif-unplugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:42:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5c1a7f82-3d66-4609-9668-0eb626710911 req-7afd6204-7e77-4634-8d0f-8a9f90009d78 service nova] Acquiring lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5c1a7f82-3d66-4609-9668-0eb626710911 req-7afd6204-7e77-4634-8d0f-8a9f90009d78 service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5c1a7f82-3d66-4609-9668-0eb626710911 req-7afd6204-7e77-4634-8d0f-8a9f90009d78 service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:53 user nova-compute[73484]: DEBUG nova.compute.manager [req-5c1a7f82-3d66-4609-9668-0eb626710911 req-7afd6204-7e77-4634-8d0f-8a9f90009d78 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] No waiting events found dispatching network-vif-unplugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:42:53 user nova-compute[73484]: WARNING nova.compute.manager [req-5c1a7f82-3d66-4609-9668-0eb626710911 req-7afd6204-7e77-4634-8d0f-8a9f90009d78 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received unexpected event network-vif-unplugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a for instance with vm_state active and task_state powering-off.
Aug 14 13:42:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-bc45fc45-0eb0-4f0c-bebf-6e97dcb169e4 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.744s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:53 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Instance destroyed successfully.
Aug 14 13:42:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:53 user nova-compute[73484]: INFO nova.compute.manager [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Detaching volume ed64de01-c957-421a-9664-569069202f9b
Aug 14 13:42:53 user nova-compute[73484]: INFO nova.virt.block_device [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Attempting to driver detach volume ed64de01-c957-421a-9664-569069202f9b from mountpoint /dev/vdb
Aug 14 13:42:53 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Attempting to detach device vdb from instance ed239af5-980e-42d3-8ebd-ca100ccb2708 from the persistent domain config. {{(pid=73484) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 13:42:53 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:42:53 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:42:53 user nova-compute[73484]:   <source dev="/dev/sde"/>
Aug 14 13:42:53 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:42:53 user nova-compute[73484]:   <serial>ed64de01-c957-421a-9664-569069202f9b</serial>
Aug 14 13:42:53 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 13:42:53 user nova-compute[73484]: </disk>
Aug 14 13:42:53 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:42:53 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Successfully detached device vdb from instance ed239af5-980e-42d3-8ebd-ca100ccb2708 from the persistent domain config.
Aug 14 13:42:53 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNEtDAag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:42:54 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[53554e04-648f-4f99-b998-5fa05eac566d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[53571b83-4a29-410e-809e-6246132745d9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:42:54 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:42:54 user nova-compute[73484]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:42:54 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:42:54 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:42:54 user nova-compute[73484]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:42:54 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4587dfa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b'): ({'sde'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Removing single pathed devices sde {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9a855c-134c-4d12-a36f-a35ef0143a50]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b280384-3d6d-42fa-a2a6-7faf68b8e5d0]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Flushing IO for device /dev/sde {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[413fdec7-a973-4a59-b25f-679771634b38]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG nova.compute.manager [req-d4025ffb-3689-4a26-9a57-eba484359867 req-14010fd3-43e0-499f-a82c-55533526f188 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received event network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d4025ffb-3689-4a26-9a57-eba484359867 req-14010fd3-43e0-499f-a82c-55533526f188 service nova] Acquiring lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d4025ffb-3689-4a26-9a57-eba484359867 req-14010fd3-43e0-499f-a82c-55533526f188 service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d4025ffb-3689-4a26-9a57-eba484359867 req-14010fd3-43e0-499f-a82c-55533526f188 service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG nova.compute.manager [req-d4025ffb-3689-4a26-9a57-eba484359867 req-14010fd3-43e0-499f-a82c-55533526f188 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] No waiting events found dispatching network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:42:54 user nova-compute[73484]: WARNING nova.compute.manager [req-d4025ffb-3689-4a26-9a57-eba484359867 req-14010fd3-43e0-499f-a82c-55533526f188 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received unexpected event network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a for instance with vm_state stopped and task_state None.
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[855f293b-8aaa-4b98-8c71-bfdf79c6c121]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG nova.compute.manager [req-94ab6984-605d-4a89-bd00-7fc3aebd7547 req-6d8a0c78-9d6c-4785-8434-59d4f2f47895 service nova] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Received event network-vif-plugged-2c48d537-2b53-4807-a789-e7444e76ca45 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-94ab6984-605d-4a89-bd00-7fc3aebd7547 req-6d8a0c78-9d6c-4785-8434-59d4f2f47895 service nova] Acquiring lock "29855792-6422-4626-ae64-923c346b1eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-94ab6984-605d-4a89-bd00-7fc3aebd7547 req-6d8a0c78-9d6c-4785-8434-59d4f2f47895 service nova] Lock "29855792-6422-4626-ae64-923c346b1eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-94ab6984-605d-4a89-bd00-7fc3aebd7547 req-6d8a0c78-9d6c-4785-8434-59d4f2f47895 service nova] Lock "29855792-6422-4626-ae64-923c346b1eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG nova.compute.manager [req-94ab6984-605d-4a89-bd00-7fc3aebd7547 req-6d8a0c78-9d6c-4785-8434-59d4f2f47895 service nova] [instance: 29855792-6422-4626-ae64-923c346b1eb9] No waiting events found dispatching network-vif-plugged-2c48d537-2b53-4807-a789-e7444e76ca45 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:42:54 user nova-compute[73484]: WARNING nova.compute.manager [req-94ab6984-605d-4a89-bd00-7fc3aebd7547 req-6d8a0c78-9d6c-4785-8434-59d4f2f47895 service nova] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Received unexpected event network-vif-plugged-2c48d537-2b53-4807-a789-e7444e76ca45 for instance with vm_state building and task_state spawning.
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] SCSI volumes sde have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bfb8b4-f7a6-45eb-9b30-7a412e8cb563]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db0dcc4-5309-4b52-9f1c-823d97776279]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b, portal: 172.16.0.220,3260]
Aug 14 13:42:54 user nova-compute[73484]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b, portal: 172.16.0.220,3260] successful.
Aug 14 13:42:54 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4af1d9-59f4-4ea8-a2aa-3e8e0f14aa3c]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] <== disconnect_volume: return (361ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG nova.compute.manager [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:42:54 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Creating image(s)
Aug 14 13:42:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Did not create local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Ensure instance console log exists: /opt/stack/data/nova/instances/8a3b8885-1940-4a92-82f4-c65c84bbf11e/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Start _get_guest_xml network_info=[{"id": "ec36c6e8-45d2-469b-b874-e9d3a10314f9", "address": "fa:16:3e:bf:2c:42", "network": {"id": "cf1afc3e-d2cd-48ff-b311-1c7415960df4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-690860686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec36c6e8-45", "ovs_interfaceid": "ec36c6e8-45d2-469b-b874-e9d3a10314f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "address": "fa:16:3e:7c:c1:ab", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5259f8bf-c5", "ovs_interfaceid": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45079f89-4586-4c56-824b-cf112200e102", "address": "fa:16:3e:16:d7:b1", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45079f89-45", "ovs_interfaceid": "45079f89-4586-4c56-824b-cf112200e102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "address": "fa:16:3e:fe:36:1f", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ddd484-97", "ovs_interfaceid": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f8f67d05-60f1-4a23-afdb-f26e4d8976ed", "address": "fa:16:3e:c4:ff:42", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f67d05-60", "ovs_interfaceid": "f8f67d05-60f1-4a23-afdb-f26e4d8976ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b192f20f-10a5-4370-8e81-4a6faa679942", "address": "fa:16:3e:38:e6:44", "network": {"id": "1511c9d9-7c94-4100-811f-af762219ba90", "bridge": "br-int", "label": "tempest-device-tagging-net2-709970726", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb192f20f-10", "ovs_interfaceid": "b192f20f-10a5-4370-8e81-4a6faa679942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4", "address": "fa:16:3e:f2:f3:58", "network": {"id": "1511c9d9-7c94-4100-811f-af762219ba90", "bridge": "br-int", "label": "tempest-device-tagging-net2-709970726", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda15c9a3-5f", "ovs_interfaceid": "da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9d888231-e1bf-47af-9aa4-2cf3add9fa79', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMwHfiXQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8a3b8885-1940-4a92-82f4-c65c84bbf11e', 'attached_at': '', 'detached_at': '', 'volume_id': '044c4ce7-3e17-43b4-8d37-7d9b371bad8a', 'serial': '044c4ce7-3e17-43b4-8d37-7d9b371bad8a'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}, {'attachment_id': '2d9d64a4-8782-448c-a1e9-b53c2b5d6a45', 'guest_format': None, 'boot_index': 1, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iGnqtlAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8a3b8885-1940-4a92-82f4-c65c84bbf11e', 'attached_at': '', 'detached_at': '', 'volume_id': '67a997e7-86e6-47a2-b8f1-7f783c53f9d3', 'serial': '67a997e7-86e6-47a2-b8f1-7f783c53f9d3'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}, {'attachment_id': '34438326-7829-48d9-bf84-040216526520', 'guest_format': None, 'boot_index': 2, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXFLJfej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8a3b8885-1940-4a92-82f4-c65c84bbf11e', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5662fa5-2d57-4576-baf1-6ebdd75d0467', 'serial': 'b5662fa5-2d57-4576-baf1-6ebdd75d0467'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:42:54 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:42:54 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:42:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMwHfiXQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:42:54 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:42:54 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:42:54 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4bfdcd-5497-457f-bf6b-0681b22b179b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:42:54 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6323f2a-87ed-4a2a-b25a-b9d651726282]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a] added
Aug 14 13:42:54 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4970fee-bd2a-4fa9-9323-4c0b4161a499]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d310cd-ccd3-41f2-988f-697aa1ebcd3a]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lMwHfiXQ {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lMwHfiXQ" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e7458a-b979-4a42-8a25-2655686d92ae]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lMwHfiXQ'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2648bca-c64c-4bb2-85da-2ae65d0d94bd]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[5823ee2f-2a77-4684-ad50-40c36d4c72a4]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:42:54 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:42:54 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:42:54 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:42:54 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG nova.compute.manager [req-42d35357-3e60-4b06-a57b-c25320e13b22 req-6a1313dd-b978-4f8e-b2ec-3991c267360a service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Received event network-vif-plugged-cfbf4211-f3cb-49ad-98dd-68029d497e5f {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-42d35357-3e60-4b06-a57b-c25320e13b22 req-6a1313dd-b978-4f8e-b2ec-3991c267360a service nova] Acquiring lock "ed239af5-980e-42d3-8ebd-ca100ccb2708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-42d35357-3e60-4b06-a57b-c25320e13b22 req-6a1313dd-b978-4f8e-b2ec-3991c267360a service nova] Lock "ed239af5-980e-42d3-8ebd-ca100ccb2708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-42d35357-3e60-4b06-a57b-c25320e13b22 req-6a1313dd-b978-4f8e-b2ec-3991c267360a service nova] Lock "ed239af5-980e-42d3-8ebd-ca100ccb2708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG nova.compute.manager [req-42d35357-3e60-4b06-a57b-c25320e13b22 req-6a1313dd-b978-4f8e-b2ec-3991c267360a service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] No waiting events found dispatching network-vif-plugged-cfbf4211-f3cb-49ad-98dd-68029d497e5f {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:42:54 user nova-compute[73484]: WARNING nova.compute.manager [req-42d35357-3e60-4b06-a57b-c25320e13b22 req-6a1313dd-b978-4f8e-b2ec-3991c267360a service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Received unexpected event network-vif-plugged-cfbf4211-f3cb-49ad-98dd-68029d497e5f for instance with vm_state active and task_state rebuilding.
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc516634-dd75-4a3d-955c-0046b6257504]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a, portal: 172.16.0.220,3260]
Aug 14 13:42:54 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a, portal: 172.16.0.220,3260] successful.
Aug 14 13:42:54 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91ca104-a028-446f-b2a9-eb7535273aca]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1666b6-7df0-40a9-897f-68cd867824fb]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:42:54 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:42:54 user nova-compute[73484]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)
Aug 14 13:42:54 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:42:54 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:42:54 user nova-compute[73484]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)
Aug 14 13:42:54 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[670af6dc-17b0-4c6d-bbc1-e85c1474a7a6]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:42:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMwHfiXQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:42:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:55 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Instance destroyed successfully.
Aug 14 13:42:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-808860414',display_name='tempest-ServerActionsTestOtherA-server-319727995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-808860414',id=15,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeXNpb9XHaUrVlh12GX9afYS4uhArSHw3Bmb57wtkUnIoEAuE3Mh/kr8GY8u6/64wrETW58CSBoYMy9LyrbLjI8XQndUnGuUz3mUsWp7LyaF/HaeOtI27YfARpw+mLtGw==',key_name='tempest-keypair-1210865444',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:40:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ff9e3bd3df8a408e96e9054775c3cb83',ramdisk_id='',reservation_id='r-vq274olh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2033458528',owner_user_name='tempest-ServerActionsTestOtherA-2033458528-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:42:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b22dfe5647e149a5b3a19d843f0efd66',uuid=ed239af5-980e-42d3-8ebd-ca100ccb2708,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "address": "fa:16:3e:c9:13:42", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbf4211-f3", "ovs_interfaceid": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:42:55 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Converting VIF {"id": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "address": "fa:16:3e:c9:13:42", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbf4211-f3", "ovs_interfaceid": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:42:55 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:13:42,bridge_name='br-int',has_traffic_filtering=True,id=cfbf4211-f3cb-49ad-98dd-68029d497e5f,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbf4211-f3') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:42:55 user nova-compute[73484]: DEBUG os_vif [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:13:42,bridge_name='br-int',has_traffic_filtering=True,id=cfbf4211-f3cb-49ad-98dd-68029d497e5f,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbf4211-f3') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:42:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcfbf4211-f3, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:42:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:42:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:55 user nova-compute[73484]: INFO os_vif [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:13:42,bridge_name='br-int',has_traffic_filtering=True,id=cfbf4211-f3cb-49ad-98dd-68029d497e5f,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbf4211-f3')
Aug 14 13:42:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:42:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNEtDAag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:42:55 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 13:42:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:42:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:42:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23634663533326237', 'path': '/dev/sdd'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:42:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634663533326237', 'path': '/dev/sdd'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:42:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.691s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:42:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:42:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ee910e-aa74-4b7a-94ac-0f4f21c59f73]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iGnqtlAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:42:56 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da92a08-21c0-4d7e-8312-4da713f821d9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:42:56 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:42:56 user nova-compute[73484]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)
Aug 14 13:42:56 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:42:56 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:42:56 user nova-compute[73484]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)
Aug 14 13:42:56 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc458337760>, {}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Disconnecting from: [] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.078s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] <== disconnect_volume: return (769ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:42:56 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Deleting instance files /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708_del
Aug 14 13:42:56 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Deletion of /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708_del complete
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.048s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:42:56 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:42:56 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020576.100711, 29855792-6422-4626-ae64-923c346b1eb9 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:42:56 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 29855792-6422-4626-ae64-923c346b1eb9] VM Resumed (Lifecycle Event)
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db20b8f-1e10-44c3-9c93-86a449d6e0a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:42:56 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:42:56 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Instance spawned successfully.
Aug 14 13:42:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4c6089-442a-4915-b515-403aa30b1575]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3] added
Aug 14 13:42:56 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[637ecd31-58c4-4c06-9ecf-17eb098838e6]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:56 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 29855792-6422-4626-ae64-923c346b1eb9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:42:56 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020576.1011717, 29855792-6422-4626-ae64-923c346b1eb9 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:42:56 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 29855792-6422-4626-ae64-923c346b1eb9] VM Started (Lifecycle Event)
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b7e74e-8446-4733-a16b-a920346d2572]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iGnqtlAV {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iGnqtlAV" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[222f5083-6168-4f91-8681-765d2e6450fc]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iGnqtlAV'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:56 user nova-compute[73484]: INFO nova.virt.block_device [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Booting with volume ed64de01-c957-421a-9664-569069202f9b at /dev/vdb
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f0909a-1b41-48a3-a59a-3e4c03973c81]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:56 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 29855792-6422-4626-ae64-923c346b1eb9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:56 user nova-compute[73484]: INFO nova.compute.manager [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Took 7.43 seconds to spawn the instance on the hypervisor.
Aug 14 13:42:56 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1326efa8-30fb-4b6a-acae-23b944e28fa0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:42:56 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:42:56 user nova-compute[73484]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)
Aug 14 13:42:56 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:42:56 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:42:56 user nova-compute[73484]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)
Aug 14 13:42:56 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG nova.compute.manager [req-3f6a110d-7c87-418b-b02e-36d12d307f67 req-dc1c18e0-129b-4e8f-88ae-2d5f2e8bba24 service nova] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Received event network-vif-plugged-2c48d537-2b53-4807-a789-e7444e76ca45 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3f6a110d-7c87-418b-b02e-36d12d307f67 req-dc1c18e0-129b-4e8f-88ae-2d5f2e8bba24 service nova] Acquiring lock "29855792-6422-4626-ae64-923c346b1eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3f6a110d-7c87-418b-b02e-36d12d307f67 req-dc1c18e0-129b-4e8f-88ae-2d5f2e8bba24 service nova] Lock "29855792-6422-4626-ae64-923c346b1eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3f6a110d-7c87-418b-b02e-36d12d307f67 req-dc1c18e0-129b-4e8f-88ae-2d5f2e8bba24 service nova] Lock "29855792-6422-4626-ae64-923c346b1eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG nova.compute.manager [req-3f6a110d-7c87-418b-b02e-36d12d307f67 req-dc1c18e0-129b-4e8f-88ae-2d5f2e8bba24 service nova] [instance: 29855792-6422-4626-ae64-923c346b1eb9] No waiting events found dispatching network-vif-plugged-2c48d537-2b53-4807-a789-e7444e76ca45 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:42:56 user nova-compute[73484]: WARNING nova.compute.manager [req-3f6a110d-7c87-418b-b02e-36d12d307f67 req-dc1c18e0-129b-4e8f-88ae-2d5f2e8bba24 service nova] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Received unexpected event network-vif-plugged-2c48d537-2b53-4807-a789-e7444e76ca45 for instance with vm_state building and task_state spawning.
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.utils [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4485bbce-fd1a-4691-ae16-d0393b0ee780]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:56 user nova-compute[73484]: INFO nova.compute.manager [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Took 8.95 seconds to build instance.
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc3159f-26ec-4958-bc18-67807e647076]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3, portal: 172.16.0.220,3260]
Aug 14 13:42:56 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3, portal: 172.16.0.220,3260] successful.
Aug 14 13:42:56 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a57dd566-15ef-4e7d-ba96-ec400f3cbc69 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "29855792-6422-4626-ae64-923c346b1eb9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.046s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.039s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a400d42-414e-4c9c-9bb3-8cfdfe960623]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c720f1a-55cc-4666-82b9-45d800e67baf]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db0d531-68b0-4638-8ab0-ec6ea5804c43]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d160c05-8536-4147-8242-1eee83b13266]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf34634-aff8-457d-a80c-3e8f45f16861]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:42:56 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:42:56 user nova-compute[73484]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)
Aug 14 13:42:56 user nova-compute[73484]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)
Aug 14 13:42:56 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:42:56 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:42:56 user nova-compute[73484]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)
Aug 14 13:42:56 user nova-compute[73484]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)
Aug 14 13:42:56 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:42:56 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5c301d-8a36-4eb1-9665-20d41b6f1b31]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.utils [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Updating existing volume attachment record: cdacafbe-df6d-4460-8de2-9ef850919837 {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e171b44-0ee9-43ae-a49f-9f610d47d708]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:42:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iGnqtlAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.456s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] <== connect_volume: return (1505ms) {'type': 'block', 'scsi_wwn': '23431643962336635', 'path': '/dev/sde'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431643962336635', 'path': '/dev/sde'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXFLJfej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:42:57 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:42:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:42:57 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:42:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:42:57 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2221a32-6801-46a2-a67a-32580f0c824c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:42:57 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0012101f-3bdb-49e4-b4d1-701976f52586]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467] added
Aug 14 13:42:57 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3c569f-4ad1-498a-9455-6fc9375ed4fb]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b8c038-91b0-4cf5-8838-c16f205367ba]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tXFLJfej {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tXFLJfej" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[de980cb5-57c3-4779-8217-49f9f3f2f603]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tXFLJfej'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8324dbce-2c1e-4fc9-807b-bea8099b9fbb]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0207d33-ea83-4b05-8af5-f28ccc70c187]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:42:57 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:42:57 user nova-compute[73484]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)
Aug 14 13:42:57 user nova-compute[73484]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)
Aug 14 13:42:57 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:42:57 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:42:57 user nova-compute[73484]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)
Aug 14 13:42:57 user nova-compute[73484]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)
Aug 14 13:42:57 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2f44d1-69ce-4521-9055-23b30b39d538]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467, portal: 172.16.0.220,3260]
Aug 14 13:42:57 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467, portal: 172.16.0.220,3260] successful.
Aug 14 13:42:57 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf5ea1e-5029-4802-8556-b0d3dd75a596]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e28338-d301-413f-bc53-e55e731ee9bc]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:42:57 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:42:57 user nova-compute[73484]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)
Aug 14 13:42:57 user nova-compute[73484]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)
Aug 14 13:42:57 user nova-compute[73484]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 (non-flash)
Aug 14 13:42:57 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:42:57 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:42:57 user nova-compute[73484]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)
Aug 14 13:42:57 user nova-compute[73484]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)
Aug 14 13:42:57 user nova-compute[73484]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 (non-flash)
Aug 14 13:42:57 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] HCTL ('37', '-', '-', 0) found on session 23 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1672e78-d0a3-4fd9-93fd-fac596f4a5d5]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Searching for a device in session 23 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:42:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXFLJfej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:42:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:42:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23038663562356333', 'path': '/dev/sdf'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:42:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038663562356333', 'path': '/dev/sdf'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:42:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:42:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-887610754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-887610754',id=19,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi0gS+WpIKrgrS0mV0bR1l62g9OmjDCiprCWZONRUMZMQmvGO1TchMpbMfyKFCnzFTqOV6VmF0HLgUjtWXXpnGjIQdt8wNFklgDRvpfiHHZ16Ur5FAWNB3hO3OjZ335hw==',key_name='tempest-keypair-672802766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8d4635233ed41bca48d5dc2a709b076',ramdisk_id='',reservation_id='r-3ylp5ayp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1908642749',owner_user_name='tempest-TaggedBootDevicesTest-1908642749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729ad05102d7403e8aaa34a6c17f1a1d',uuid=8a3b8885-1940-4a92-82f4-c65c84bbf11e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec36c6e8-45d2-469b-b874-e9d3a10314f9", "address": "fa:16:3e:bf:2c:42", "network": {"id": "cf1afc3e-d2cd-48ff-b311-1c7415960df4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-690860686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec36c6e8-45", "ovs_interfaceid": "ec36c6e8-45d2-469b-b874-e9d3a10314f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:42:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converting VIF {"id": "ec36c6e8-45d2-469b-b874-e9d3a10314f9", "address": "fa:16:3e:bf:2c:42", "network": {"id": "cf1afc3e-d2cd-48ff-b311-1c7415960df4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-690860686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec36c6e8-45", "ovs_interfaceid": "ec36c6e8-45d2-469b-b874-e9d3a10314f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:42:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:2c:42,bridge_name='br-int',has_traffic_filtering=True,id=ec36c6e8-45d2-469b-b874-e9d3a10314f9,network=Network(cf1afc3e-d2cd-48ff-b311-1c7415960df4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec36c6e8-45') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:42:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:42:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-887610754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-887610754',id=19,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi0gS+WpIKrgrS0mV0bR1l62g9OmjDCiprCWZONRUMZMQmvGO1TchMpbMfyKFCnzFTqOV6VmF0HLgUjtWXXpnGjIQdt8wNFklgDRvpfiHHZ16Ur5FAWNB3hO3OjZ335hw==',key_name='tempest-keypair-672802766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8d4635233ed41bca48d5dc2a709b076',ramdisk_id='',reservation_id='r-3ylp5ayp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1908642749',owner_user_name='tempest-TaggedBootDevicesTest-1908642749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729ad05102d7403e8aaa34a6c17f1a1d',uuid=8a3b8885-1940-4a92-82f4-c65c84bbf11e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "address": "fa:16:3e:7c:c1:ab", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5259f8bf-c5", "ovs_interfaceid": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:42:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converting VIF {"id": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "address": "fa:16:3e:7c:c1:ab", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5259f8bf-c5", "ovs_interfaceid": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:42:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c1:ab,bridge_name='br-int',has_traffic_filtering=True,id=5259f8bf-c556-4ac0-9587-1633b3cf47e4,network=Network(cca9bd37-0d08-4714-a528-3c47a406ad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5259f8bf-c5') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:42:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:42:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-887610754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-887610754',id=19,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi0gS+WpIKrgrS0mV0bR1l62g9OmjDCiprCWZONRUMZMQmvGO1TchMpbMfyKFCnzFTqOV6VmF0HLgUjtWXXpnGjIQdt8wNFklgDRvpfiHHZ16Ur5FAWNB3hO3OjZ335hw==',key_name='tempest-keypair-672802766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8d4635233ed41bca48d5dc2a709b076',ramdisk_id='',reservation_id='r-3ylp5ayp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1908642749',owner_user_name='tempest-TaggedBootDevicesTest-1908642749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729ad05102d7403e8aaa34a6c17f1a1d',uuid=8a3b8885-1940-4a92-82f4-c65c84bbf11e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45079f89-4586-4c56-824b-cf112200e102", "address": "fa:16:3e:16:d7:b1", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45079f89-45", "ovs_interfaceid": "45079f89-4586-4c56-824b-cf112200e102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:42:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converting VIF {"id": "45079f89-4586-4c56-824b-cf112200e102", "address": "fa:16:3e:16:d7:b1", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45079f89-45", "ovs_interfaceid": "45079f89-4586-4c56-824b-cf112200e102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:42:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:d7:b1,bridge_name='br-int',has_traffic_filtering=True,id=45079f89-4586-4c56-824b-cf112200e102,network=Network(cca9bd37-0d08-4714-a528-3c47a406ad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap45079f89-45') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:42:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:42:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-887610754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-887610754',id=19,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi0gS+WpIKrgrS0mV0bR1l62g9OmjDCiprCWZONRUMZMQmvGO1TchMpbMfyKFCnzFTqOV6VmF0HLgUjtWXXpnGjIQdt8wNFklgDRvpfiHHZ16Ur5FAWNB3hO3OjZ335hw==',key_name='tempest-keypair-672802766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8d4635233ed41bca48d5dc2a709b076',ramdisk_id='',reservation_id='r-3ylp5ayp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1908642749',owner_user_name='tempest-TaggedBootDevicesTest-1908642749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729ad05102d7403e8aaa34a6c17f1a1d',uuid=8a3b8885-1940-4a92-82f4-c65c84bbf11e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "address": "fa:16:3e:fe:36:1f", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ddd484-97", "ovs_interfaceid": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:42:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converting VIF {"id": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "address": "fa:16:3e:fe:36:1f", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ddd484-97", "ovs_interfaceid": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:42:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:36:1f,bridge_name='br-int',has_traffic_filtering=True,id=e1ddd484-97b4-4cfe-be1e-a3be0128bfdb,network=Network(cca9bd37-0d08-4714-a528-3c47a406ad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1ddd484-97') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:42:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:42:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-887610754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-887610754',id=19,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi0gS+WpIKrgrS0mV0bR1l62g9OmjDCiprCWZONRUMZMQmvGO1TchMpbMfyKFCnzFTqOV6VmF0HLgUjtWXXpnGjIQdt8wNFklgDRvpfiHHZ16Ur5FAWNB3hO3OjZ335hw==',key_name='tempest-keypair-672802766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8d4635233ed41bca48d5dc2a709b076',ramdisk_id='',reservation_id='r-3ylp5ayp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1908642749',owner_user_name='tempest-TaggedBootDevicesTest-1908642749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729ad05102d7403e8aaa34a6c17f1a1d',uuid=8a3b8885-1940-4a92-82f4-c65c84bbf11e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8f67d05-60f1-4a23-afdb-f26e4d8976ed", "address": "fa:16:3e:c4:ff:42", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f67d05-60", "ovs_interfaceid": "f8f67d05-60f1-4a23-afdb-f26e4d8976ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:42:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converting VIF {"id": "f8f67d05-60f1-4a23-afdb-f26e4d8976ed", "address": "fa:16:3e:c4:ff:42", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f67d05-60", "ovs_interfaceid": "f8f67d05-60f1-4a23-afdb-f26e4d8976ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:42:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:ff:42,bridge_name='br-int',has_traffic_filtering=True,id=f8f67d05-60f1-4a23-afdb-f26e4d8976ed,network=Network(cca9bd37-0d08-4714-a528-3c47a406ad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8f67d05-60') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:42:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:42:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-887610754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-887610754',id=19,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi0gS+WpIKrgrS0mV0bR1l62g9OmjDCiprCWZONRUMZMQmvGO1TchMpbMfyKFCnzFTqOV6VmF0HLgUjtWXXpnGjIQdt8wNFklgDRvpfiHHZ16Ur5FAWNB3hO3OjZ335hw==',key_name='tempest-keypair-672802766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8d4635233ed41bca48d5dc2a709b076',ramdisk_id='',reservation_id='r-3ylp5ayp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1908642749',owner_user_name='tempest-TaggedBootDevicesTest-1908642749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729ad05102d7403e8aaa34a6c17f1a1d',uuid=8a3b8885-1940-4a92-82f4-c65c84bbf11e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b192f20f-10a5-4370-8e81-4a6faa679942", "address": "fa:16:3e:38:e6:44", "network": {"id": "1511c9d9-7c94-4100-811f-af762219ba90", "bridge": "br-int", "label": "tempest-device-tagging-net2-709970726", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb192f20f-10", "ovs_interfaceid": "b192f20f-10a5-4370-8e81-4a6faa679942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converting VIF {"id": "b192f20f-10a5-4370-8e81-4a6faa679942", "address": "fa:16:3e:38:e6:44", "network": {"id": "1511c9d9-7c94-4100-811f-af762219ba90", "bridge": "br-int", "label": "tempest-device-tagging-net2-709970726", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb192f20f-10", "ovs_interfaceid": "b192f20f-10a5-4370-8e81-4a6faa679942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:e6:44,bridge_name='br-int',has_traffic_filtering=True,id=b192f20f-10a5-4370-8e81-4a6faa679942,network=Network(1511c9d9-7c94-4100-811f-af762219ba90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb192f20f-10') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:42:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-887610754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-887610754',id=19,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi0gS+WpIKrgrS0mV0bR1l62g9OmjDCiprCWZONRUMZMQmvGO1TchMpbMfyKFCnzFTqOV6VmF0HLgUjtWXXpnGjIQdt8wNFklgDRvpfiHHZ16Ur5FAWNB3hO3OjZ335hw==',key_name='tempest-keypair-672802766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8d4635233ed41bca48d5dc2a709b076',ramdisk_id='',reservation_id='r-3ylp5ayp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1908642749',owner_user_name='tempest-TaggedBootDevicesTest-1908642749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729ad05102d7403e8aaa34a6c17f1a1d',uuid=8a3b8885-1940-4a92-82f4-c65c84bbf11e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4", "address": "fa:16:3e:f2:f3:58", "network": {"id": "1511c9d9-7c94-4100-811f-af762219ba90", "bridge": "br-int", "label": "tempest-device-tagging-net2-709970726", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda15c9a3-5f", "ovs_interfaceid": "da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converting VIF {"id": "da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4", "address": "fa:16:3e:f2:f3:58", "network": {"id": "1511c9d9-7c94-4100-811f-af762219ba90", "bridge": "br-int", "label": "tempest-device-tagging-net2-709970726", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda15c9a3-5f", "ovs_interfaceid": "da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:f3:58,bridge_name='br-int',has_traffic_filtering=True,id=da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4,network=Network(1511c9d9-7c94-4100-811f-af762219ba90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda15c9a3-5f') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.objects.instance [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a3b8885-1940-4a92-82f4-c65c84bbf11e {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:42:59 user nova-compute[73484]:   <uuid>8a3b8885-1940-4a92-82f4-c65c84bbf11e</uuid>
Aug 14 13:42:59 user nova-compute[73484]:   <name>instance-00000013</name>
Aug 14 13:42:59 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:42:59 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:42:59 user nova-compute[73484]:   <metadata>
Aug 14 13:42:59 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:42:59 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:42:59 user nova-compute[73484]:       <nova:name>tempest-device-tagging-server-887610754</nova:name>
Aug 14 13:42:59 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:42:54</nova:creationTime>
Aug 14 13:42:59 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:42:59 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:42:59 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:42:59 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:42:59 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:42:59 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:42:59 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:42:59 user nova-compute[73484]:       <nova:owner>
Aug 14 13:42:59 user nova-compute[73484]:         <nova:user uuid="729ad05102d7403e8aaa34a6c17f1a1d">tempest-TaggedBootDevicesTest-1908642749-project-member</nova:user>
Aug 14 13:42:59 user nova-compute[73484]:         <nova:project uuid="d8d4635233ed41bca48d5dc2a709b076">tempest-TaggedBootDevicesTest-1908642749</nova:project>
Aug 14 13:42:59 user nova-compute[73484]:       </nova:owner>
Aug 14 13:42:59 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:42:59 user nova-compute[73484]:       <nova:ports>
Aug 14 13:42:59 user nova-compute[73484]:         <nova:port uuid="ec36c6e8-45d2-469b-b874-e9d3a10314f9">
Aug 14 13:42:59 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 13:42:59 user nova-compute[73484]:         </nova:port>
Aug 14 13:42:59 user nova-compute[73484]:         <nova:port uuid="5259f8bf-c556-4ac0-9587-1633b3cf47e4">
Aug 14 13:42:59 user nova-compute[73484]:           <nova:ip type="fixed" address="10.1.1.178" ipVersion="4"/>
Aug 14 13:42:59 user nova-compute[73484]:         </nova:port>
Aug 14 13:42:59 user nova-compute[73484]:         <nova:port uuid="45079f89-4586-4c56-824b-cf112200e102">
Aug 14 13:42:59 user nova-compute[73484]:           <nova:ip type="fixed" address="10.1.1.206" ipVersion="4"/>
Aug 14 13:42:59 user nova-compute[73484]:         </nova:port>
Aug 14 13:42:59 user nova-compute[73484]:         <nova:port uuid="e1ddd484-97b4-4cfe-be1e-a3be0128bfdb">
Aug 14 13:42:59 user nova-compute[73484]:           <nova:ip type="fixed" address="10.1.1.91" ipVersion="4"/>
Aug 14 13:42:59 user nova-compute[73484]:         </nova:port>
Aug 14 13:42:59 user nova-compute[73484]:         <nova:port uuid="f8f67d05-60f1-4a23-afdb-f26e4d8976ed">
Aug 14 13:42:59 user nova-compute[73484]:           <nova:ip type="fixed" address="10.1.1.223" ipVersion="4"/>
Aug 14 13:42:59 user nova-compute[73484]:         </nova:port>
Aug 14 13:42:59 user nova-compute[73484]:         <nova:port uuid="b192f20f-10a5-4370-8e81-4a6faa679942">
Aug 14 13:42:59 user nova-compute[73484]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 14 13:42:59 user nova-compute[73484]:         </nova:port>
Aug 14 13:42:59 user nova-compute[73484]:         <nova:port uuid="da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4">
Aug 14 13:42:59 user nova-compute[73484]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 14 13:42:59 user nova-compute[73484]:         </nova:port>
Aug 14 13:42:59 user nova-compute[73484]:       </nova:ports>
Aug 14 13:42:59 user nova-compute[73484]:     </nova:instance>
Aug 14 13:42:59 user nova-compute[73484]:   </metadata>
Aug 14 13:42:59 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:42:59 user nova-compute[73484]:     <system>
Aug 14 13:42:59 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:42:59 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:42:59 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:42:59 user nova-compute[73484]:       <entry name="serial">8a3b8885-1940-4a92-82f4-c65c84bbf11e</entry>
Aug 14 13:42:59 user nova-compute[73484]:       <entry name="uuid">8a3b8885-1940-4a92-82f4-c65c84bbf11e</entry>
Aug 14 13:42:59 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:42:59 user nova-compute[73484]:     </system>
Aug 14 13:42:59 user nova-compute[73484]:   </sysinfo>
Aug 14 13:42:59 user nova-compute[73484]:   <os>
Aug 14 13:42:59 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:42:59 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:42:59 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:42:59 user nova-compute[73484]:   </os>
Aug 14 13:42:59 user nova-compute[73484]:   <features>
Aug 14 13:42:59 user nova-compute[73484]:     <acpi/>
Aug 14 13:42:59 user nova-compute[73484]:     <apic/>
Aug 14 13:42:59 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:42:59 user nova-compute[73484]:   </features>
Aug 14 13:42:59 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:42:59 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:42:59 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:42:59 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:42:59 user nova-compute[73484]:   </clock>
Aug 14 13:42:59 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:42:59 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:42:59 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:42:59 user nova-compute[73484]:   </cpu>
Aug 14 13:42:59 user nova-compute[73484]:   <devices>
Aug 14 13:42:59 user nova-compute[73484]:     <disk type="file" device="cdrom">
Aug 14 13:42:59 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 13:42:59 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/8a3b8885-1940-4a92-82f4-c65c84bbf11e/disk.config"/>
Aug 14 13:42:59 user nova-compute[73484]:       <target dev="hda" bus="ide"/>
Aug 14 13:42:59 user nova-compute[73484]:     </disk>
Aug 14 13:42:59 user nova-compute[73484]:     <disk type="block" device="disk">
Aug 14 13:42:59 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:42:59 user nova-compute[73484]:       <source dev="/dev/sdd"/>
Aug 14 13:42:59 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:42:59 user nova-compute[73484]:       <serial>044c4ce7-3e17-43b4-8d37-7d9b371bad8a</serial>
Aug 14 13:42:59 user nova-compute[73484]:     </disk>
Aug 14 13:42:59 user nova-compute[73484]:     <disk type="block" device="disk">
Aug 14 13:42:59 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:42:59 user nova-compute[73484]:       <source dev="/dev/sde"/>
Aug 14 13:42:59 user nova-compute[73484]:       <target dev="vdb" bus="virtio"/>
Aug 14 13:42:59 user nova-compute[73484]:       <serial>67a997e7-86e6-47a2-b8f1-7f783c53f9d3</serial>
Aug 14 13:42:59 user nova-compute[73484]:     </disk>
Aug 14 13:42:59 user nova-compute[73484]:     <disk type="block" device="disk">
Aug 14 13:42:59 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:42:59 user nova-compute[73484]:       <source dev="/dev/sdf"/>
Aug 14 13:42:59 user nova-compute[73484]:       <target dev="vdc" bus="virtio"/>
Aug 14 13:42:59 user nova-compute[73484]:       <serial>b5662fa5-2d57-4576-baf1-6ebdd75d0467</serial>
Aug 14 13:42:59 user nova-compute[73484]:     </disk>
Aug 14 13:42:59 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:42:59 user nova-compute[73484]:       <mac address="fa:16:3e:bf:2c:42"/>
Aug 14 13:42:59 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:42:59 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:42:59 user nova-compute[73484]:       <target dev="tapec36c6e8-45"/>
Aug 14 13:42:59 user nova-compute[73484]:     </interface>
Aug 14 13:42:59 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:42:59 user nova-compute[73484]:       <mac address="fa:16:3e:7c:c1:ab"/>
Aug 14 13:42:59 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:42:59 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:42:59 user nova-compute[73484]:       <target dev="tap5259f8bf-c5"/>
Aug 14 13:42:59 user nova-compute[73484]:     </interface>
Aug 14 13:42:59 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:42:59 user nova-compute[73484]:       <mac address="fa:16:3e:16:d7:b1"/>
Aug 14 13:42:59 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:42:59 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:42:59 user nova-compute[73484]:       <target dev="tap45079f89-45"/>
Aug 14 13:42:59 user nova-compute[73484]:     </interface>
Aug 14 13:42:59 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:42:59 user nova-compute[73484]:       <mac address="fa:16:3e:fe:36:1f"/>
Aug 14 13:42:59 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:42:59 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:42:59 user nova-compute[73484]:       <target dev="tape1ddd484-97"/>
Aug 14 13:42:59 user nova-compute[73484]:     </interface>
Aug 14 13:42:59 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:42:59 user nova-compute[73484]:       <mac address="fa:16:3e:c4:ff:42"/>
Aug 14 13:42:59 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:42:59 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:42:59 user nova-compute[73484]:       <target dev="tapf8f67d05-60"/>
Aug 14 13:42:59 user nova-compute[73484]:     </interface>
Aug 14 13:42:59 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:42:59 user nova-compute[73484]:       <mac address="fa:16:3e:38:e6:44"/>
Aug 14 13:42:59 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:42:59 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:42:59 user nova-compute[73484]:       <target dev="tapb192f20f-10"/>
Aug 14 13:42:59 user nova-compute[73484]:     </interface>
Aug 14 13:42:59 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:42:59 user nova-compute[73484]:       <mac address="fa:16:3e:f2:f3:58"/>
Aug 14 13:42:59 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:42:59 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:42:59 user nova-compute[73484]:       <target dev="tapda15c9a3-5f"/>
Aug 14 13:42:59 user nova-compute[73484]:     </interface>
Aug 14 13:42:59 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:42:59 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/8a3b8885-1940-4a92-82f4-c65c84bbf11e/console.log" append="off"/>
Aug 14 13:42:59 user nova-compute[73484]:     </serial>
Aug 14 13:42:59 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:42:59 user nova-compute[73484]:     <video>
Aug 14 13:42:59 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:42:59 user nova-compute[73484]:     </video>
Aug 14 13:42:59 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:42:59 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:42:59 user nova-compute[73484]:     </rng>
Aug 14 13:42:59 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:42:59 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:42:59 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:42:59 user nova-compute[73484]:     </memballoon>
Aug 14 13:42:59 user nova-compute[73484]:   </devices>
Aug 14 13:42:59 user nova-compute[73484]: </domain>
Aug 14 13:42:59 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:42:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-887610754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-887610754',id=19,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi0gS+WpIKrgrS0mV0bR1l62g9OmjDCiprCWZONRUMZMQmvGO1TchMpbMfyKFCnzFTqOV6VmF0HLgUjtWXXpnGjIQdt8wNFklgDRvpfiHHZ16Ur5FAWNB3hO3OjZ335hw==',key_name='tempest-keypair-672802766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8d4635233ed41bca48d5dc2a709b076',ramdisk_id='',reservation_id='r-3ylp5ayp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1908642749',owner_user_name='tempest-TaggedBootDevicesTest-1908642749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729ad05102d7403e8aaa34a6c17f1a1d',uuid=8a3b8885-1940-4a92-82f4-c65c84bbf11e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec36c6e8-45d2-469b-b874-e9d3a10314f9", "address": "fa:16:3e:bf:2c:42", "network": {"id": "cf1afc3e-d2cd-48ff-b311-1c7415960df4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-690860686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec36c6e8-45", "ovs_interfaceid": "ec36c6e8-45d2-469b-b874-e9d3a10314f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converting VIF {"id": "ec36c6e8-45d2-469b-b874-e9d3a10314f9", "address": "fa:16:3e:bf:2c:42", "network": {"id": "cf1afc3e-d2cd-48ff-b311-1c7415960df4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-690860686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec36c6e8-45", "ovs_interfaceid": "ec36c6e8-45d2-469b-b874-e9d3a10314f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:2c:42,bridge_name='br-int',has_traffic_filtering=True,id=ec36c6e8-45d2-469b-b874-e9d3a10314f9,network=Network(cf1afc3e-d2cd-48ff-b311-1c7415960df4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec36c6e8-45') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG os_vif [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:2c:42,bridge_name='br-int',has_traffic_filtering=True,id=ec36c6e8-45d2-469b-b874-e9d3a10314f9,network=Network(cf1afc3e-d2cd-48ff-b311-1c7415960df4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec36c6e8-45') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec36c6e8-45, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapec36c6e8-45, col_values=(('external_ids', {'iface-id': 'ec36c6e8-45d2-469b-b874-e9d3a10314f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:2c:42', 'vm-uuid': '8a3b8885-1940-4a92-82f4-c65c84bbf11e'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:59 user nova-compute[73484]: INFO os_vif [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:2c:42,bridge_name='br-int',has_traffic_filtering=True,id=ec36c6e8-45d2-469b-b874-e9d3a10314f9,network=Network(cf1afc3e-d2cd-48ff-b311-1c7415960df4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec36c6e8-45')
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:42:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-887610754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-887610754',id=19,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi0gS+WpIKrgrS0mV0bR1l62g9OmjDCiprCWZONRUMZMQmvGO1TchMpbMfyKFCnzFTqOV6VmF0HLgUjtWXXpnGjIQdt8wNFklgDRvpfiHHZ16Ur5FAWNB3hO3OjZ335hw==',key_name='tempest-keypair-672802766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8d4635233ed41bca48d5dc2a709b076',ramdisk_id='',reservation_id='r-3ylp5ayp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1908642749',owner_user_name='tempest-TaggedBootDevicesTest-1908642749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729ad05102d7403e8aaa34a6c17f1a1d',uuid=8a3b8885-1940-4a92-82f4-c65c84bbf11e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "address": "fa:16:3e:7c:c1:ab", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5259f8bf-c5", "ovs_interfaceid": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converting VIF {"id": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "address": "fa:16:3e:7c:c1:ab", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5259f8bf-c5", "ovs_interfaceid": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c1:ab,bridge_name='br-int',has_traffic_filtering=True,id=5259f8bf-c556-4ac0-9587-1633b3cf47e4,network=Network(cca9bd37-0d08-4714-a528-3c47a406ad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5259f8bf-c5') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG os_vif [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c1:ab,bridge_name='br-int',has_traffic_filtering=True,id=5259f8bf-c556-4ac0-9587-1633b3cf47e4,network=Network(cca9bd37-0d08-4714-a528-3c47a406ad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5259f8bf-c5') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5259f8bf-c5, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5259f8bf-c5, col_values=(('external_ids', {'iface-id': '5259f8bf-c556-4ac0-9587-1633b3cf47e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:c1:ab', 'vm-uuid': '8a3b8885-1940-4a92-82f4-c65c84bbf11e'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:59 user nova-compute[73484]: INFO os_vif [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c1:ab,bridge_name='br-int',has_traffic_filtering=True,id=5259f8bf-c556-4ac0-9587-1633b3cf47e4,network=Network(cca9bd37-0d08-4714-a528-3c47a406ad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5259f8bf-c5')
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:42:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-887610754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-887610754',id=19,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi0gS+WpIKrgrS0mV0bR1l62g9OmjDCiprCWZONRUMZMQmvGO1TchMpbMfyKFCnzFTqOV6VmF0HLgUjtWXXpnGjIQdt8wNFklgDRvpfiHHZ16Ur5FAWNB3hO3OjZ335hw==',key_name='tempest-keypair-672802766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8d4635233ed41bca48d5dc2a709b076',ramdisk_id='',reservation_id='r-3ylp5ayp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1908642749',owner_user_name='tempest-TaggedBootDevicesTest-1908642749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729ad05102d7403e8aaa34a6c17f1a1d',uuid=8a3b8885-1940-4a92-82f4-c65c84bbf11e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45079f89-4586-4c56-824b-cf112200e102", "address": "fa:16:3e:16:d7:b1", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45079f89-45", "ovs_interfaceid": "45079f89-4586-4c56-824b-cf112200e102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converting VIF {"id": "45079f89-4586-4c56-824b-cf112200e102", "address": "fa:16:3e:16:d7:b1", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45079f89-45", "ovs_interfaceid": "45079f89-4586-4c56-824b-cf112200e102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:d7:b1,bridge_name='br-int',has_traffic_filtering=True,id=45079f89-4586-4c56-824b-cf112200e102,network=Network(cca9bd37-0d08-4714-a528-3c47a406ad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap45079f89-45') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG os_vif [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:d7:b1,bridge_name='br-int',has_traffic_filtering=True,id=45079f89-4586-4c56-824b-cf112200e102,network=Network(cca9bd37-0d08-4714-a528-3c47a406ad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap45079f89-45') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45079f89-45, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap45079f89-45, col_values=(('external_ids', {'iface-id': '45079f89-4586-4c56-824b-cf112200e102', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:d7:b1', 'vm-uuid': '8a3b8885-1940-4a92-82f4-c65c84bbf11e'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:59 user nova-compute[73484]: INFO os_vif [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:d7:b1,bridge_name='br-int',has_traffic_filtering=True,id=45079f89-4586-4c56-824b-cf112200e102,network=Network(cca9bd37-0d08-4714-a528-3c47a406ad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap45079f89-45')
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:42:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-887610754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-887610754',id=19,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi0gS+WpIKrgrS0mV0bR1l62g9OmjDCiprCWZONRUMZMQmvGO1TchMpbMfyKFCnzFTqOV6VmF0HLgUjtWXXpnGjIQdt8wNFklgDRvpfiHHZ16Ur5FAWNB3hO3OjZ335hw==',key_name='tempest-keypair-672802766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8d4635233ed41bca48d5dc2a709b076',ramdisk_id='',reservation_id='r-3ylp5ayp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1908642749',owner_user_name='tempest-TaggedBootDevicesTest-1908642749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729ad05102d7403e8aaa34a6c17f1a1d',uuid=8a3b8885-1940-4a92-82f4-c65c84bbf11e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "address": "fa:16:3e:fe:36:1f", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ddd484-97", "ovs_interfaceid": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converting VIF {"id": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "address": "fa:16:3e:fe:36:1f", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ddd484-97", "ovs_interfaceid": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:36:1f,bridge_name='br-int',has_traffic_filtering=True,id=e1ddd484-97b4-4cfe-be1e-a3be0128bfdb,network=Network(cca9bd37-0d08-4714-a528-3c47a406ad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1ddd484-97') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG os_vif [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:36:1f,bridge_name='br-int',has_traffic_filtering=True,id=e1ddd484-97b4-4cfe-be1e-a3be0128bfdb,network=Network(cca9bd37-0d08-4714-a528-3c47a406ad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1ddd484-97') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1ddd484-97, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape1ddd484-97, col_values=(('external_ids', {'iface-id': 'e1ddd484-97b4-4cfe-be1e-a3be0128bfdb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:36:1f', 'vm-uuid': '8a3b8885-1940-4a92-82f4-c65c84bbf11e'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:59 user nova-compute[73484]: INFO os_vif [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:36:1f,bridge_name='br-int',has_traffic_filtering=True,id=e1ddd484-97b4-4cfe-be1e-a3be0128bfdb,network=Network(cca9bd37-0d08-4714-a528-3c47a406ad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1ddd484-97')
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:42:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-887610754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-887610754',id=19,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi0gS+WpIKrgrS0mV0bR1l62g9OmjDCiprCWZONRUMZMQmvGO1TchMpbMfyKFCnzFTqOV6VmF0HLgUjtWXXpnGjIQdt8wNFklgDRvpfiHHZ16Ur5FAWNB3hO3OjZ335hw==',key_name='tempest-keypair-672802766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8d4635233ed41bca48d5dc2a709b076',ramdisk_id='',reservation_id='r-3ylp5ayp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1908642749',owner_user_name='tempest-TaggedBootDevicesTest-1908642749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729ad05102d7403e8aaa34a6c17f1a1d',uuid=8a3b8885-1940-4a92-82f4-c65c84bbf11e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8f67d05-60f1-4a23-afdb-f26e4d8976ed", "address": "fa:16:3e:c4:ff:42", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f67d05-60", "ovs_interfaceid": "f8f67d05-60f1-4a23-afdb-f26e4d8976ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converting VIF {"id": "f8f67d05-60f1-4a23-afdb-f26e4d8976ed", "address": "fa:16:3e:c4:ff:42", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f67d05-60", "ovs_interfaceid": "f8f67d05-60f1-4a23-afdb-f26e4d8976ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:ff:42,bridge_name='br-int',has_traffic_filtering=True,id=f8f67d05-60f1-4a23-afdb-f26e4d8976ed,network=Network(cca9bd37-0d08-4714-a528-3c47a406ad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8f67d05-60') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG os_vif [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:ff:42,bridge_name='br-int',has_traffic_filtering=True,id=f8f67d05-60f1-4a23-afdb-f26e4d8976ed,network=Network(cca9bd37-0d08-4714-a528-3c47a406ad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8f67d05-60') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8f67d05-60, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf8f67d05-60, col_values=(('external_ids', {'iface-id': 'f8f67d05-60f1-4a23-afdb-f26e4d8976ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:ff:42', 'vm-uuid': '8a3b8885-1940-4a92-82f4-c65c84bbf11e'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:59 user nova-compute[73484]: INFO os_vif [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:ff:42,bridge_name='br-int',has_traffic_filtering=True,id=f8f67d05-60f1-4a23-afdb-f26e4d8976ed,network=Network(cca9bd37-0d08-4714-a528-3c47a406ad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8f67d05-60')
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:42:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-887610754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-887610754',id=19,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi0gS+WpIKrgrS0mV0bR1l62g9OmjDCiprCWZONRUMZMQmvGO1TchMpbMfyKFCnzFTqOV6VmF0HLgUjtWXXpnGjIQdt8wNFklgDRvpfiHHZ16Ur5FAWNB3hO3OjZ335hw==',key_name='tempest-keypair-672802766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8d4635233ed41bca48d5dc2a709b076',ramdisk_id='',reservation_id='r-3ylp5ayp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1908642749',owner_user_name='tempest-TaggedBootDevicesTest-1908642749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729ad05102d7403e8aaa34a6c17f1a1d',uuid=8a3b8885-1940-4a92-82f4-c65c84bbf11e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b192f20f-10a5-4370-8e81-4a6faa679942", "address": "fa:16:3e:38:e6:44", "network": {"id": "1511c9d9-7c94-4100-811f-af762219ba90", "bridge": "br-int", "label": "tempest-device-tagging-net2-709970726", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb192f20f-10", "ovs_interfaceid": "b192f20f-10a5-4370-8e81-4a6faa679942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converting VIF {"id": "b192f20f-10a5-4370-8e81-4a6faa679942", "address": "fa:16:3e:38:e6:44", "network": {"id": "1511c9d9-7c94-4100-811f-af762219ba90", "bridge": "br-int", "label": "tempest-device-tagging-net2-709970726", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb192f20f-10", "ovs_interfaceid": "b192f20f-10a5-4370-8e81-4a6faa679942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:e6:44,bridge_name='br-int',has_traffic_filtering=True,id=b192f20f-10a5-4370-8e81-4a6faa679942,network=Network(1511c9d9-7c94-4100-811f-af762219ba90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb192f20f-10') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG os_vif [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:e6:44,bridge_name='br-int',has_traffic_filtering=True,id=b192f20f-10a5-4370-8e81-4a6faa679942,network=Network(1511c9d9-7c94-4100-811f-af762219ba90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb192f20f-10') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb192f20f-10, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb192f20f-10, col_values=(('external_ids', {'iface-id': 'b192f20f-10a5-4370-8e81-4a6faa679942', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:e6:44', 'vm-uuid': '8a3b8885-1940-4a92-82f4-c65c84bbf11e'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:59 user nova-compute[73484]: INFO os_vif [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:e6:44,bridge_name='br-int',has_traffic_filtering=True,id=b192f20f-10a5-4370-8e81-4a6faa679942,network=Network(1511c9d9-7c94-4100-811f-af762219ba90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb192f20f-10')
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:42:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-887610754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-887610754',id=19,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi0gS+WpIKrgrS0mV0bR1l62g9OmjDCiprCWZONRUMZMQmvGO1TchMpbMfyKFCnzFTqOV6VmF0HLgUjtWXXpnGjIQdt8wNFklgDRvpfiHHZ16Ur5FAWNB3hO3OjZ335hw==',key_name='tempest-keypair-672802766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8d4635233ed41bca48d5dc2a709b076',ramdisk_id='',reservation_id='r-3ylp5ayp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1908642749',owner_user_name='tempest-TaggedBootDevicesTest-1908642749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729ad05102d7403e8aaa34a6c17f1a1d',uuid=8a3b8885-1940-4a92-82f4-c65c84bbf11e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4", "address": "fa:16:3e:f2:f3:58", "network": {"id": "1511c9d9-7c94-4100-811f-af762219ba90", "bridge": "br-int", "label": "tempest-device-tagging-net2-709970726", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda15c9a3-5f", "ovs_interfaceid": "da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converting VIF {"id": "da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4", "address": "fa:16:3e:f2:f3:58", "network": {"id": "1511c9d9-7c94-4100-811f-af762219ba90", "bridge": "br-int", "label": "tempest-device-tagging-net2-709970726", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda15c9a3-5f", "ovs_interfaceid": "da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:f3:58,bridge_name='br-int',has_traffic_filtering=True,id=da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4,network=Network(1511c9d9-7c94-4100-811f-af762219ba90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda15c9a3-5f') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG os_vif [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:f3:58,bridge_name='br-int',has_traffic_filtering=True,id=da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4,network=Network(1511c9d9-7c94-4100-811f-af762219ba90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda15c9a3-5f') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda15c9a3-5f, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapda15c9a3-5f, col_values=(('external_ids', {'iface-id': 'da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:f3:58', 'vm-uuid': '8a3b8885-1940-4a92-82f4-c65c84bbf11e'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:42:59 user nova-compute[73484]: INFO os_vif [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:f3:58,bridge_name='br-int',has_traffic_filtering=True,id=da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4,network=Network(1511c9d9-7c94-4100-811f-af762219ba90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda15c9a3-5f')
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] No BDM found with device name hda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] No VIF found with MAC fa:16:3e:bf:2c:42, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] No VIF found with MAC fa:16:3e:c4:ff:42, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:42:59 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Using config drive
Aug 14 13:42:59 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Creating config drive at /opt/stack/data/nova/instances/8a3b8885-1940-4a92-82f4-c65c84bbf11e/disk.config
Aug 14 13:42:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8a3b8885-1940-4a92-82f4-c65c84bbf11e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpyxphguoo {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:42:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8a3b8885-1940-4a92-82f4-c65c84bbf11e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpyxphguoo" returned: 0 in 0.069s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:02 user nova-compute[73484]: DEBUG nova.compute.manager [req-da998fbc-d9d1-4bd9-a7fe-d4a5a6d140c0 req-c8667e68-531f-48a1-b990-4bdc22b2f29e service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-plugged-ec36c6e8-45d2-469b-b874-e9d3a10314f9 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-da998fbc-d9d1-4bd9-a7fe-d4a5a6d140c0 req-c8667e68-531f-48a1-b990-4bdc22b2f29e service nova] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-da998fbc-d9d1-4bd9-a7fe-d4a5a6d140c0 req-c8667e68-531f-48a1-b990-4bdc22b2f29e service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-da998fbc-d9d1-4bd9-a7fe-d4a5a6d140c0 req-c8667e68-531f-48a1-b990-4bdc22b2f29e service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:02 user nova-compute[73484]: DEBUG nova.compute.manager [req-da998fbc-d9d1-4bd9-a7fe-d4a5a6d140c0 req-c8667e68-531f-48a1-b990-4bdc22b2f29e service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] No waiting events found dispatching network-vif-plugged-ec36c6e8-45d2-469b-b874-e9d3a10314f9 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:43:02 user nova-compute[73484]: WARNING nova.compute.manager [req-da998fbc-d9d1-4bd9-a7fe-d4a5a6d140c0 req-c8667e68-531f-48a1-b990-4bdc22b2f29e service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received unexpected event network-vif-plugged-ec36c6e8-45d2-469b-b874-e9d3a10314f9 for instance with vm_state building and task_state spawning.
Aug 14 13:43:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:02 user nova-compute[73484]: DEBUG nova.compute.manager [req-2ce71741-2be5-4e2e-a1e3-14df555f9b21 req-23346c00-5994-45b6-ae15-68eed315c8b9 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-plugged-5259f8bf-c556-4ac0-9587-1633b3cf47e4 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2ce71741-2be5-4e2e-a1e3-14df555f9b21 req-23346c00-5994-45b6-ae15-68eed315c8b9 service nova] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2ce71741-2be5-4e2e-a1e3-14df555f9b21 req-23346c00-5994-45b6-ae15-68eed315c8b9 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2ce71741-2be5-4e2e-a1e3-14df555f9b21 req-23346c00-5994-45b6-ae15-68eed315c8b9 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:02 user nova-compute[73484]: DEBUG nova.compute.manager [req-2ce71741-2be5-4e2e-a1e3-14df555f9b21 req-23346c00-5994-45b6-ae15-68eed315c8b9 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] No waiting events found dispatching network-vif-plugged-5259f8bf-c556-4ac0-9587-1633b3cf47e4 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:43:02 user nova-compute[73484]: WARNING nova.compute.manager [req-2ce71741-2be5-4e2e-a1e3-14df555f9b21 req-23346c00-5994-45b6-ae15-68eed315c8b9 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received unexpected event network-vif-plugged-5259f8bf-c556-4ac0-9587-1633b3cf47e4 for instance with vm_state building and task_state spawning.
Aug 14 13:43:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:04 user nova-compute[73484]: DEBUG nova.compute.manager [req-df7e9d83-9727-4e8a-b648-422a1d1cc9ee req-365cac6d-9bcd-49ee-8337-120613743c2c service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-plugged-b192f20f-10a5-4370-8e81-4a6faa679942 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-df7e9d83-9727-4e8a-b648-422a1d1cc9ee req-365cac6d-9bcd-49ee-8337-120613743c2c service nova] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-df7e9d83-9727-4e8a-b648-422a1d1cc9ee req-365cac6d-9bcd-49ee-8337-120613743c2c service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-df7e9d83-9727-4e8a-b648-422a1d1cc9ee req-365cac6d-9bcd-49ee-8337-120613743c2c service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:04 user nova-compute[73484]: DEBUG nova.compute.manager [req-df7e9d83-9727-4e8a-b648-422a1d1cc9ee req-365cac6d-9bcd-49ee-8337-120613743c2c service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] No waiting events found dispatching network-vif-plugged-b192f20f-10a5-4370-8e81-4a6faa679942 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:43:04 user nova-compute[73484]: WARNING nova.compute.manager [req-df7e9d83-9727-4e8a-b648-422a1d1cc9ee req-365cac6d-9bcd-49ee-8337-120613743c2c service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received unexpected event network-vif-plugged-b192f20f-10a5-4370-8e81-4a6faa679942 for instance with vm_state building and task_state spawning.
Aug 14 13:43:04 user nova-compute[73484]: DEBUG nova.compute.manager [req-8480af01-2472-482c-bfa9-670d7799e377 req-e2167d64-81bb-4c58-8c4a-38453cbf911d service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-plugged-ec36c6e8-45d2-469b-b874-e9d3a10314f9 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8480af01-2472-482c-bfa9-670d7799e377 req-e2167d64-81bb-4c58-8c4a-38453cbf911d service nova] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8480af01-2472-482c-bfa9-670d7799e377 req-e2167d64-81bb-4c58-8c4a-38453cbf911d service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8480af01-2472-482c-bfa9-670d7799e377 req-e2167d64-81bb-4c58-8c4a-38453cbf911d service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:04 user nova-compute[73484]: DEBUG nova.compute.manager [req-8480af01-2472-482c-bfa9-670d7799e377 req-e2167d64-81bb-4c58-8c4a-38453cbf911d service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] No waiting events found dispatching network-vif-plugged-ec36c6e8-45d2-469b-b874-e9d3a10314f9 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:43:04 user nova-compute[73484]: WARNING nova.compute.manager [req-8480af01-2472-482c-bfa9-670d7799e377 req-e2167d64-81bb-4c58-8c4a-38453cbf911d service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received unexpected event network-vif-plugged-ec36c6e8-45d2-469b-b874-e9d3a10314f9 for instance with vm_state building and task_state spawning.
Aug 14 13:43:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:04 user nova-compute[73484]: DEBUG nova.compute.manager [req-f39c23c8-af78-4b85-acf6-e2b0d7869ba8 req-971ac45f-9cc1-4378-acfd-64797c905b0e service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-plugged-5259f8bf-c556-4ac0-9587-1633b3cf47e4 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f39c23c8-af78-4b85-acf6-e2b0d7869ba8 req-971ac45f-9cc1-4378-acfd-64797c905b0e service nova] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f39c23c8-af78-4b85-acf6-e2b0d7869ba8 req-971ac45f-9cc1-4378-acfd-64797c905b0e service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f39c23c8-af78-4b85-acf6-e2b0d7869ba8 req-971ac45f-9cc1-4378-acfd-64797c905b0e service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:04 user nova-compute[73484]: DEBUG nova.compute.manager [req-f39c23c8-af78-4b85-acf6-e2b0d7869ba8 req-971ac45f-9cc1-4378-acfd-64797c905b0e service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] No waiting events found dispatching network-vif-plugged-5259f8bf-c556-4ac0-9587-1633b3cf47e4 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:43:04 user nova-compute[73484]: WARNING nova.compute.manager [req-f39c23c8-af78-4b85-acf6-e2b0d7869ba8 req-971ac45f-9cc1-4378-acfd-64797c905b0e service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received unexpected event network-vif-plugged-5259f8bf-c556-4ac0-9587-1633b3cf47e4 for instance with vm_state building and task_state spawning.
Aug 14 13:43:04 user nova-compute[73484]: DEBUG nova.compute.manager [req-f39c23c8-af78-4b85-acf6-e2b0d7869ba8 req-971ac45f-9cc1-4378-acfd-64797c905b0e service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-plugged-e1ddd484-97b4-4cfe-be1e-a3be0128bfdb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f39c23c8-af78-4b85-acf6-e2b0d7869ba8 req-971ac45f-9cc1-4378-acfd-64797c905b0e service nova] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f39c23c8-af78-4b85-acf6-e2b0d7869ba8 req-971ac45f-9cc1-4378-acfd-64797c905b0e service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f39c23c8-af78-4b85-acf6-e2b0d7869ba8 req-971ac45f-9cc1-4378-acfd-64797c905b0e service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:04 user nova-compute[73484]: DEBUG nova.compute.manager [req-f39c23c8-af78-4b85-acf6-e2b0d7869ba8 req-971ac45f-9cc1-4378-acfd-64797c905b0e service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] No waiting events found dispatching network-vif-plugged-e1ddd484-97b4-4cfe-be1e-a3be0128bfdb {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:43:04 user nova-compute[73484]: WARNING nova.compute.manager [req-f39c23c8-af78-4b85-acf6-e2b0d7869ba8 req-971ac45f-9cc1-4378-acfd-64797c905b0e service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received unexpected event network-vif-plugged-e1ddd484-97b4-4cfe-be1e-a3be0128bfdb for instance with vm_state building and task_state spawning.
Aug 14 13:43:04 user nova-compute[73484]: DEBUG nova.compute.manager [req-f39c23c8-af78-4b85-acf6-e2b0d7869ba8 req-971ac45f-9cc1-4378-acfd-64797c905b0e service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-plugged-e1ddd484-97b4-4cfe-be1e-a3be0128bfdb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f39c23c8-af78-4b85-acf6-e2b0d7869ba8 req-971ac45f-9cc1-4378-acfd-64797c905b0e service nova] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f39c23c8-af78-4b85-acf6-e2b0d7869ba8 req-971ac45f-9cc1-4378-acfd-64797c905b0e service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f39c23c8-af78-4b85-acf6-e2b0d7869ba8 req-971ac45f-9cc1-4378-acfd-64797c905b0e service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:04 user nova-compute[73484]: DEBUG nova.compute.manager [req-f39c23c8-af78-4b85-acf6-e2b0d7869ba8 req-971ac45f-9cc1-4378-acfd-64797c905b0e service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] No waiting events found dispatching network-vif-plugged-e1ddd484-97b4-4cfe-be1e-a3be0128bfdb {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:43:04 user nova-compute[73484]: WARNING nova.compute.manager [req-f39c23c8-af78-4b85-acf6-e2b0d7869ba8 req-971ac45f-9cc1-4378-acfd-64797c905b0e service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received unexpected event network-vif-plugged-e1ddd484-97b4-4cfe-be1e-a3be0128bfdb for instance with vm_state building and task_state spawning.
Aug 14 13:43:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:06 user nova-compute[73484]: DEBUG nova.compute.manager [req-71c4b8f2-592e-4f82-b2a3-2936a8169226 req-de21a900-66ed-4cf3-a625-7e11de6b399c service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-plugged-b192f20f-10a5-4370-8e81-4a6faa679942 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-71c4b8f2-592e-4f82-b2a3-2936a8169226 req-de21a900-66ed-4cf3-a625-7e11de6b399c service nova] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-71c4b8f2-592e-4f82-b2a3-2936a8169226 req-de21a900-66ed-4cf3-a625-7e11de6b399c service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-71c4b8f2-592e-4f82-b2a3-2936a8169226 req-de21a900-66ed-4cf3-a625-7e11de6b399c service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:06 user nova-compute[73484]: DEBUG nova.compute.manager [req-71c4b8f2-592e-4f82-b2a3-2936a8169226 req-de21a900-66ed-4cf3-a625-7e11de6b399c service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] No waiting events found dispatching network-vif-plugged-b192f20f-10a5-4370-8e81-4a6faa679942 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:43:06 user nova-compute[73484]: WARNING nova.compute.manager [req-71c4b8f2-592e-4f82-b2a3-2936a8169226 req-de21a900-66ed-4cf3-a625-7e11de6b399c service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received unexpected event network-vif-plugged-b192f20f-10a5-4370-8e81-4a6faa679942 for instance with vm_state building and task_state spawning.
Aug 14 13:43:06 user nova-compute[73484]: DEBUG nova.compute.manager [req-0dcde9f9-e5b0-4ee1-8305-95160fc1d07e req-6740cdb0-44f3-4423-80d4-50ed52f7e113 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-plugged-45079f89-4586-4c56-824b-cf112200e102 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0dcde9f9-e5b0-4ee1-8305-95160fc1d07e req-6740cdb0-44f3-4423-80d4-50ed52f7e113 service nova] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0dcde9f9-e5b0-4ee1-8305-95160fc1d07e req-6740cdb0-44f3-4423-80d4-50ed52f7e113 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0dcde9f9-e5b0-4ee1-8305-95160fc1d07e req-6740cdb0-44f3-4423-80d4-50ed52f7e113 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:06 user nova-compute[73484]: DEBUG nova.compute.manager [req-0dcde9f9-e5b0-4ee1-8305-95160fc1d07e req-6740cdb0-44f3-4423-80d4-50ed52f7e113 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] No waiting events found dispatching network-vif-plugged-45079f89-4586-4c56-824b-cf112200e102 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:43:06 user nova-compute[73484]: WARNING nova.compute.manager [req-0dcde9f9-e5b0-4ee1-8305-95160fc1d07e req-6740cdb0-44f3-4423-80d4-50ed52f7e113 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received unexpected event network-vif-plugged-45079f89-4586-4c56-824b-cf112200e102 for instance with vm_state building and task_state spawning.
Aug 14 13:43:06 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020586.5886767, 8a3b8885-1940-4a92-82f4-c65c84bbf11e => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:43:06 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] VM Resumed (Lifecycle Event)
Aug 14 13:43:06 user nova-compute[73484]: DEBUG nova.compute.manager [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:43:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:43:06 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Instance spawned successfully.
Aug 14 13:43:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:43:06 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:43:06 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:43:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:43:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:43:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:43:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:43:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:43:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:43:06 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:43:06 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020586.595268, 8a3b8885-1940-4a92-82f4-c65c84bbf11e => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:43:06 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] VM Started (Lifecycle Event)
Aug 14 13:43:06 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:43:06 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:43:06 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:43:06 user nova-compute[73484]: INFO nova.compute.manager [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Took 12.23 seconds to spawn the instance on the hypervisor.
Aug 14 13:43:06 user nova-compute[73484]: DEBUG nova.compute.manager [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:43:06 user nova-compute[73484]: INFO nova.compute.manager [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Took 44.31 seconds to build instance.
Aug 14 13:43:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-85ac8f27-de47-4cf7-a3f2-4209ddecf922 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 44.423s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:07 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:07 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:43:07 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Creating image(s)
Aug 14 13:43:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "/opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "/opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.201s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.208s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk 1073741824" returned: 0 in 0.051s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692020573.2365155, 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:43:08 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] VM Stopped (Lifecycle Event)
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.compute.manager [None req-64c08bfe-a46d-4526-95b3-4ba02941c7ef None None] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.compute.manager [None req-64c08bfe-a46d-4526-95b3-4ba02941c7ef None None] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.223s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.compute.manager [req-2db6279e-aa81-4700-81d3-f9c598132762 req-8b99961a-24e9-4abe-99fb-34eacbd5178c service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-plugged-45079f89-4586-4c56-824b-cf112200e102 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2db6279e-aa81-4700-81d3-f9c598132762 req-8b99961a-24e9-4abe-99fb-34eacbd5178c service nova] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2db6279e-aa81-4700-81d3-f9c598132762 req-8b99961a-24e9-4abe-99fb-34eacbd5178c service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2db6279e-aa81-4700-81d3-f9c598132762 req-8b99961a-24e9-4abe-99fb-34eacbd5178c service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.compute.manager [req-2db6279e-aa81-4700-81d3-f9c598132762 req-8b99961a-24e9-4abe-99fb-34eacbd5178c service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] No waiting events found dispatching network-vif-plugged-45079f89-4586-4c56-824b-cf112200e102 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:43:08 user nova-compute[73484]: WARNING nova.compute.manager [req-2db6279e-aa81-4700-81d3-f9c598132762 req-8b99961a-24e9-4abe-99fb-34eacbd5178c service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received unexpected event network-vif-plugged-45079f89-4586-4c56-824b-cf112200e102 for instance with vm_state active and task_state None.
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.compute.manager [req-2db6279e-aa81-4700-81d3-f9c598132762 req-8b99961a-24e9-4abe-99fb-34eacbd5178c service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-plugged-f8f67d05-60f1-4a23-afdb-f26e4d8976ed {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2db6279e-aa81-4700-81d3-f9c598132762 req-8b99961a-24e9-4abe-99fb-34eacbd5178c service nova] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2db6279e-aa81-4700-81d3-f9c598132762 req-8b99961a-24e9-4abe-99fb-34eacbd5178c service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2db6279e-aa81-4700-81d3-f9c598132762 req-8b99961a-24e9-4abe-99fb-34eacbd5178c service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.compute.manager [req-2db6279e-aa81-4700-81d3-f9c598132762 req-8b99961a-24e9-4abe-99fb-34eacbd5178c service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] No waiting events found dispatching network-vif-plugged-f8f67d05-60f1-4a23-afdb-f26e4d8976ed {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:43:08 user nova-compute[73484]: WARNING nova.compute.manager [req-2db6279e-aa81-4700-81d3-f9c598132762 req-8b99961a-24e9-4abe-99fb-34eacbd5178c service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received unexpected event network-vif-plugged-f8f67d05-60f1-4a23-afdb-f26e4d8976ed for instance with vm_state active and task_state None.
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.compute.manager [req-2db6279e-aa81-4700-81d3-f9c598132762 req-8b99961a-24e9-4abe-99fb-34eacbd5178c service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-plugged-f8f67d05-60f1-4a23-afdb-f26e4d8976ed {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2db6279e-aa81-4700-81d3-f9c598132762 req-8b99961a-24e9-4abe-99fb-34eacbd5178c service nova] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2db6279e-aa81-4700-81d3-f9c598132762 req-8b99961a-24e9-4abe-99fb-34eacbd5178c service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2db6279e-aa81-4700-81d3-f9c598132762 req-8b99961a-24e9-4abe-99fb-34eacbd5178c service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.compute.manager [req-2db6279e-aa81-4700-81d3-f9c598132762 req-8b99961a-24e9-4abe-99fb-34eacbd5178c service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] No waiting events found dispatching network-vif-plugged-f8f67d05-60f1-4a23-afdb-f26e4d8976ed {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:43:08 user nova-compute[73484]: WARNING nova.compute.manager [req-2db6279e-aa81-4700-81d3-f9c598132762 req-8b99961a-24e9-4abe-99fb-34eacbd5178c service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received unexpected event network-vif-plugged-f8f67d05-60f1-4a23-afdb-f26e4d8976ed for instance with vm_state active and task_state None.
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.compute.manager [req-2db6279e-aa81-4700-81d3-f9c598132762 req-8b99961a-24e9-4abe-99fb-34eacbd5178c service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-plugged-da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2db6279e-aa81-4700-81d3-f9c598132762 req-8b99961a-24e9-4abe-99fb-34eacbd5178c service nova] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2db6279e-aa81-4700-81d3-f9c598132762 req-8b99961a-24e9-4abe-99fb-34eacbd5178c service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2db6279e-aa81-4700-81d3-f9c598132762 req-8b99961a-24e9-4abe-99fb-34eacbd5178c service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.compute.manager [req-2db6279e-aa81-4700-81d3-f9c598132762 req-8b99961a-24e9-4abe-99fb-34eacbd5178c service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] No waiting events found dispatching network-vif-plugged-da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:43:08 user nova-compute[73484]: WARNING nova.compute.manager [req-2db6279e-aa81-4700-81d3-f9c598132762 req-8b99961a-24e9-4abe-99fb-34eacbd5178c service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received unexpected event network-vif-plugged-da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4 for instance with vm_state active and task_state None.
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.compute.manager [req-2db6279e-aa81-4700-81d3-f9c598132762 req-8b99961a-24e9-4abe-99fb-34eacbd5178c service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-plugged-da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2db6279e-aa81-4700-81d3-f9c598132762 req-8b99961a-24e9-4abe-99fb-34eacbd5178c service nova] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2db6279e-aa81-4700-81d3-f9c598132762 req-8b99961a-24e9-4abe-99fb-34eacbd5178c service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2db6279e-aa81-4700-81d3-f9c598132762 req-8b99961a-24e9-4abe-99fb-34eacbd5178c service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.compute.manager [req-2db6279e-aa81-4700-81d3-f9c598132762 req-8b99961a-24e9-4abe-99fb-34eacbd5178c service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] No waiting events found dispatching network-vif-plugged-da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:43:08 user nova-compute[73484]: WARNING nova.compute.manager [req-2db6279e-aa81-4700-81d3-f9c598132762 req-8b99961a-24e9-4abe-99fb-34eacbd5178c service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received unexpected event network-vif-plugged-da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4 for instance with vm_state active and task_state None.
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692020573.6329243, ed239af5-980e-42d3-8ebd-ca100ccb2708 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:43:08 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] VM Stopped (Lifecycle Event)
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Cannot resize image /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Ensure instance console log exists: /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Start _get_guest_xml network_info=[{"id": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "address": "fa:16:3e:c9:13:42", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbf4211-f3", "ovs_interfaceid": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'cdacafbe-df6d-4460-8de2-9ef850919837', 'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNEtDAag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ed239af5-980e-42d3-8ebd-ca100ccb2708', 'attached_at': '', 'detached_at': '', 'volume_id': 'ed64de01-c957-421a-9664-569069202f9b', 'serial': 'ed64de01-c957-421a-9664-569069202f9b'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.compute.manager [None req-ba4e67c0-5761-4ed0-85d5-5a1108112eca None None] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:43:08 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 14 13:43:08 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.objects.instance [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lazy-loading 'vcpu_model' on Instance uuid ed239af5-980e-42d3-8ebd-ca100ccb2708 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNEtDAag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:43:08 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 13:43:08 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:43:08 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 13:43:08 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:43:08 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f536e6-fd31-4f70-b225-f8e7ca85daf0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:43:08 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b426d7-391f-4416-9e65-832fa4bb53af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b] added
Aug 14 13:43:08 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a52a4b-49dd-48be-b93d-106ce6a7ff88]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[644ba7f9-6cfd-403d-8504-ffbeb93cb56c]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mNEtDAag {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mNEtDAag" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e669164-a932-42f1-b790-dd24ce4fc328]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mNEtDAag'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e104aa-20de-499f-84b9-0dafe052f7e4]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e3956a-bb33-4e7f-9d42-9051fd1906b0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:43:08 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:43:08 user nova-compute[73484]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)
Aug 14 13:43:08 user nova-compute[73484]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)
Aug 14 13:43:08 user nova-compute[73484]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 (non-flash)
Aug 14 13:43:08 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:43:08 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:43:08 user nova-compute[73484]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)
Aug 14 13:43:08 user nova-compute[73484]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)
Aug 14 13:43:08 user nova-compute[73484]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 (non-flash)
Aug 14 13:43:08 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:43:08 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bc25a7-4142-4f02-a4c3-4a3a1e566c03]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b, portal: 172.16.0.220,3260]
Aug 14 13:43:09 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b, portal: 172.16.0.220,3260] successful.
Aug 14 13:43:09 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:43:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[511158f0-0cd9-439e-baca-6d2c357abb21]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:43:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c55203-d5c5-4a6f-9815-436b420a853e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:43:09 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:43:09 user nova-compute[73484]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)
Aug 14 13:43:09 user nova-compute[73484]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)
Aug 14 13:43:09 user nova-compute[73484]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 (non-flash)
Aug 14 13:43:09 user nova-compute[73484]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:43:09 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:43:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:43:09 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:43:09 user nova-compute[73484]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)
Aug 14 13:43:09 user nova-compute[73484]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)
Aug 14 13:43:09 user nova-compute[73484]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 (non-flash)
Aug 14 13:43:09 user nova-compute[73484]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:43:09 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:43:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:43:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:43:09 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] HCTL ('38', '-', '-', 0) found on session 24 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:43:09 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:43:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3d84de-837a-4f77-90f1-4174c76a96e9]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:09 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Searching for a device in session 24 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:43:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNEtDAag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:43:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:43:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23733663832333038', 'path': '/dev/sdg'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:43:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733663832333038', 'path': '/dev/sdg'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:43:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T13:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-808860414',display_name='tempest-ServerActionsTestOtherA-server-319727995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-808860414',id=15,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeXNpb9XHaUrVlh12GX9afYS4uhArSHw3Bmb57wtkUnIoEAuE3Mh/kr8GY8u6/64wrETW58CSBoYMy9LyrbLjI8XQndUnGuUz3mUsWp7LyaF/HaeOtI27YfARpw+mLtGw==',key_name='tempest-keypair-1210865444',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:40:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ff9e3bd3df8a408e96e9054775c3cb83',ramdisk_id='',reservation_id='r-vq274olh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2033458528',owner_user_name='tempest-ServerActionsTestOtherA-2033458528-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:42:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b22dfe5647e149a5b3a19d843f0efd66',uuid=ed239af5-980e-42d3-8ebd-ca100ccb2708,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "address": "fa:16:3e:c9:13:42", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbf4211-f3", "ovs_interfaceid": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:43:10 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Converting VIF {"id": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "address": "fa:16:3e:c9:13:42", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbf4211-f3", "ovs_interfaceid": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:43:10 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:13:42,bridge_name='br-int',has_traffic_filtering=True,id=cfbf4211-f3cb-49ad-98dd-68029d497e5f,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbf4211-f3') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:43:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:43:10 user nova-compute[73484]:   <uuid>ed239af5-980e-42d3-8ebd-ca100ccb2708</uuid>
Aug 14 13:43:10 user nova-compute[73484]:   <name>instance-0000000f</name>
Aug 14 13:43:10 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:43:10 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:43:10 user nova-compute[73484]:   <metadata>
Aug 14 13:43:10 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:43:10 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:43:10 user nova-compute[73484]:       <nova:name>tempest-ServerActionsTestOtherA-server-319727995</nova:name>
Aug 14 13:43:10 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:43:08</nova:creationTime>
Aug 14 13:43:10 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:43:10 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:43:10 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:43:10 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:43:10 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:43:10 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:43:10 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:43:10 user nova-compute[73484]:       <nova:owner>
Aug 14 13:43:10 user nova-compute[73484]:         <nova:user uuid="b22dfe5647e149a5b3a19d843f0efd66">tempest-ServerActionsTestOtherA-2033458528-project-member</nova:user>
Aug 14 13:43:10 user nova-compute[73484]:         <nova:project uuid="ff9e3bd3df8a408e96e9054775c3cb83">tempest-ServerActionsTestOtherA-2033458528</nova:project>
Aug 14 13:43:10 user nova-compute[73484]:       </nova:owner>
Aug 14 13:43:10 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:43:10 user nova-compute[73484]:       <nova:ports>
Aug 14 13:43:10 user nova-compute[73484]:         <nova:port uuid="cfbf4211-f3cb-49ad-98dd-68029d497e5f">
Aug 14 13:43:10 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 13:43:10 user nova-compute[73484]:         </nova:port>
Aug 14 13:43:10 user nova-compute[73484]:       </nova:ports>
Aug 14 13:43:10 user nova-compute[73484]:     </nova:instance>
Aug 14 13:43:10 user nova-compute[73484]:   </metadata>
Aug 14 13:43:10 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:43:10 user nova-compute[73484]:     <system>
Aug 14 13:43:10 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:43:10 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:43:10 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:43:10 user nova-compute[73484]:       <entry name="serial">ed239af5-980e-42d3-8ebd-ca100ccb2708</entry>
Aug 14 13:43:10 user nova-compute[73484]:       <entry name="uuid">ed239af5-980e-42d3-8ebd-ca100ccb2708</entry>
Aug 14 13:43:10 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:43:10 user nova-compute[73484]:     </system>
Aug 14 13:43:10 user nova-compute[73484]:   </sysinfo>
Aug 14 13:43:10 user nova-compute[73484]:   <os>
Aug 14 13:43:10 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:43:10 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:43:10 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:43:10 user nova-compute[73484]:   </os>
Aug 14 13:43:10 user nova-compute[73484]:   <features>
Aug 14 13:43:10 user nova-compute[73484]:     <acpi/>
Aug 14 13:43:10 user nova-compute[73484]:     <apic/>
Aug 14 13:43:10 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:43:10 user nova-compute[73484]:   </features>
Aug 14 13:43:10 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:43:10 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:43:10 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:43:10 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:43:10 user nova-compute[73484]:   </clock>
Aug 14 13:43:10 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:43:10 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:43:10 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:43:10 user nova-compute[73484]:   </cpu>
Aug 14 13:43:10 user nova-compute[73484]:   <devices>
Aug 14 13:43:10 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:43:10 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:43:10 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk"/>
Aug 14 13:43:10 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:43:10 user nova-compute[73484]:     </disk>
Aug 14 13:43:10 user nova-compute[73484]:     <disk type="block" device="disk">
Aug 14 13:43:10 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:43:10 user nova-compute[73484]:       <source dev="/dev/sdg"/>
Aug 14 13:43:10 user nova-compute[73484]:       <target dev="vdb" bus="virtio"/>
Aug 14 13:43:10 user nova-compute[73484]:       <serial>ed64de01-c957-421a-9664-569069202f9b</serial>
Aug 14 13:43:10 user nova-compute[73484]:     </disk>
Aug 14 13:43:10 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:43:10 user nova-compute[73484]:       <mac address="fa:16:3e:c9:13:42"/>
Aug 14 13:43:10 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:43:10 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:43:10 user nova-compute[73484]:       <target dev="tapcfbf4211-f3"/>
Aug 14 13:43:10 user nova-compute[73484]:     </interface>
Aug 14 13:43:10 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:43:10 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/console.log" append="off"/>
Aug 14 13:43:10 user nova-compute[73484]:     </serial>
Aug 14 13:43:10 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:43:10 user nova-compute[73484]:     <video>
Aug 14 13:43:10 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:43:10 user nova-compute[73484]:     </video>
Aug 14 13:43:10 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:43:10 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:43:10 user nova-compute[73484]:     </rng>
Aug 14 13:43:10 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:43:10 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:43:10 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:43:10 user nova-compute[73484]:     </memballoon>
Aug 14 13:43:10 user nova-compute[73484]:   </devices>
Aug 14 13:43:10 user nova-compute[73484]: </domain>
Aug 14 13:43:10 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:43:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T13:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-808860414',display_name='tempest-ServerActionsTestOtherA-server-319727995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-808860414',id=15,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeXNpb9XHaUrVlh12GX9afYS4uhArSHw3Bmb57wtkUnIoEAuE3Mh/kr8GY8u6/64wrETW58CSBoYMy9LyrbLjI8XQndUnGuUz3mUsWp7LyaF/HaeOtI27YfARpw+mLtGw==',key_name='tempest-keypair-1210865444',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:40:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ff9e3bd3df8a408e96e9054775c3cb83',ramdisk_id='',reservation_id='r-vq274olh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2033458528',owner_user_name='tempest-ServerActionsTestOtherA-2033458528-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:42:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b22dfe5647e149a5b3a19d843f0efd66',uuid=ed239af5-980e-42d3-8ebd-ca100ccb2708,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "address": "fa:16:3e:c9:13:42", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbf4211-f3", "ovs_interfaceid": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:43:10 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Converting VIF {"id": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "address": "fa:16:3e:c9:13:42", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbf4211-f3", "ovs_interfaceid": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:43:10 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:13:42,bridge_name='br-int',has_traffic_filtering=True,id=cfbf4211-f3cb-49ad-98dd-68029d497e5f,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbf4211-f3') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:43:10 user nova-compute[73484]: DEBUG os_vif [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:13:42,bridge_name='br-int',has_traffic_filtering=True,id=cfbf4211-f3cb-49ad-98dd-68029d497e5f,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbf4211-f3') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:43:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:43:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:43:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcfbf4211-f3, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:43:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcfbf4211-f3, col_values=(('external_ids', {'iface-id': 'cfbf4211-f3cb-49ad-98dd-68029d497e5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:13:42', 'vm-uuid': 'ed239af5-980e-42d3-8ebd-ca100ccb2708'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:43:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:43:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:10 user nova-compute[73484]: INFO os_vif [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:13:42,bridge_name='br-int',has_traffic_filtering=True,id=cfbf4211-f3cb-49ad-98dd-68029d497e5f,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbf4211-f3')
Aug 14 13:43:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:43:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:43:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] No VIF found with MAC fa:16:3e:c9:13:42, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:43:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Acquiring lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:11 user nova-compute[73484]: DEBUG nova.compute.manager [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:43:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:11 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:43:11 user nova-compute[73484]: INFO nova.compute.claims [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Claim successful on node user
Aug 14 13:43:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:12 user nova-compute[73484]: DEBUG nova.compute.manager [req-423d5f66-8e87-47c3-91bc-416c0e80ffd5 req-543e8e79-9bbf-4c93-b025-419d72031f6e service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Received event network-vif-plugged-cfbf4211-f3cb-49ad-98dd-68029d497e5f {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-423d5f66-8e87-47c3-91bc-416c0e80ffd5 req-543e8e79-9bbf-4c93-b025-419d72031f6e service nova] Acquiring lock "ed239af5-980e-42d3-8ebd-ca100ccb2708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-423d5f66-8e87-47c3-91bc-416c0e80ffd5 req-543e8e79-9bbf-4c93-b025-419d72031f6e service nova] Lock "ed239af5-980e-42d3-8ebd-ca100ccb2708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-423d5f66-8e87-47c3-91bc-416c0e80ffd5 req-543e8e79-9bbf-4c93-b025-419d72031f6e service nova] Lock "ed239af5-980e-42d3-8ebd-ca100ccb2708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:12 user nova-compute[73484]: DEBUG nova.compute.manager [req-423d5f66-8e87-47c3-91bc-416c0e80ffd5 req-543e8e79-9bbf-4c93-b025-419d72031f6e service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] No waiting events found dispatching network-vif-plugged-cfbf4211-f3cb-49ad-98dd-68029d497e5f {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:43:12 user nova-compute[73484]: WARNING nova.compute.manager [req-423d5f66-8e87-47c3-91bc-416c0e80ffd5 req-543e8e79-9bbf-4c93-b025-419d72031f6e service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Received unexpected event network-vif-plugged-cfbf4211-f3cb-49ad-98dd-68029d497e5f for instance with vm_state active and task_state rebuild_spawning.
Aug 14 13:43:12 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:43:12 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:43:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.716s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:12 user nova-compute[73484]: DEBUG nova.compute.manager [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:43:12 user nova-compute[73484]: DEBUG nova.compute.manager [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:43:12 user nova-compute[73484]: DEBUG nova.network.neutron [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:43:12 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:43:12 user nova-compute[73484]: DEBUG nova.compute.manager [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:43:12 user nova-compute[73484]: DEBUG nova.policy [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '36d93382bc5744769f45a6255e7b4bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26adad8a3f8460c9e0bf53812d66c9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:43:12 user nova-compute[73484]: DEBUG nova.compute.manager [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:43:12 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:43:12 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Creating image(s)
Aug 14 13:43:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Acquiring lock "/opt/stack/data/nova/instances/9eed5f58-f09b-419a-ba10-7b1dd6f27f7f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "/opt/stack/data/nova/instances/9eed5f58-f09b-419a-ba10-7b1dd6f27f7f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "/opt/stack/data/nova/instances/9eed5f58-f09b-419a-ba10-7b1dd6f27f7f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.192s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.182s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/9eed5f58-f09b-419a-ba10-7b1dd6f27f7f/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/9eed5f58-f09b-419a-ba10-7b1dd6f27f7f/disk 1073741824" returned: 0 in 0.055s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.181s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:13 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9eed5f58-f09b-419a-ba10-7b1dd6f27f7f/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:43:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eed5f58-f09b-419a-ba10-7b1dd6f27f7f/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eed5f58-f09b-419a-ba10-7b1dd6f27f7f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:13 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Cannot resize image /opt/stack/data/nova/instances/9eed5f58-f09b-419a-ba10-7b1dd6f27f7f/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:43:13 user nova-compute[73484]: DEBUG nova.objects.instance [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lazy-loading 'migration_context' on Instance uuid 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:43:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:43:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Ensure instance console log exists: /opt/stack/data/nova/instances/9eed5f58-f09b-419a-ba10-7b1dd6f27f7f/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:43:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:13 user nova-compute[73484]: DEBUG nova.network.neutron [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Successfully created port: 64496447-3d0b-4259-9c93-8ec02b4546fc {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:43:14 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020594.305222, ed239af5-980e-42d3-8ebd-ca100ccb2708 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:43:14 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] VM Resumed (Lifecycle Event)
Aug 14 13:43:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:43:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:43:14 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Instance spawned successfully.
Aug 14 13:43:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:43:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:43:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:43:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:43:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:43:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:43:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:43:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:43:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:43:14 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 14 13:43:14 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020594.3075159, ed239af5-980e-42d3-8ebd-ca100ccb2708 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:43:14 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] VM Started (Lifecycle Event)
Aug 14 13:43:14 user nova-compute[73484]: DEBUG nova.compute.manager [req-909c2d69-7d0d-43f4-bf60-eea6ddfe6f2b req-f294b9c8-d1e5-422e-98aa-1c25fbc40d02 service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Received event network-vif-plugged-cfbf4211-f3cb-49ad-98dd-68029d497e5f {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-909c2d69-7d0d-43f4-bf60-eea6ddfe6f2b req-f294b9c8-d1e5-422e-98aa-1c25fbc40d02 service nova] Acquiring lock "ed239af5-980e-42d3-8ebd-ca100ccb2708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-909c2d69-7d0d-43f4-bf60-eea6ddfe6f2b req-f294b9c8-d1e5-422e-98aa-1c25fbc40d02 service nova] Lock "ed239af5-980e-42d3-8ebd-ca100ccb2708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-909c2d69-7d0d-43f4-bf60-eea6ddfe6f2b req-f294b9c8-d1e5-422e-98aa-1c25fbc40d02 service nova] Lock "ed239af5-980e-42d3-8ebd-ca100ccb2708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:14 user nova-compute[73484]: DEBUG nova.compute.manager [req-909c2d69-7d0d-43f4-bf60-eea6ddfe6f2b req-f294b9c8-d1e5-422e-98aa-1c25fbc40d02 service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] No waiting events found dispatching network-vif-plugged-cfbf4211-f3cb-49ad-98dd-68029d497e5f {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:43:14 user nova-compute[73484]: WARNING nova.compute.manager [req-909c2d69-7d0d-43f4-bf60-eea6ddfe6f2b req-f294b9c8-d1e5-422e-98aa-1c25fbc40d02 service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Received unexpected event network-vif-plugged-cfbf4211-f3cb-49ad-98dd-68029d497e5f for instance with vm_state active and task_state rebuild_spawning.
Aug 14 13:43:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:43:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:43:14 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 14 13:43:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:43:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:14 user nova-compute[73484]: DEBUG nova.objects.instance [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73484) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 14 13:43:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3e7567d1-38c1-48ea-b546-57e2b04f446c tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.078s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:14 user nova-compute[73484]: DEBUG nova.network.neutron [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Successfully updated port: 64496447-3d0b-4259-9c93-8ec02b4546fc {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:43:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Acquiring lock "refresh_cache-9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:43:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Acquired lock "refresh_cache-9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:43:14 user nova-compute[73484]: DEBUG nova.network.neutron [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:43:14 user nova-compute[73484]: DEBUG nova.compute.manager [req-31415dc5-15fb-4e83-baf8-68d476fac148 req-a688343a-0f12-40da-bb6d-6ac4d64fffef service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Received event network-changed-64496447-3d0b-4259-9c93-8ec02b4546fc {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:14 user nova-compute[73484]: DEBUG nova.compute.manager [req-31415dc5-15fb-4e83-baf8-68d476fac148 req-a688343a-0f12-40da-bb6d-6ac4d64fffef service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Refreshing instance network info cache due to event network-changed-64496447-3d0b-4259-9c93-8ec02b4546fc. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:43:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-31415dc5-15fb-4e83-baf8-68d476fac148 req-a688343a-0f12-40da-bb6d-6ac4d64fffef service nova] Acquiring lock "refresh_cache-9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:43:14 user nova-compute[73484]: DEBUG nova.network.neutron [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.network.neutron [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Updating instance_info_cache with network_info: [{"id": "64496447-3d0b-4259-9c93-8ec02b4546fc", "address": "fa:16:3e:69:48:02", "network": {"id": "dcba25a0-5382-48d6-a1b3-7115a3eab557", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1037577426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26adad8a3f8460c9e0bf53812d66c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64496447-3d", "ovs_interfaceid": "64496447-3d0b-4259-9c93-8ec02b4546fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Releasing lock "refresh_cache-9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Instance network_info: |[{"id": "64496447-3d0b-4259-9c93-8ec02b4546fc", "address": "fa:16:3e:69:48:02", "network": {"id": "dcba25a0-5382-48d6-a1b3-7115a3eab557", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1037577426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26adad8a3f8460c9e0bf53812d66c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64496447-3d", "ovs_interfaceid": "64496447-3d0b-4259-9c93-8ec02b4546fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-31415dc5-15fb-4e83-baf8-68d476fac148 req-a688343a-0f12-40da-bb6d-6ac4d64fffef service nova] Acquired lock "refresh_cache-9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.network.neutron [req-31415dc5-15fb-4e83-baf8-68d476fac148 req-a688343a-0f12-40da-bb6d-6ac4d64fffef service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Refreshing network info cache for port 64496447-3d0b-4259-9c93-8ec02b4546fc {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Start _get_guest_xml network_info=[{"id": "64496447-3d0b-4259-9c93-8ec02b4546fc", "address": "fa:16:3e:69:48:02", "network": {"id": "dcba25a0-5382-48d6-a1b3-7115a3eab557", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1037577426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26adad8a3f8460c9e0bf53812d66c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64496447-3d", "ovs_interfaceid": "64496447-3d0b-4259-9c93-8ec02b4546fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:43:15 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:43:15 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:43:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1201110003',display_name='tempest-TestServerVolumeAttachmentScenario-server-1201110003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1201110003',id=22,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbJl0OsE95v2l+0E7uoqvsxmbv+fCBq04O9af6L0/mlkoLfZt2IOfPAv00RyP1IPcgIsQGEkY0DTj7yso5i/H8jKYHqzAtF2OVQK+/ri+v79OFi31EZVuGoGlvUG1xL6w==',key_name='tempest-keypair-1804530879',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a26adad8a3f8460c9e0bf53812d66c9c',ramdisk_id='',reservation_id='r-44la7o7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-529492929',owner_user_name='tempest-TestServerVolumeAttachmentScenario-529492929-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:43:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36d93382bc5744769f45a6255e7b4bd3',uuid=9eed5f58-f09b-419a-ba10-7b1dd6f27f7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64496447-3d0b-4259-9c93-8ec02b4546fc", "address": "fa:16:3e:69:48:02", "network": {"id": "dcba25a0-5382-48d6-a1b3-7115a3eab557", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1037577426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26adad8a3f8460c9e0bf53812d66c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64496447-3d", "ovs_interfaceid": "64496447-3d0b-4259-9c93-8ec02b4546fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Converting VIF {"id": "64496447-3d0b-4259-9c93-8ec02b4546fc", "address": "fa:16:3e:69:48:02", "network": {"id": "dcba25a0-5382-48d6-a1b3-7115a3eab557", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1037577426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26adad8a3f8460c9e0bf53812d66c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64496447-3d", "ovs_interfaceid": "64496447-3d0b-4259-9c93-8ec02b4546fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:48:02,bridge_name='br-int',has_traffic_filtering=True,id=64496447-3d0b-4259-9c93-8ec02b4546fc,network=Network(dcba25a0-5382-48d6-a1b3-7115a3eab557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64496447-3d') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.objects.instance [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lazy-loading 'pci_devices' on Instance uuid 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:43:15 user nova-compute[73484]:   <uuid>9eed5f58-f09b-419a-ba10-7b1dd6f27f7f</uuid>
Aug 14 13:43:15 user nova-compute[73484]:   <name>instance-00000016</name>
Aug 14 13:43:15 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:43:15 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:43:15 user nova-compute[73484]:   <metadata>
Aug 14 13:43:15 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:43:15 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:43:15 user nova-compute[73484]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1201110003</nova:name>
Aug 14 13:43:15 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:43:15</nova:creationTime>
Aug 14 13:43:15 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:43:15 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:43:15 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:43:15 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:43:15 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:43:15 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:43:15 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:43:15 user nova-compute[73484]:       <nova:owner>
Aug 14 13:43:15 user nova-compute[73484]:         <nova:user uuid="36d93382bc5744769f45a6255e7b4bd3">tempest-TestServerVolumeAttachmentScenario-529492929-project-member</nova:user>
Aug 14 13:43:15 user nova-compute[73484]:         <nova:project uuid="a26adad8a3f8460c9e0bf53812d66c9c">tempest-TestServerVolumeAttachmentScenario-529492929</nova:project>
Aug 14 13:43:15 user nova-compute[73484]:       </nova:owner>
Aug 14 13:43:15 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:43:15 user nova-compute[73484]:       <nova:ports>
Aug 14 13:43:15 user nova-compute[73484]:         <nova:port uuid="64496447-3d0b-4259-9c93-8ec02b4546fc">
Aug 14 13:43:15 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 13:43:15 user nova-compute[73484]:         </nova:port>
Aug 14 13:43:15 user nova-compute[73484]:       </nova:ports>
Aug 14 13:43:15 user nova-compute[73484]:     </nova:instance>
Aug 14 13:43:15 user nova-compute[73484]:   </metadata>
Aug 14 13:43:15 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:43:15 user nova-compute[73484]:     <system>
Aug 14 13:43:15 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:43:15 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:43:15 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:43:15 user nova-compute[73484]:       <entry name="serial">9eed5f58-f09b-419a-ba10-7b1dd6f27f7f</entry>
Aug 14 13:43:15 user nova-compute[73484]:       <entry name="uuid">9eed5f58-f09b-419a-ba10-7b1dd6f27f7f</entry>
Aug 14 13:43:15 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:43:15 user nova-compute[73484]:     </system>
Aug 14 13:43:15 user nova-compute[73484]:   </sysinfo>
Aug 14 13:43:15 user nova-compute[73484]:   <os>
Aug 14 13:43:15 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:43:15 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:43:15 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:43:15 user nova-compute[73484]:   </os>
Aug 14 13:43:15 user nova-compute[73484]:   <features>
Aug 14 13:43:15 user nova-compute[73484]:     <acpi/>
Aug 14 13:43:15 user nova-compute[73484]:     <apic/>
Aug 14 13:43:15 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:43:15 user nova-compute[73484]:   </features>
Aug 14 13:43:15 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:43:15 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:43:15 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:43:15 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:43:15 user nova-compute[73484]:   </clock>
Aug 14 13:43:15 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:43:15 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:43:15 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:43:15 user nova-compute[73484]:   </cpu>
Aug 14 13:43:15 user nova-compute[73484]:   <devices>
Aug 14 13:43:15 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:43:15 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:43:15 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/9eed5f58-f09b-419a-ba10-7b1dd6f27f7f/disk"/>
Aug 14 13:43:15 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:43:15 user nova-compute[73484]:     </disk>
Aug 14 13:43:15 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:43:15 user nova-compute[73484]:       <mac address="fa:16:3e:69:48:02"/>
Aug 14 13:43:15 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:43:15 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:43:15 user nova-compute[73484]:       <target dev="tap64496447-3d"/>
Aug 14 13:43:15 user nova-compute[73484]:     </interface>
Aug 14 13:43:15 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:43:15 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/9eed5f58-f09b-419a-ba10-7b1dd6f27f7f/console.log" append="off"/>
Aug 14 13:43:15 user nova-compute[73484]:     </serial>
Aug 14 13:43:15 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:43:15 user nova-compute[73484]:     <video>
Aug 14 13:43:15 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:43:15 user nova-compute[73484]:     </video>
Aug 14 13:43:15 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:43:15 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:43:15 user nova-compute[73484]:     </rng>
Aug 14 13:43:15 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:43:15 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:43:15 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:43:15 user nova-compute[73484]:     </memballoon>
Aug 14 13:43:15 user nova-compute[73484]:   </devices>
Aug 14 13:43:15 user nova-compute[73484]: </domain>
Aug 14 13:43:15 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:43:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1201110003',display_name='tempest-TestServerVolumeAttachmentScenario-server-1201110003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1201110003',id=22,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbJl0OsE95v2l+0E7uoqvsxmbv+fCBq04O9af6L0/mlkoLfZt2IOfPAv00RyP1IPcgIsQGEkY0DTj7yso5i/H8jKYHqzAtF2OVQK+/ri+v79OFi31EZVuGoGlvUG1xL6w==',key_name='tempest-keypair-1804530879',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a26adad8a3f8460c9e0bf53812d66c9c',ramdisk_id='',reservation_id='r-44la7o7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-529492929',owner_user_name='tempest-TestServerVolumeAttachmentScenario-529492929-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:43:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36d93382bc5744769f45a6255e7b4bd3',uuid=9eed5f58-f09b-419a-ba10-7b1dd6f27f7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64496447-3d0b-4259-9c93-8ec02b4546fc", "address": "fa:16:3e:69:48:02", "network": {"id": "dcba25a0-5382-48d6-a1b3-7115a3eab557", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1037577426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26adad8a3f8460c9e0bf53812d66c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64496447-3d", "ovs_interfaceid": "64496447-3d0b-4259-9c93-8ec02b4546fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Converting VIF {"id": "64496447-3d0b-4259-9c93-8ec02b4546fc", "address": "fa:16:3e:69:48:02", "network": {"id": "dcba25a0-5382-48d6-a1b3-7115a3eab557", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1037577426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26adad8a3f8460c9e0bf53812d66c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64496447-3d", "ovs_interfaceid": "64496447-3d0b-4259-9c93-8ec02b4546fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:48:02,bridge_name='br-int',has_traffic_filtering=True,id=64496447-3d0b-4259-9c93-8ec02b4546fc,network=Network(dcba25a0-5382-48d6-a1b3-7115a3eab557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64496447-3d') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG os_vif [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:48:02,bridge_name='br-int',has_traffic_filtering=True,id=64496447-3d0b-4259-9c93-8ec02b4546fc,network=Network(dcba25a0-5382-48d6-a1b3-7115a3eab557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64496447-3d') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64496447-3d, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap64496447-3d, col_values=(('external_ids', {'iface-id': '64496447-3d0b-4259-9c93-8ec02b4546fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:48:02', 'vm-uuid': '9eed5f58-f09b-419a-ba10-7b1dd6f27f7f'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:15 user nova-compute[73484]: INFO os_vif [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:48:02,bridge_name='br-int',has_traffic_filtering=True,id=64496447-3d0b-4259-9c93-8ec02b4546fc,network=Network(dcba25a0-5382-48d6-a1b3-7115a3eab557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64496447-3d')
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] No VIF found with MAC fa:16:3e:69:48:02, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.network.neutron [req-31415dc5-15fb-4e83-baf8-68d476fac148 req-a688343a-0f12-40da-bb6d-6ac4d64fffef service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Updated VIF entry in instance network info cache for port 64496447-3d0b-4259-9c93-8ec02b4546fc. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG nova.network.neutron [req-31415dc5-15fb-4e83-baf8-68d476fac148 req-a688343a-0f12-40da-bb6d-6ac4d64fffef service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Updating instance_info_cache with network_info: [{"id": "64496447-3d0b-4259-9c93-8ec02b4546fc", "address": "fa:16:3e:69:48:02", "network": {"id": "dcba25a0-5382-48d6-a1b3-7115a3eab557", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1037577426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26adad8a3f8460c9e0bf53812d66c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64496447-3d", "ovs_interfaceid": "64496447-3d0b-4259-9c93-8ec02b4546fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:43:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-31415dc5-15fb-4e83-baf8-68d476fac148 req-a688343a-0f12-40da-bb6d-6ac4d64fffef service nova] Releasing lock "refresh_cache-9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:43:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:17 user nova-compute[73484]: DEBUG nova.compute.manager [req-a8cb185c-7765-4c7c-bc9f-d31aff653dd1 req-bddee767-37e3-4b53-bd32-3a2e33857459 service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Received event network-vif-plugged-64496447-3d0b-4259-9c93-8ec02b4546fc {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a8cb185c-7765-4c7c-bc9f-d31aff653dd1 req-bddee767-37e3-4b53-bd32-3a2e33857459 service nova] Acquiring lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a8cb185c-7765-4c7c-bc9f-d31aff653dd1 req-bddee767-37e3-4b53-bd32-3a2e33857459 service nova] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a8cb185c-7765-4c7c-bc9f-d31aff653dd1 req-bddee767-37e3-4b53-bd32-3a2e33857459 service nova] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:17 user nova-compute[73484]: DEBUG nova.compute.manager [req-a8cb185c-7765-4c7c-bc9f-d31aff653dd1 req-bddee767-37e3-4b53-bd32-3a2e33857459 service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] No waiting events found dispatching network-vif-plugged-64496447-3d0b-4259-9c93-8ec02b4546fc {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:43:17 user nova-compute[73484]: WARNING nova.compute.manager [req-a8cb185c-7765-4c7c-bc9f-d31aff653dd1 req-bddee767-37e3-4b53-bd32-3a2e33857459 service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Received unexpected event network-vif-plugged-64496447-3d0b-4259-9c93-8ec02b4546fc for instance with vm_state building and task_state spawning.
Aug 14 13:43:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Acquiring lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:18 user nova-compute[73484]: INFO nova.compute.manager [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Detaching volume 383633e0-0201-479d-8e03-3a15c3341c1d
Aug 14 13:43:18 user nova-compute[73484]: INFO nova.virt.block_device [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Attempting to driver detach volume 383633e0-0201-479d-8e03-3a15c3341c1d from mountpoint /dev/vdb
Aug 14 13:43:18 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Attempting to detach device vdb from instance 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 from the persistent domain config. {{(pid=73484) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 13:43:18 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:43:18 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:43:18 user nova-compute[73484]:   <source dev="/dev/sdc"/>
Aug 14 13:43:18 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:43:18 user nova-compute[73484]:   <serial>383633e0-0201-479d-8e03-3a15c3341c1d</serial>
Aug 14 13:43:18 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 13:43:18 user nova-compute[73484]: </disk>
Aug 14 13:43:18 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:43:18 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Successfully detached device vdb from instance 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 from the persistent domain config.
Aug 14 13:43:18 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 from the live domain config. {{(pid=73484) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 13:43:18 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:43:18 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:43:18 user nova-compute[73484]:   <source dev="/dev/sdc"/>
Aug 14 13:43:18 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:43:18 user nova-compute[73484]:   <serial>383633e0-0201-479d-8e03-3a15c3341c1d</serial>
Aug 14 13:43:18 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 13:43:18 user nova-compute[73484]: </disk>
Aug 14 13:43:18 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:43:18 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Received event <DeviceRemovedEvent: 1692020598.8722057, 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73484) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 13:43:18 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 {{(pid=73484) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 13:43:18 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Successfully detached device vdb from instance 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 from the live domain config.
Aug 14 13:43:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:18 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:43:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'utMplJdi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:43:18 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:43:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:43:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:43:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:43:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:18 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2b3dfd-6d70-4788-8173-b4b44564f352]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:18 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1594af-b7bc-4f74-89b5-c6154407ec38]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:43:18 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:43:18 user nova-compute[73484]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)
Aug 14 13:43:18 user nova-compute[73484]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)
Aug 14 13:43:18 user nova-compute[73484]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 (non-flash)
Aug 14 13:43:18 user nova-compute[73484]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:43:18 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:43:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:43:18 user nova-compute[73484]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d (non-flash)
Aug 14 13:43:18 user nova-compute[73484]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)
Aug 14 13:43:18 user nova-compute[73484]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)
Aug 14 13:43:18 user nova-compute[73484]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 (non-flash)
Aug 14 13:43:18 user nova-compute[73484]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:43:18 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc458334ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d'): ({'sdc'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Removing single pathed devices sdc {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[279d4bf0-80b5-48a2-bdb1-717149d44611]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[330fa1fe-e794-4827-9f2f-39eb755c2235]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Flushing IO for device /dev/sdc {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87c8956-0875-44c7-acf3-d788df66c4f4]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1343da92-c34a-4671-abb7-e1e1e3e48c5c]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1afd3e-37ac-455d-bcc5-7f15efea54c7]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG nova.compute.manager [req-a0695fd3-1c93-4ef8-b029-26d90162fda9 req-3b52c89a-e317-4509-b7ea-648e9121693e service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Received event network-vif-plugged-64496447-3d0b-4259-9c93-8ec02b4546fc {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a0695fd3-1c93-4ef8-b029-26d90162fda9 req-3b52c89a-e317-4509-b7ea-648e9121693e service nova] Acquiring lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a0695fd3-1c93-4ef8-b029-26d90162fda9 req-3b52c89a-e317-4509-b7ea-648e9121693e service nova] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a0695fd3-1c93-4ef8-b029-26d90162fda9 req-3b52c89a-e317-4509-b7ea-648e9121693e service nova] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG nova.compute.manager [req-a0695fd3-1c93-4ef8-b029-26d90162fda9 req-3b52c89a-e317-4509-b7ea-648e9121693e service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] No waiting events found dispatching network-vif-plugged-64496447-3d0b-4259-9c93-8ec02b4546fc {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:43:19 user nova-compute[73484]: WARNING nova.compute.manager [req-a0695fd3-1c93-4ef8-b029-26d90162fda9 req-3b52c89a-e317-4509-b7ea-648e9121693e service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Received unexpected event network-vif-plugged-64496447-3d0b-4259-9c93-8ec02b4546fc for instance with vm_state building and task_state spawning.
Aug 14 13:43:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9184c465-28de-471b-a8c0-e3aa941b8414]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d, portal: 172.16.0.220,3260]
Aug 14 13:43:19 user nova-compute[73484]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d, portal: 172.16.0.220,3260] successful.
Aug 14 13:43:19 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:383633e0-0201-479d-8e03-3a15c3341c1d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf839c2-f31a-439e-8dbc-7139b6d86e4a]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] <== disconnect_volume: return (388ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020599.3023643, 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:43:19 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] VM Resumed (Lifecycle Event)
Aug 14 13:43:19 user nova-compute[73484]: DEBUG nova.compute.manager [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:43:19 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Instance spawned successfully.
Aug 14 13:43:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:43:19 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:43:19 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020599.3024564, 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:43:19 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] VM Started (Lifecycle Event)
Aug 14 13:43:19 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:43:19 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:43:19 user nova-compute[73484]: INFO nova.compute.manager [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Took 6.64 seconds to spawn the instance on the hypervisor.
Aug 14 13:43:19 user nova-compute[73484]: DEBUG nova.compute.manager [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:43:19 user nova-compute[73484]: INFO nova.compute.manager [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Took 7.73 seconds to build instance.
Aug 14 13:43:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0c0f0028-9cc1-409a-8bc0-0e58c68e652d tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Acquiring lock "b889688d-13dd-4f7b-bfef-26dc5347fd6e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0c0f0028-9cc1-409a-8bc0-0e58c68e652d tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "b889688d-13dd-4f7b-bfef-26dc5347fd6e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0c0f0028-9cc1-409a-8bc0-0e58c68e652d tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Acquiring lock "b889688d-13dd-4f7b-bfef-26dc5347fd6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0c0f0028-9cc1-409a-8bc0-0e58c68e652d tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "b889688d-13dd-4f7b-bfef-26dc5347fd6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0c0f0028-9cc1-409a-8bc0-0e58c68e652d tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "b889688d-13dd-4f7b-bfef-26dc5347fd6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f439797e-d334-4c66-a7b1-5b1a91c9232b tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.835s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:19 user nova-compute[73484]: INFO nova.compute.manager [None req-0c0f0028-9cc1-409a-8bc0-0e58c68e652d tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Terminating instance
Aug 14 13:43:19 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0c0f0028-9cc1-409a-8bc0-0e58c68e652d tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:20 user nova-compute[73484]: DEBUG nova.compute.manager [req-38cf0226-f895-41af-b4a1-66526c68c84a req-ef3fadc8-2b9e-417c-bba4-23f629ff194f service nova] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Received event network-vif-unplugged-cd94675b-f6af-48b1-a32f-0a39549f404d {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-38cf0226-f895-41af-b4a1-66526c68c84a req-ef3fadc8-2b9e-417c-bba4-23f629ff194f service nova] Acquiring lock "b889688d-13dd-4f7b-bfef-26dc5347fd6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-38cf0226-f895-41af-b4a1-66526c68c84a req-ef3fadc8-2b9e-417c-bba4-23f629ff194f service nova] Lock "b889688d-13dd-4f7b-bfef-26dc5347fd6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-38cf0226-f895-41af-b4a1-66526c68c84a req-ef3fadc8-2b9e-417c-bba4-23f629ff194f service nova] Lock "b889688d-13dd-4f7b-bfef-26dc5347fd6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:20 user nova-compute[73484]: DEBUG nova.compute.manager [req-38cf0226-f895-41af-b4a1-66526c68c84a req-ef3fadc8-2b9e-417c-bba4-23f629ff194f service nova] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] No waiting events found dispatching network-vif-unplugged-cd94675b-f6af-48b1-a32f-0a39549f404d {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:43:20 user nova-compute[73484]: DEBUG nova.compute.manager [req-38cf0226-f895-41af-b4a1-66526c68c84a req-ef3fadc8-2b9e-417c-bba4-23f629ff194f service nova] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Received event network-vif-unplugged-cd94675b-f6af-48b1-a32f-0a39549f404d for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:43:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:20 user nova-compute[73484]: DEBUG nova.objects.instance [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lazy-loading 'flavor' on Instance uuid 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:43:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9829a7df-e4cb-4a2f-9406-0d20cbd0e429 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.162s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:20 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Instance destroyed successfully.
Aug 14 13:43:20 user nova-compute[73484]: DEBUG nova.objects.instance [None req-0c0f0028-9cc1-409a-8bc0-0e58c68e652d tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lazy-loading 'resources' on Instance uuid b889688d-13dd-4f7b-bfef-26dc5347fd6e {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:43:20 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-0c0f0028-9cc1-409a-8bc0-0e58c68e652d tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-509440637',display_name='tempest-VolumesAdminNegativeTest-server-509440637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-509440637',id=5,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3Wz96SUnWyQVq0ihJIu2YwAhTs2Lj/ulEHdQO6NEEo6qvv2i4bzsbUOltHeuSdFluC5QPPUoTPGmJIXmapKoUEMpdadG+tuxCZ2kmwpd4rGn3FG3iQlj5vLArK27oCTQ==',key_name='tempest-keypair-1658501023',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:37:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a95ec66f3424934bdff0335e262cc9e',ramdisk_id='',reservation_id='r-f8nxg0l1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-730276289',owner_user_name='tempest-VolumesAdminNegativeTest-730276289-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:37:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d89860cdc284bc898c650b2a6fc3a2a',uuid=b889688d-13dd-4f7b-bfef-26dc5347fd6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd94675b-f6af-48b1-a32f-0a39549f404d", "address": "fa:16:3e:7d:02:29", "network": {"id": "988c9059-476e-4558-8e68-3cfe68a53a09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1683768593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a95ec66f3424934bdff0335e262cc9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd94675b-f6", "ovs_interfaceid": "cd94675b-f6af-48b1-a32f-0a39549f404d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:43:20 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-0c0f0028-9cc1-409a-8bc0-0e58c68e652d tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Converting VIF {"id": "cd94675b-f6af-48b1-a32f-0a39549f404d", "address": "fa:16:3e:7d:02:29", "network": {"id": "988c9059-476e-4558-8e68-3cfe68a53a09", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1683768593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a95ec66f3424934bdff0335e262cc9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd94675b-f6", "ovs_interfaceid": "cd94675b-f6af-48b1-a32f-0a39549f404d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:43:20 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-0c0f0028-9cc1-409a-8bc0-0e58c68e652d tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:02:29,bridge_name='br-int',has_traffic_filtering=True,id=cd94675b-f6af-48b1-a32f-0a39549f404d,network=Network(988c9059-476e-4558-8e68-3cfe68a53a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd94675b-f6') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:43:20 user nova-compute[73484]: DEBUG os_vif [None req-0c0f0028-9cc1-409a-8bc0-0e58c68e652d tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:02:29,bridge_name='br-int',has_traffic_filtering=True,id=cd94675b-f6af-48b1-a32f-0a39549f404d,network=Network(988c9059-476e-4558-8e68-3cfe68a53a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd94675b-f6') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:43:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd94675b-f6, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:43:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:43:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:20 user nova-compute[73484]: INFO os_vif [None req-0c0f0028-9cc1-409a-8bc0-0e58c68e652d tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:02:29,bridge_name='br-int',has_traffic_filtering=True,id=cd94675b-f6af-48b1-a32f-0a39549f404d,network=Network(988c9059-476e-4558-8e68-3cfe68a53a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd94675b-f6')
Aug 14 13:43:20 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-0c0f0028-9cc1-409a-8bc0-0e58c68e652d tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Deleting instance files /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e_del
Aug 14 13:43:20 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-0c0f0028-9cc1-409a-8bc0-0e58c68e652d tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Deletion of /opt/stack/data/nova/instances/b889688d-13dd-4f7b-bfef-26dc5347fd6e_del complete
Aug 14 13:43:20 user nova-compute[73484]: INFO nova.compute.manager [None req-0c0f0028-9cc1-409a-8bc0-0e58c68e652d tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Took 1.08 seconds to destroy the instance on the hypervisor.
Aug 14 13:43:20 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-0c0f0028-9cc1-409a-8bc0-0e58c68e652d tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:43:20 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:43:20 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:43:21 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:43:21 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Took 1.12 seconds to deallocate network for instance.
Aug 14 13:43:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0c0f0028-9cc1-409a-8bc0-0e58c68e652d tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0c0f0028-9cc1-409a-8bc0-0e58c68e652d tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:22 user nova-compute[73484]: DEBUG nova.compute.manager [req-c2595847-27b2-45cb-be9d-722fa8f2bbca req-121d09ef-a5e3-4ca6-9e7e-8cf21fd96f48 service nova] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Received event network-vif-plugged-cd94675b-f6af-48b1-a32f-0a39549f404d {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c2595847-27b2-45cb-be9d-722fa8f2bbca req-121d09ef-a5e3-4ca6-9e7e-8cf21fd96f48 service nova] Acquiring lock "b889688d-13dd-4f7b-bfef-26dc5347fd6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c2595847-27b2-45cb-be9d-722fa8f2bbca req-121d09ef-a5e3-4ca6-9e7e-8cf21fd96f48 service nova] Lock "b889688d-13dd-4f7b-bfef-26dc5347fd6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c2595847-27b2-45cb-be9d-722fa8f2bbca req-121d09ef-a5e3-4ca6-9e7e-8cf21fd96f48 service nova] Lock "b889688d-13dd-4f7b-bfef-26dc5347fd6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:22 user nova-compute[73484]: DEBUG nova.compute.manager [req-c2595847-27b2-45cb-be9d-722fa8f2bbca req-121d09ef-a5e3-4ca6-9e7e-8cf21fd96f48 service nova] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] No waiting events found dispatching network-vif-plugged-cd94675b-f6af-48b1-a32f-0a39549f404d {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:43:22 user nova-compute[73484]: WARNING nova.compute.manager [req-c2595847-27b2-45cb-be9d-722fa8f2bbca req-121d09ef-a5e3-4ca6-9e7e-8cf21fd96f48 service nova] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Received unexpected event network-vif-plugged-cd94675b-f6af-48b1-a32f-0a39549f404d for instance with vm_state deleted and task_state None.
Aug 14 13:43:22 user nova-compute[73484]: DEBUG nova.compute.manager [req-c2595847-27b2-45cb-be9d-722fa8f2bbca req-121d09ef-a5e3-4ca6-9e7e-8cf21fd96f48 service nova] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Received event network-vif-deleted-cd94675b-f6af-48b1-a32f-0a39549f404d {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:22 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-0c0f0028-9cc1-409a-8bc0-0e58c68e652d tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:43:22 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-0c0f0028-9cc1-409a-8bc0-0e58c68e652d tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:43:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0c0f0028-9cc1-409a-8bc0-0e58c68e652d tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.551s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:22 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-0c0f0028-9cc1-409a-8bc0-0e58c68e652d tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Deleted allocations for instance b889688d-13dd-4f7b-bfef-26dc5347fd6e
Aug 14 13:43:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0c0f0028-9cc1-409a-8bc0-0e58c68e652d tempest-VolumesAdminNegativeTest-730276289 tempest-VolumesAdminNegativeTest-730276289-project-member] Lock "b889688d-13dd-4f7b-bfef-26dc5347fd6e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.978s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:24 user nova-compute[73484]: DEBUG nova.compute.manager [req-abb3ce68-af46-4961-b137-235d37ad9c7e req-9a26ae73-0cef-4dfc-b2a6-e4fe6070c5db service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Received event network-changed-3ef63421-a4aa-4126-b8ee-c141b2ef10cb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:24 user nova-compute[73484]: DEBUG nova.compute.manager [req-abb3ce68-af46-4961-b137-235d37ad9c7e req-9a26ae73-0cef-4dfc-b2a6-e4fe6070c5db service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Refreshing instance network info cache due to event network-changed-3ef63421-a4aa-4126-b8ee-c141b2ef10cb. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:43:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-abb3ce68-af46-4961-b137-235d37ad9c7e req-9a26ae73-0cef-4dfc-b2a6-e4fe6070c5db service nova] Acquiring lock "refresh_cache-8220a084-e402-435a-b6a7-ffd94f91a211" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:43:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-abb3ce68-af46-4961-b137-235d37ad9c7e req-9a26ae73-0cef-4dfc-b2a6-e4fe6070c5db service nova] Acquired lock "refresh_cache-8220a084-e402-435a-b6a7-ffd94f91a211" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:43:24 user nova-compute[73484]: DEBUG nova.network.neutron [req-abb3ce68-af46-4961-b137-235d37ad9c7e req-9a26ae73-0cef-4dfc-b2a6-e4fe6070c5db service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Refreshing network info cache for port 3ef63421-a4aa-4126-b8ee-c141b2ef10cb {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:43:25 user nova-compute[73484]: DEBUG nova.network.neutron [req-abb3ce68-af46-4961-b137-235d37ad9c7e req-9a26ae73-0cef-4dfc-b2a6-e4fe6070c5db service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Updated VIF entry in instance network info cache for port 3ef63421-a4aa-4126-b8ee-c141b2ef10cb. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:43:25 user nova-compute[73484]: DEBUG nova.network.neutron [req-abb3ce68-af46-4961-b137-235d37ad9c7e req-9a26ae73-0cef-4dfc-b2a6-e4fe6070c5db service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Updating instance_info_cache with network_info: [{"id": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "address": "fa:16:3e:ca:70:43", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef63421-a4", "ovs_interfaceid": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:43:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-abb3ce68-af46-4961-b137-235d37ad9c7e req-9a26ae73-0cef-4dfc-b2a6-e4fe6070c5db service nova] Releasing lock "refresh_cache-8220a084-e402-435a-b6a7-ffd94f91a211" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:43:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:43:28 user nova-compute[73484]: WARNING nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] While synchronizing instance power states, found 14 instances in the database and 13 instances on the hypervisor.
Aug 14 13:43:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Triggering sync for uuid f4f7788c-fcca-47c1-b5b8-72892253982d {{(pid=73484) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Triggering sync for uuid 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 {{(pid=73484) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Triggering sync for uuid 07bac569-8b2c-4555-b4d5-a74f7384630b {{(pid=73484) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Triggering sync for uuid 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 {{(pid=73484) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Triggering sync for uuid eaaccbea-d453-4943-9663-949c66029d87 {{(pid=73484) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Triggering sync for uuid a9d4ec42-3db9-439b-87a7-02bcaab514a4 {{(pid=73484) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Triggering sync for uuid ed239af5-980e-42d3-8ebd-ca100ccb2708 {{(pid=73484) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Triggering sync for uuid bd43e3a9-0413-4e55-b6a1-7f3f792ba872 {{(pid=73484) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Triggering sync for uuid 8220a084-e402-435a-b6a7-ffd94f91a211 {{(pid=73484) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Triggering sync for uuid 1c48c0d4-7d10-4086-b30f-61e71f358622 {{(pid=73484) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Triggering sync for uuid 8a3b8885-1940-4a92-82f4-c65c84bbf11e {{(pid=73484) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Triggering sync for uuid 09ba29fd-8161-485c-ba6d-71d24ab086bc {{(pid=73484) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Triggering sync for uuid 29855792-6422-4626-ae64-923c346b1eb9 {{(pid=73484) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Triggering sync for uuid 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f {{(pid=73484) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "f4f7788c-fcca-47c1-b5b8-72892253982d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "f4f7788c-fcca-47c1-b5b8-72892253982d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "07bac569-8b2c-4555-b4d5-a74f7384630b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "07bac569-8b2c-4555-b4d5-a74f7384630b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "eaaccbea-d453-4943-9663-949c66029d87" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "eaaccbea-d453-4943-9663-949c66029d87" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "ed239af5-980e-42d3-8ebd-ca100ccb2708" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "ed239af5-980e-42d3-8ebd-ca100ccb2708" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "bd43e3a9-0413-4e55-b6a1-7f3f792ba872" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "bd43e3a9-0413-4e55-b6a1-7f3f792ba872" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "8220a084-e402-435a-b6a7-ffd94f91a211" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "8220a084-e402-435a-b6a7-ffd94f91a211" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "1c48c0d4-7d10-4086-b30f-61e71f358622" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "1c48c0d4-7d10-4086-b30f-61e71f358622" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "09ba29fd-8161-485c-ba6d-71d24ab086bc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "29855792-6422-4626-ae64-923c346b1eb9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "29855792-6422-4626-ae64-923c346b1eb9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:28 user nova-compute[73484]: WARNING oslo_messaging._drivers.amqpdriver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:28 user nova-compute[73484]: INFO nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: eaaccbea-d453-4943-9663-949c66029d87] During _sync_instance_power_state the DB power_state (1) does not match the vm_power_state from the hypervisor (0). Updating power_state in the DB to match the hypervisor.
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "07bac569-8b2c-4555-b4d5-a74f7384630b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "f4f7788c-fcca-47c1-b5b8-72892253982d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "8220a084-e402-435a-b6a7-ffd94f91a211" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.111s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "bd43e3a9-0413-4e55-b6a1-7f3f792ba872" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "ed239af5-980e-42d3-8ebd-ca100ccb2708" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.128s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "29855792-6422-4626-ae64-923c346b1eb9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.127s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "1c48c0d4-7d10-4086-b30f-61e71f358622" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.132s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:28 user nova-compute[73484]: WARNING nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: eaaccbea-d453-4943-9663-949c66029d87] Instance is unexpectedly not found. Ignore.
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "eaaccbea-d453-4943-9663-949c66029d87" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.160s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.157s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:29 user nova-compute[73484]: INFO nova.compute.manager [None req-6abd7896-303d-49cb-9b89-4a12a3729612 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Unrescuing
Aug 14 13:43:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6abd7896-303d-49cb-9b89-4a12a3729612 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "refresh_cache-a9d4ec42-3db9-439b-87a7-02bcaab514a4" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:43:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6abd7896-303d-49cb-9b89-4a12a3729612 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquired lock "refresh_cache-a9d4ec42-3db9-439b-87a7-02bcaab514a4" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:43:29 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6abd7896-303d-49cb-9b89-4a12a3729612 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:43:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "8220a084-e402-435a-b6a7-ffd94f91a211" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "8220a084-e402-435a-b6a7-ffd94f91a211" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:29 user nova-compute[73484]: INFO nova.compute.manager [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Shelving
Aug 14 13:43:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:29 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6abd7896-303d-49cb-9b89-4a12a3729612 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Updating instance_info_cache with network_info: [{"id": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "address": "fa:16:3e:a8:f5:8b", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa109f4ac-a7", "ovs_interfaceid": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:43:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6abd7896-303d-49cb-9b89-4a12a3729612 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Releasing lock "refresh_cache-a9d4ec42-3db9-439b-87a7-02bcaab514a4" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:43:29 user nova-compute[73484]: DEBUG nova.objects.instance [None req-6abd7896-303d-49cb-9b89-4a12a3729612 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lazy-loading 'flavor' on Instance uuid a9d4ec42-3db9-439b-87a7-02bcaab514a4 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:43:29 user nova-compute[73484]: DEBUG nova.compute.manager [req-1c0ce36a-57b6-4bf5-b68c-3add3d4afc9f req-945ce539-57a2-4d9f-be1d-300673100bef service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Received event network-vif-unplugged-3ef63421-a4aa-4126-b8ee-c141b2ef10cb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1c0ce36a-57b6-4bf5-b68c-3add3d4afc9f req-945ce539-57a2-4d9f-be1d-300673100bef service nova] Acquiring lock "8220a084-e402-435a-b6a7-ffd94f91a211-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1c0ce36a-57b6-4bf5-b68c-3add3d4afc9f req-945ce539-57a2-4d9f-be1d-300673100bef service nova] Lock "8220a084-e402-435a-b6a7-ffd94f91a211-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1c0ce36a-57b6-4bf5-b68c-3add3d4afc9f req-945ce539-57a2-4d9f-be1d-300673100bef service nova] Lock "8220a084-e402-435a-b6a7-ffd94f91a211-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:29 user nova-compute[73484]: DEBUG nova.compute.manager [req-1c0ce36a-57b6-4bf5-b68c-3add3d4afc9f req-945ce539-57a2-4d9f-be1d-300673100bef service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] No waiting events found dispatching network-vif-unplugged-3ef63421-a4aa-4126-b8ee-c141b2ef10cb {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:43:29 user nova-compute[73484]: WARNING nova.compute.manager [req-1c0ce36a-57b6-4bf5-b68c-3add3d4afc9f req-945ce539-57a2-4d9f-be1d-300673100bef service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Received unexpected event network-vif-unplugged-3ef63421-a4aa-4126-b8ee-c141b2ef10cb for instance with vm_state active and task_state shelving.
Aug 14 13:43:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:30 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Instance destroyed successfully.
Aug 14 13:43:30 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Instance destroyed successfully.
Aug 14 13:43:30 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Beginning cold snapshot process
Aug 14 13:43:30 user nova-compute[73484]: DEBUG nova.privsep.utils [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73484) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 13:43:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk /opt/stack/data/nova/instances/snapshots/tmpl84otbxu/0fb83886aa9e433bb4c45ca2aa0840e0 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:31 user nova-compute[73484]: DEBUG nova.compute.manager [req-a4b63f37-eca5-4749-8149-9abb6c2653c6 req-739bd91c-1330-40d2-bd7f-96b0f45133a5 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Received event network-vif-plugged-3ef63421-a4aa-4126-b8ee-c141b2ef10cb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a4b63f37-eca5-4749-8149-9abb6c2653c6 req-739bd91c-1330-40d2-bd7f-96b0f45133a5 service nova] Acquiring lock "8220a084-e402-435a-b6a7-ffd94f91a211-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a4b63f37-eca5-4749-8149-9abb6c2653c6 req-739bd91c-1330-40d2-bd7f-96b0f45133a5 service nova] Lock "8220a084-e402-435a-b6a7-ffd94f91a211-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a4b63f37-eca5-4749-8149-9abb6c2653c6 req-739bd91c-1330-40d2-bd7f-96b0f45133a5 service nova] Lock "8220a084-e402-435a-b6a7-ffd94f91a211-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:31 user nova-compute[73484]: DEBUG nova.compute.manager [req-a4b63f37-eca5-4749-8149-9abb6c2653c6 req-739bd91c-1330-40d2-bd7f-96b0f45133a5 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] No waiting events found dispatching network-vif-plugged-3ef63421-a4aa-4126-b8ee-c141b2ef10cb {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:43:31 user nova-compute[73484]: WARNING nova.compute.manager [req-a4b63f37-eca5-4749-8149-9abb6c2653c6 req-739bd91c-1330-40d2-bd7f-96b0f45133a5 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Received unexpected event network-vif-plugged-3ef63421-a4aa-4126-b8ee-c141b2ef10cb for instance with vm_state active and task_state shelving_image_pending_upload.
Aug 14 13:43:31 user nova-compute[73484]: DEBUG nova.compute.manager [req-a4b63f37-eca5-4749-8149-9abb6c2653c6 req-739bd91c-1330-40d2-bd7f-96b0f45133a5 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Received event network-vif-unplugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a4b63f37-eca5-4749-8149-9abb6c2653c6 req-739bd91c-1330-40d2-bd7f-96b0f45133a5 service nova] Acquiring lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a4b63f37-eca5-4749-8149-9abb6c2653c6 req-739bd91c-1330-40d2-bd7f-96b0f45133a5 service nova] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a4b63f37-eca5-4749-8149-9abb6c2653c6 req-739bd91c-1330-40d2-bd7f-96b0f45133a5 service nova] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:31 user nova-compute[73484]: DEBUG nova.compute.manager [req-a4b63f37-eca5-4749-8149-9abb6c2653c6 req-739bd91c-1330-40d2-bd7f-96b0f45133a5 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] No waiting events found dispatching network-vif-unplugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:43:31 user nova-compute[73484]: WARNING nova.compute.manager [req-a4b63f37-eca5-4749-8149-9abb6c2653c6 req-739bd91c-1330-40d2-bd7f-96b0f45133a5 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Received unexpected event network-vif-unplugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 for instance with vm_state rescued and task_state unrescuing.
Aug 14 13:43:31 user nova-compute[73484]: DEBUG nova.compute.manager [req-a4b63f37-eca5-4749-8149-9abb6c2653c6 req-739bd91c-1330-40d2-bd7f-96b0f45133a5 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Received event network-vif-plugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a4b63f37-eca5-4749-8149-9abb6c2653c6 req-739bd91c-1330-40d2-bd7f-96b0f45133a5 service nova] Acquiring lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a4b63f37-eca5-4749-8149-9abb6c2653c6 req-739bd91c-1330-40d2-bd7f-96b0f45133a5 service nova] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a4b63f37-eca5-4749-8149-9abb6c2653c6 req-739bd91c-1330-40d2-bd7f-96b0f45133a5 service nova] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:32 user nova-compute[73484]: DEBUG nova.compute.manager [req-a4b63f37-eca5-4749-8149-9abb6c2653c6 req-739bd91c-1330-40d2-bd7f-96b0f45133a5 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] No waiting events found dispatching network-vif-plugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:43:32 user nova-compute[73484]: WARNING nova.compute.manager [req-a4b63f37-eca5-4749-8149-9abb6c2653c6 req-739bd91c-1330-40d2-bd7f-96b0f45133a5 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Received unexpected event network-vif-plugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 for instance with vm_state rescued and task_state unrescuing.
Aug 14 13:43:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk /opt/stack/data/nova/instances/snapshots/tmpl84otbxu/0fb83886aa9e433bb4c45ca2aa0840e0" returned: 0 in 1.160s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:32 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Snapshot extracted, beginning image upload
Aug 14 13:43:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:34 user nova-compute[73484]: DEBUG nova.compute.manager [req-b755652c-62a4-4630-8849-3972b3604a2e req-64ef32f2-ee37-40b9-9993-4d8a8705fe98 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Received event network-vif-plugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b755652c-62a4-4630-8849-3972b3604a2e req-64ef32f2-ee37-40b9-9993-4d8a8705fe98 service nova] Acquiring lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b755652c-62a4-4630-8849-3972b3604a2e req-64ef32f2-ee37-40b9-9993-4d8a8705fe98 service nova] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b755652c-62a4-4630-8849-3972b3604a2e req-64ef32f2-ee37-40b9-9993-4d8a8705fe98 service nova] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:34 user nova-compute[73484]: DEBUG nova.compute.manager [req-b755652c-62a4-4630-8849-3972b3604a2e req-64ef32f2-ee37-40b9-9993-4d8a8705fe98 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] No waiting events found dispatching network-vif-plugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:43:34 user nova-compute[73484]: WARNING nova.compute.manager [req-b755652c-62a4-4630-8849-3972b3604a2e req-64ef32f2-ee37-40b9-9993-4d8a8705fe98 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Received unexpected event network-vif-plugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 for instance with vm_state rescued and task_state unrescuing.
Aug 14 13:43:34 user nova-compute[73484]: DEBUG nova.compute.manager [req-b755652c-62a4-4630-8849-3972b3604a2e req-64ef32f2-ee37-40b9-9993-4d8a8705fe98 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Received event network-vif-plugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b755652c-62a4-4630-8849-3972b3604a2e req-64ef32f2-ee37-40b9-9993-4d8a8705fe98 service nova] Acquiring lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b755652c-62a4-4630-8849-3972b3604a2e req-64ef32f2-ee37-40b9-9993-4d8a8705fe98 service nova] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b755652c-62a4-4630-8849-3972b3604a2e req-64ef32f2-ee37-40b9-9993-4d8a8705fe98 service nova] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:34 user nova-compute[73484]: DEBUG nova.compute.manager [req-b755652c-62a4-4630-8849-3972b3604a2e req-64ef32f2-ee37-40b9-9993-4d8a8705fe98 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] No waiting events found dispatching network-vif-plugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:43:34 user nova-compute[73484]: WARNING nova.compute.manager [req-b755652c-62a4-4630-8849-3972b3604a2e req-64ef32f2-ee37-40b9-9993-4d8a8705fe98 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Received unexpected event network-vif-plugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 for instance with vm_state rescued and task_state unrescuing.
Aug 14 13:43:34 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Removed pending event for a9d4ec42-3db9-439b-87a7-02bcaab514a4 due to event {{(pid=73484) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 13:43:34 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020614.535764, a9d4ec42-3db9-439b-87a7-02bcaab514a4 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:43:34 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] VM Resumed (Lifecycle Event)
Aug 14 13:43:34 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6abd7896-303d-49cb-9b89-4a12a3729612 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:43:34 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:43:34 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:43:34 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 13:43:34 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020614.539046, a9d4ec42-3db9-439b-87a7-02bcaab514a4 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:43:34 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] VM Started (Lifecycle Event)
Aug 14 13:43:34 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:43:34 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:43:34 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Snapshot image upload complete
Aug 14 13:43:34 user nova-compute[73484]: DEBUG nova.compute.manager [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:43:34 user nova-compute[73484]: INFO nova.compute.manager [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Shelve offloading
Aug 14 13:43:34 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Instance destroyed successfully.
Aug 14 13:43:34 user nova-compute[73484]: DEBUG nova.compute.manager [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:43:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "refresh_cache-8220a084-e402-435a-b6a7-ffd94f91a211" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:43:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquired lock "refresh_cache-8220a084-e402-435a-b6a7-ffd94f91a211" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:43:34 user nova-compute[73484]: DEBUG nova.network.neutron [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:43:34 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:43:34 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 13:43:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-0a3a174b-d870-4164-891e-a2fa8cc8c8b8" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:43:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-0a3a174b-d870-4164-891e-a2fa8cc8c8b8" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:43:35 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 13:43:35 user nova-compute[73484]: DEBUG nova.network.neutron [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Updating instance_info_cache with network_info: [{"id": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "address": "fa:16:3e:ca:70:43", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef63421-a4", "ovs_interfaceid": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:43:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Releasing lock "refresh_cache-8220a084-e402-435a-b6a7-ffd94f91a211" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:43:35 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692020600.5089211, b889688d-13dd-4f7b-bfef-26dc5347fd6e => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:43:35 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] VM Stopped (Lifecycle Event)
Aug 14 13:43:35 user nova-compute[73484]: DEBUG nova.compute.manager [None req-10733cef-f195-4b36-83ad-b3e1710ac4a6 None None] [instance: b889688d-13dd-4f7b-bfef-26dc5347fd6e] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:43:35 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Updating instance_info_cache with network_info: [{"id": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "address": "fa:16:3e:b8:35:a4", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511cc5ad-6f", "ovs_interfaceid": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:43:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-0a3a174b-d870-4164-891e-a2fa8cc8c8b8" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:43:35 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 13:43:35 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:43:35 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Instance destroyed successfully.
Aug 14 13:43:35 user nova-compute[73484]: DEBUG nova.objects.instance [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lazy-loading 'resources' on Instance uuid 8220a084-e402-435a-b6a7-ffd94f91a211 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:43:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:41:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1500691485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1500691485',id=17,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbZYzDLzDUqAfp9/0tMMWal0Npb7Q9VW764vBVt/78de6sGHrTc6QryY/PPWtnTrkZNOrBVy1sS2Lv9880nGFfXr7m+xb6JqE7SCtrvvtov8Bx57jr2o0U2QK23gjDKkw==',key_name='tempest-keypair-1575579439',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:41:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0c1ccc7c1aaf497da5f1d325d79e9301',ramdisk_id='',reservation_id='r-j80xfzw1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1730232968',owner_user_name='tempest-AttachVolumeShelveTestJSON-1730232968-project-member',shelved_at='2023-08-14T13:43:34.697198',shelved_host='user',shelved_image_id='8d2c5d93-4597-4780-a862-ce810eb495fd'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:43:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bda36df8b1f64c7894bfee5da258c1e6',uuid=8220a084-e402-435a-b6a7-ffd94f91a211,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "address": "fa:16:3e:ca:70:43", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef63421-a4", "ovs_interfaceid": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:43:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Converting VIF {"id": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "address": "fa:16:3e:ca:70:43", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef63421-a4", "ovs_interfaceid": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:43:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:70:43,bridge_name='br-int',has_traffic_filtering=True,id=3ef63421-a4aa-4126-b8ee-c141b2ef10cb,network=Network(cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ef63421-a4') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:43:35 user nova-compute[73484]: DEBUG os_vif [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:70:43,bridge_name='br-int',has_traffic_filtering=True,id=3ef63421-a4aa-4126-b8ee-c141b2ef10cb,network=Network(cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ef63421-a4') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:43:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ef63421-a4, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:43:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:43:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:35 user nova-compute[73484]: INFO os_vif [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:70:43,bridge_name='br-int',has_traffic_filtering=True,id=3ef63421-a4aa-4126-b8ee-c141b2ef10cb,network=Network(cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ef63421-a4')
Aug 14 13:43:35 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Deleting instance files /opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211_del
Aug 14 13:43:35 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Deletion of /opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211_del complete
Aug 14 13:43:36 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Deleted allocations for instance 8220a084-e402-435a-b6a7-ffd94f91a211
Aug 14 13:43:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:36 user nova-compute[73484]: DEBUG nova.objects.instance [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lazy-loading 'numa_topology' on Instance uuid 8220a084-e402-435a-b6a7-ffd94f91a211 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:43:36 user nova-compute[73484]: DEBUG nova.compute.manager [req-aa93b489-42b3-4b02-8e31-8e44b1de6301 req-c99a0586-eb06-48aa-ba66-d19aebb596f7 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Received event network-changed-3ef63421-a4aa-4126-b8ee-c141b2ef10cb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:36 user nova-compute[73484]: DEBUG nova.compute.manager [req-aa93b489-42b3-4b02-8e31-8e44b1de6301 req-c99a0586-eb06-48aa-ba66-d19aebb596f7 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Refreshing instance network info cache due to event network-changed-3ef63421-a4aa-4126-b8ee-c141b2ef10cb. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:43:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-aa93b489-42b3-4b02-8e31-8e44b1de6301 req-c99a0586-eb06-48aa-ba66-d19aebb596f7 service nova] Acquiring lock "refresh_cache-8220a084-e402-435a-b6a7-ffd94f91a211" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:43:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-aa93b489-42b3-4b02-8e31-8e44b1de6301 req-c99a0586-eb06-48aa-ba66-d19aebb596f7 service nova] Acquired lock "refresh_cache-8220a084-e402-435a-b6a7-ffd94f91a211" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:43:36 user nova-compute[73484]: DEBUG nova.network.neutron [req-aa93b489-42b3-4b02-8e31-8e44b1de6301 req-c99a0586-eb06-48aa-ba66-d19aebb596f7 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Refreshing network info cache for port 3ef63421-a4aa-4126-b8ee-c141b2ef10cb {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:43:36 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:43:36 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:43:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b254da08-8f16-414a-ad55-4b6d01d12210 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "8220a084-e402-435a-b6a7-ffd94f91a211" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.097s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:36 user nova-compute[73484]: DEBUG nova.network.neutron [req-aa93b489-42b3-4b02-8e31-8e44b1de6301 req-c99a0586-eb06-48aa-ba66-d19aebb596f7 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Updated VIF entry in instance network info cache for port 3ef63421-a4aa-4126-b8ee-c141b2ef10cb. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:43:36 user nova-compute[73484]: DEBUG nova.network.neutron [req-aa93b489-42b3-4b02-8e31-8e44b1de6301 req-c99a0586-eb06-48aa-ba66-d19aebb596f7 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Updating instance_info_cache with network_info: [{"id": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "address": "fa:16:3e:ca:70:43", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap3ef63421-a4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:43:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-aa93b489-42b3-4b02-8e31-8e44b1de6301 req-c99a0586-eb06-48aa-ba66-d19aebb596f7 service nova] Releasing lock "refresh_cache-8220a084-e402-435a-b6a7-ffd94f91a211" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:43:36 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:43:36 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:43:36 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 13:43:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Acquiring lock "1c48c0d4-7d10-4086-b30f-61e71f358622" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Lock "1c48c0d4-7d10-4086-b30f-61e71f358622" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:37 user nova-compute[73484]: DEBUG nova.objects.instance [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Lazy-loading 'flavor' on Instance uuid 1c48c0d4-7d10-4086-b30f-61e71f358622 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:43:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Lock "1c48c0d4-7d10-4086-b30f-61e71f358622" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Acquiring lock "1c48c0d4-7d10-4086-b30f-61e71f358622" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Lock "1c48c0d4-7d10-4086-b30f-61e71f358622" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:37 user nova-compute[73484]: INFO nova.compute.manager [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Attaching volume 4883057a-5330-436c-b73a-16cf30eb6987 to /dev/vdb
Aug 14 13:43:37 user nova-compute[73484]: DEBUG os_brick.utils [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:43:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:37 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6f623e-fcec-48d2-9c25-7ea2923cdea2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:37 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[485c033f-544a-4547-86aa-283ab2febb39]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:37 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08fb867-54ad-4c46-8d2d-39133135f57b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:37 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d37e1d-c681-4c97-b19f-6b2bbff55695]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:43:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:43:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:43:37 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:43:37 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6770fc9-8ec1-4bd4-8506-c29314f8a6e5]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:43:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:43:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:43:37 user nova-compute[73484]: DEBUG os_brick.utils [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:43:37 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Updating existing volume attachment record: 2a01d4e6-fce4-4a4a-948f-57a70353bffa {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:43:37 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:43:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:37 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 13:43:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:38 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:43:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:43:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29855792-6422-4626-ae64-923c346b1eb9/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29855792-6422-4626-ae64-923c346b1eb9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29855792-6422-4626-ae64-923c346b1eb9/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29855792-6422-4626-ae64-923c346b1eb9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eed5f58-f09b-419a-ba10-7b1dd6f27f7f/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eed5f58-f09b-419a-ba10-7b1dd6f27f7f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eed5f58-f09b-419a-ba10-7b1dd6f27f7f/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eed5f58-f09b-419a-ba10-7b1dd6f27f7f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c48c0d4-7d10-4086-b30f-61e71f358622/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c48c0d4-7d10-4086-b30f-61e71f358622/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c48c0d4-7d10-4086-b30f-61e71f358622/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c48c0d4-7d10-4086-b30f-61e71f358622/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:41 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:43:41 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:43:41 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:43:42 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:43:42 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:43:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=6812MB free_disk=25.309005737304688GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 13:43:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance f4f7788c-fcca-47c1-b5b8-72892253982d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:43:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:43:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:43:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 07bac569-8b2c-4555-b4d5-a74f7384630b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:43:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance eaaccbea-d453-4943-9663-949c66029d87 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:43:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance a9d4ec42-3db9-439b-87a7-02bcaab514a4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:43:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance ed239af5-980e-42d3-8ebd-ca100ccb2708 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:43:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance bd43e3a9-0413-4e55-b6a1-7f3f792ba872 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:43:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 1c48c0d4-7d10-4086-b30f-61e71f358622 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:43:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 8a3b8885-1940-4a92-82f4-c65c84bbf11e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:43:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 09ba29fd-8161-485c-ba6d-71d24ab086bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:43:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 29855792-6422-4626-ae64-923c346b1eb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:43:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:43:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 13:43:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 13:43:42 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:43:42 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:43:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 13:43:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.549s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:44 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:43:44 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:43:44 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:43:44 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:43:45 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692020610.6905844, 8220a084-e402-435a-b6a7-ffd94f91a211 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:43:45 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] VM Stopped (Lifecycle Event)
Aug 14 13:43:45 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0cd4a16c-0386-4c1c-bc36-63717fd74495 None None] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:43:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'afxMDwoI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:43:46 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:43:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:43:46 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:43:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:43:46 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[62117ad6-7b1b-458d-b19d-f06f13712734]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:43:46 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987 -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e48e68d-0f7f-492a-81cf-24774e37cc4d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987] added
Aug 14 13:43:46 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddd01ae-5945-4cac-8be5-98cc14bdfc42]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd34693f-ba84-42cc-9fa4-3ae545bcd5be]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v afxMDwoI {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v afxMDwoI" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c6b75b-e1ce-4748-bea1-aa4b7f0fac06]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'afxMDwoI'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[078c43b5-36cc-4757-83ec-e63c915ade5c]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[98196b8e-db81-44e7-9b87-d974f8e0f78a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:43:46 user nova-compute[73484]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)
Aug 14 13:43:46 user nova-compute[73484]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)
Aug 14 13:43:46 user nova-compute[73484]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 (non-flash)
Aug 14 13:43:46 user nova-compute[73484]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:43:46 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:43:46 user nova-compute[73484]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)
Aug 14 13:43:46 user nova-compute[73484]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)
Aug 14 13:43:46 user nova-compute[73484]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 (non-flash)
Aug 14 13:43:46 user nova-compute[73484]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:43:46 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987 -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[641b04c3-ee38-4bf0-b1c7-8c85e466619d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987, portal: 172.16.0.220,3260]
Aug 14 13:43:46 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987, portal: 172.16.0.220,3260] successful.
Aug 14 13:43:46 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e4f190-3e1e-4084-b476-c625a79fb181]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab203603-018b-4902-93d6-d594e3b76d54]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:43:46 user nova-compute[73484]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)
Aug 14 13:43:46 user nova-compute[73484]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)
Aug 14 13:43:46 user nova-compute[73484]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 (non-flash)
Aug 14 13:43:46 user nova-compute[73484]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:43:46 user nova-compute[73484]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987 (non-flash)
Aug 14 13:43:46 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:43:46 user nova-compute[73484]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)
Aug 14 13:43:46 user nova-compute[73484]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)
Aug 14 13:43:46 user nova-compute[73484]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 (non-flash)
Aug 14 13:43:46 user nova-compute[73484]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:43:46 user nova-compute[73484]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987 (non-flash)
Aug 14 13:43:46 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33515f5-d211-46f5-9e74-6ab6a962a2ce]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:46 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: None {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:43:47 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:43:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'afxMDwoI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:43:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:43:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26334653562323930', 'path': '/dev/sdc'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:43:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334653562323930', 'path': '/dev/sdc'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:43:47 user nova-compute[73484]: DEBUG nova.objects.instance [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Lazy-loading 'flavor' on Instance uuid 1c48c0d4-7d10-4086-b30f-61e71f358622 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:43:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 13:43:47 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:43:47 user nova-compute[73484]:   <source dev="/dev/sdc"/>
Aug 14 13:43:47 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:43:47 user nova-compute[73484]:   <serial>4883057a-5330-436c-b73a-16cf30eb6987</serial>
Aug 14 13:43:47 user nova-compute[73484]: </disk>
Aug 14 13:43:47 user nova-compute[73484]:  {{(pid=73484) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 13:43:48 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:43:48 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:43:48 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] No VIF found with MAC fa:16:3e:c1:7a:84, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:43:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5c3154e3-636e-40b8-a0e2-0be43f44d655 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Lock "1c48c0d4-7d10-4086-b30f-61e71f358622" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.227s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Acquiring lock "1c48c0d4-7d10-4086-b30f-61e71f358622" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Lock "1c48c0d4-7d10-4086-b30f-61e71f358622" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Acquiring lock "1c48c0d4-7d10-4086-b30f-61e71f358622-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Lock "1c48c0d4-7d10-4086-b30f-61e71f358622-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Lock "1c48c0d4-7d10-4086-b30f-61e71f358622-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:49 user nova-compute[73484]: INFO nova.compute.manager [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Terminating instance
Aug 14 13:43:49 user nova-compute[73484]: DEBUG nova.compute.manager [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:43:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:49 user nova-compute[73484]: DEBUG nova.compute.manager [req-ee5d95d7-73fd-4117-b87e-2b7230519295 req-16086d39-a060-4785-b7c1-f0a71ac3529d service nova] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Received event network-vif-unplugged-e4f351b4-1dd3-4d2b-ae56-dd96cda44d26 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ee5d95d7-73fd-4117-b87e-2b7230519295 req-16086d39-a060-4785-b7c1-f0a71ac3529d service nova] Acquiring lock "1c48c0d4-7d10-4086-b30f-61e71f358622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ee5d95d7-73fd-4117-b87e-2b7230519295 req-16086d39-a060-4785-b7c1-f0a71ac3529d service nova] Lock "1c48c0d4-7d10-4086-b30f-61e71f358622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ee5d95d7-73fd-4117-b87e-2b7230519295 req-16086d39-a060-4785-b7c1-f0a71ac3529d service nova] Lock "1c48c0d4-7d10-4086-b30f-61e71f358622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:49 user nova-compute[73484]: DEBUG nova.compute.manager [req-ee5d95d7-73fd-4117-b87e-2b7230519295 req-16086d39-a060-4785-b7c1-f0a71ac3529d service nova] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] No waiting events found dispatching network-vif-unplugged-e4f351b4-1dd3-4d2b-ae56-dd96cda44d26 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:43:49 user nova-compute[73484]: DEBUG nova.compute.manager [req-ee5d95d7-73fd-4117-b87e-2b7230519295 req-16086d39-a060-4785-b7c1-f0a71ac3529d service nova] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Received event network-vif-unplugged-e4f351b4-1dd3-4d2b-ae56-dd96cda44d26 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:43:49 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Instance destroyed successfully.
Aug 14 13:43:49 user nova-compute[73484]: DEBUG nova.objects.instance [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Lazy-loading 'resources' on Instance uuid 1c48c0d4-7d10-4086-b30f-61e71f358622 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:43:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:41:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-822383854',display_name='tempest-DeleteServersTestJSON-server-822383854',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-822383854',id=18,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:41:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f289d1ed47534aeb867493f618d25e73',ramdisk_id='',reservation_id='r-medz9qls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1793376884',owner_user_name='tempest-DeleteServersTestJSON-1793376884-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:41:53Z,user_data=None,user_id='ec7bc3cba1744dd4b8c3bda4b21046ce',uuid=1c48c0d4-7d10-4086-b30f-61e71f358622,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4f351b4-1dd3-4d2b-ae56-dd96cda44d26", "address": "fa:16:3e:c1:7a:84", "network": {"id": "6d30d7cf-8241-42c2-8618-d5531c996de7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1252938421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f289d1ed47534aeb867493f618d25e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4f351b4-1d", "ovs_interfaceid": "e4f351b4-1dd3-4d2b-ae56-dd96cda44d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:43:49 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Converting VIF {"id": "e4f351b4-1dd3-4d2b-ae56-dd96cda44d26", "address": "fa:16:3e:c1:7a:84", "network": {"id": "6d30d7cf-8241-42c2-8618-d5531c996de7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1252938421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f289d1ed47534aeb867493f618d25e73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4f351b4-1d", "ovs_interfaceid": "e4f351b4-1dd3-4d2b-ae56-dd96cda44d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:43:49 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:7a:84,bridge_name='br-int',has_traffic_filtering=True,id=e4f351b4-1dd3-4d2b-ae56-dd96cda44d26,network=Network(6d30d7cf-8241-42c2-8618-d5531c996de7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4f351b4-1d') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:43:49 user nova-compute[73484]: DEBUG os_vif [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:7a:84,bridge_name='br-int',has_traffic_filtering=True,id=e4f351b4-1dd3-4d2b-ae56-dd96cda44d26,network=Network(6d30d7cf-8241-42c2-8618-d5531c996de7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4f351b4-1d') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:43:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4f351b4-1d, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:43:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:50 user nova-compute[73484]: INFO os_vif [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:7a:84,bridge_name='br-int',has_traffic_filtering=True,id=e4f351b4-1dd3-4d2b-ae56-dd96cda44d26,network=Network(6d30d7cf-8241-42c2-8618-d5531c996de7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4f351b4-1d')
Aug 14 13:43:50 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'afxMDwoI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:43:50 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:43:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a44d65-b70f-4b00-84da-9b3699885adb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0879b54f-b838-478d-bdba-54edada3a63b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:43:50 user nova-compute[73484]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)
Aug 14 13:43:50 user nova-compute[73484]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)
Aug 14 13:43:50 user nova-compute[73484]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 (non-flash)
Aug 14 13:43:50 user nova-compute[73484]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:43:50 user nova-compute[73484]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987 (non-flash)
Aug 14 13:43:50 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:43:50 user nova-compute[73484]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)
Aug 14 13:43:50 user nova-compute[73484]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)
Aug 14 13:43:50 user nova-compute[73484]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 (non-flash)
Aug 14 13:43:50 user nova-compute[73484]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:43:50 user nova-compute[73484]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987 (non-flash)
Aug 14 13:43:50 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc49301b6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987'): ({'sdc'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Removing single pathed devices sdc {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe3da11-69c7-4eb5-8dbc-2bbc02ea09c3]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffb6c56-b8d0-4799-bc1b-899c3fa6ceb8]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Flushing IO for device /dev/sdc {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05120cd-085f-4202-995d-17cd3cd146f7]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[844a2ce3-460b-41e2-aaae-46a12f04fce7]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ad941d-8e64-4640-b3c9-115676cfffa7]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987 -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1b4bfa-00e4-4034-9b9f-23f2f7fac225]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987, portal: 172.16.0.220,3260]
Aug 14 13:43:50 user nova-compute[73484]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987, portal: 172.16.0.220,3260] successful.
Aug 14 13:43:50 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987 -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4883057a-5330-436c-b73a-16cf30eb6987 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e754d1b-03bf-47d0-aa37-4fe509be99c6]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.434s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] <== disconnect_volume: return (435ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:43:50 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Deleting instance files /opt/stack/data/nova/instances/1c48c0d4-7d10-4086-b30f-61e71f358622_del
Aug 14 13:43:50 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Deletion of /opt/stack/data/nova/instances/1c48c0d4-7d10-4086-b30f-61e71f358622_del complete
Aug 14 13:43:50 user nova-compute[73484]: INFO nova.compute.manager [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Took 1.34 seconds to destroy the instance on the hypervisor.
Aug 14 13:43:50 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:43:50 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Took 0.43 seconds to deallocate network for instance.
Aug 14 13:43:50 user nova-compute[73484]: DEBUG nova.compute.manager [req-7cc3a981-9873-4e9d-9333-d72c235af9fa req-e1b335bd-8c72-4698-8314-f4e4eca634e3 service nova] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Received event network-vif-deleted-e4f351b4-1dd3-4d2b-ae56-dd96cda44d26 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:50 user nova-compute[73484]: INFO nova.compute.manager [req-7cc3a981-9873-4e9d-9333-d72c235af9fa req-e1b335bd-8c72-4698-8314-f4e4eca634e3 service nova] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Neutron deleted interface e4f351b4-1dd3-4d2b-ae56-dd96cda44d26; detaching it from the instance and deleting it from the info cache
Aug 14 13:43:50 user nova-compute[73484]: DEBUG nova.network.neutron [req-7cc3a981-9873-4e9d-9333-d72c235af9fa req-e1b335bd-8c72-4698-8314-f4e4eca634e3 service nova] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:43:50 user nova-compute[73484]: DEBUG nova.compute.manager [req-7cc3a981-9873-4e9d-9333-d72c235af9fa req-e1b335bd-8c72-4698-8314-f4e4eca634e3 service nova] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Detach interface failed, port_id=e4f351b4-1dd3-4d2b-ae56-dd96cda44d26, reason: Instance 1c48c0d4-7d10-4086-b30f-61e71f358622 could not be found. {{(pid=73484) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 13:43:51 user nova-compute[73484]: DEBUG nova.compute.manager [req-0440cefd-b94f-4f75-b649-62154da74be8 req-7031989d-1e5c-4821-9513-76175b1d6d73 service nova] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Received event network-vif-plugged-e4f351b4-1dd3-4d2b-ae56-dd96cda44d26 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:43:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0440cefd-b94f-4f75-b649-62154da74be8 req-7031989d-1e5c-4821-9513-76175b1d6d73 service nova] Acquiring lock "1c48c0d4-7d10-4086-b30f-61e71f358622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0440cefd-b94f-4f75-b649-62154da74be8 req-7031989d-1e5c-4821-9513-76175b1d6d73 service nova] Lock "1c48c0d4-7d10-4086-b30f-61e71f358622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0440cefd-b94f-4f75-b649-62154da74be8 req-7031989d-1e5c-4821-9513-76175b1d6d73 service nova] Lock "1c48c0d4-7d10-4086-b30f-61e71f358622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:51 user nova-compute[73484]: DEBUG nova.compute.manager [req-0440cefd-b94f-4f75-b649-62154da74be8 req-7031989d-1e5c-4821-9513-76175b1d6d73 service nova] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] No waiting events found dispatching network-vif-plugged-e4f351b4-1dd3-4d2b-ae56-dd96cda44d26 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:43:51 user nova-compute[73484]: WARNING nova.compute.manager [req-0440cefd-b94f-4f75-b649-62154da74be8 req-7031989d-1e5c-4821-9513-76175b1d6d73 service nova] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Received unexpected event network-vif-plugged-e4f351b4-1dd3-4d2b-ae56-dd96cda44d26 for instance with vm_state active and task_state deleting.
Aug 14 13:43:51 user nova-compute[73484]: INFO nova.compute.manager [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Took 0.72 seconds to detach 1 volumes for instance.
Aug 14 13:43:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:43:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:43:52 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:43:52 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:43:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:52 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Deleted allocations for instance 1c48c0d4-7d10-4086-b30f-61e71f358622
Aug 14 13:43:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9f909d05-f322-4240-ab1f-0e6f1655a2c8 tempest-DeleteServersTestJSON-1793376884 tempest-DeleteServersTestJSON-1793376884-project-member] Lock "1c48c0d4-7d10-4086-b30f-61e71f358622" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.011s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:43:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:43:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:04 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692020629.9615743, 1c48c0d4-7d10-4086-b30f-61e71f358622 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:44:04 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] VM Stopped (Lifecycle Event)
Aug 14 13:44:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:44:05 user nova-compute[73484]: DEBUG nova.compute.manager [None req-b8417b89-3198-485e-960c-547255f0e0e9 None None] [instance: 1c48c0d4-7d10-4086-b30f-61e71f358622] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:44:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-47411160-c149-4223-b512-56a1f737eff1 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Acquiring lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:44:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-47411160-c149-4223-b512-56a1f737eff1 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:44:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-47411160-c149-4223-b512-56a1f737eff1 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Acquiring lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:44:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-47411160-c149-4223-b512-56a1f737eff1 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:44:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-47411160-c149-4223-b512-56a1f737eff1 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:44:08 user nova-compute[73484]: INFO nova.compute.manager [None req-47411160-c149-4223-b512-56a1f737eff1 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Terminating instance
Aug 14 13:44:08 user nova-compute[73484]: DEBUG nova.compute.manager [None req-47411160-c149-4223-b512-56a1f737eff1 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:44:08 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:08 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:08 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:08 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:09 user nova-compute[73484]: DEBUG nova.compute.manager [req-3b75d3cc-a14a-44a5-9e2f-8c7297e987d3 req-b723af57-57c7-4da2-ac99-4b2cf1a97177 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Received event network-vif-unplugged-290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:44:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3b75d3cc-a14a-44a5-9e2f-8c7297e987d3 req-b723af57-57c7-4da2-ac99-4b2cf1a97177 service nova] Acquiring lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:44:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3b75d3cc-a14a-44a5-9e2f-8c7297e987d3 req-b723af57-57c7-4da2-ac99-4b2cf1a97177 service nova] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:44:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3b75d3cc-a14a-44a5-9e2f-8c7297e987d3 req-b723af57-57c7-4da2-ac99-4b2cf1a97177 service nova] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:44:09 user nova-compute[73484]: DEBUG nova.compute.manager [req-3b75d3cc-a14a-44a5-9e2f-8c7297e987d3 req-b723af57-57c7-4da2-ac99-4b2cf1a97177 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] No waiting events found dispatching network-vif-unplugged-290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:44:09 user nova-compute[73484]: DEBUG nova.compute.manager [req-3b75d3cc-a14a-44a5-9e2f-8c7297e987d3 req-b723af57-57c7-4da2-ac99-4b2cf1a97177 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Received event network-vif-unplugged-290c0b61-ba11-4074-a7f2-cb172a576a19 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:44:09 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Instance destroyed successfully.
Aug 14 13:44:09 user nova-compute[73484]: DEBUG nova.objects.instance [None req-47411160-c149-4223-b512-56a1f737eff1 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lazy-loading 'resources' on Instance uuid 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:44:09 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-47411160-c149-4223-b512-56a1f737eff1 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:36:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1545246932',display_name='tempest-ServerStableDeviceRescueTest-server-1545246932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1545246932',id=4,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNnPFytjTYkiccqtCpAzJGkmVj4GkS19LS49sca5TI0sqXkCY1rk1X/hROtXBUUkImQA/+wT95tfW91orX+01oToWNzGrpj6pbVY4SfyVkrwI//uxjHErhihJanzPyxbg==',key_name='tempest-keypair-183088637',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:41:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1ea5214248845418e322d18d298c449',ramdisk_id='',reservation_id='r-x171fkwc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-779507232',owner_user_name='tempest-ServerStableDeviceRescueTest-779507232-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c0b51afa7a147ce9a3047642651c6bb',uuid=66e161f1-2f3b-4777-9a0d-5f4d62e850d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "290c0b61-ba11-4074-a7f2-cb172a576a19", "address": "fa:16:3e:69:2f:ce", "network": {"id": "2306cc91-8443-4c0e-b5a6-3883766b686a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-577320480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ea5214248845418e322d18d298c449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap290c0b61-ba", "ovs_interfaceid": "290c0b61-ba11-4074-a7f2-cb172a576a19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:44:09 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-47411160-c149-4223-b512-56a1f737eff1 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Converting VIF {"id": "290c0b61-ba11-4074-a7f2-cb172a576a19", "address": "fa:16:3e:69:2f:ce", "network": {"id": "2306cc91-8443-4c0e-b5a6-3883766b686a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-577320480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1ea5214248845418e322d18d298c449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap290c0b61-ba", "ovs_interfaceid": "290c0b61-ba11-4074-a7f2-cb172a576a19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:44:09 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-47411160-c149-4223-b512-56a1f737eff1 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:2f:ce,bridge_name='br-int',has_traffic_filtering=True,id=290c0b61-ba11-4074-a7f2-cb172a576a19,network=Network(2306cc91-8443-4c0e-b5a6-3883766b686a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap290c0b61-ba') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:44:09 user nova-compute[73484]: DEBUG os_vif [None req-47411160-c149-4223-b512-56a1f737eff1 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:2f:ce,bridge_name='br-int',has_traffic_filtering=True,id=290c0b61-ba11-4074-a7f2-cb172a576a19,network=Network(2306cc91-8443-4c0e-b5a6-3883766b686a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap290c0b61-ba') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:44:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap290c0b61-ba, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:44:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:44:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:09 user nova-compute[73484]: INFO os_vif [None req-47411160-c149-4223-b512-56a1f737eff1 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:2f:ce,bridge_name='br-int',has_traffic_filtering=True,id=290c0b61-ba11-4074-a7f2-cb172a576a19,network=Network(2306cc91-8443-4c0e-b5a6-3883766b686a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap290c0b61-ba')
Aug 14 13:44:09 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-47411160-c149-4223-b512-56a1f737eff1 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Deleting instance files /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5_del
Aug 14 13:44:09 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-47411160-c149-4223-b512-56a1f737eff1 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Deletion of /opt/stack/data/nova/instances/66e161f1-2f3b-4777-9a0d-5f4d62e850d5_del complete
Aug 14 13:44:09 user nova-compute[73484]: INFO nova.compute.manager [None req-47411160-c149-4223-b512-56a1f737eff1 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 14 13:44:09 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-47411160-c149-4223-b512-56a1f737eff1 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:44:09 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:44:09 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:44:10 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:44:10 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Took 1.25 seconds to deallocate network for instance.
Aug 14 13:44:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-47411160-c149-4223-b512-56a1f737eff1 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:44:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-47411160-c149-4223-b512-56a1f737eff1 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:44:11 user nova-compute[73484]: DEBUG nova.compute.manager [req-4489ea92-4f46-4687-bd7f-c3d72463060f req-248d98b4-1cb6-4be6-8789-9c3fd748e405 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Received event network-vif-plugged-290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:44:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4489ea92-4f46-4687-bd7f-c3d72463060f req-248d98b4-1cb6-4be6-8789-9c3fd748e405 service nova] Acquiring lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:44:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4489ea92-4f46-4687-bd7f-c3d72463060f req-248d98b4-1cb6-4be6-8789-9c3fd748e405 service nova] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:44:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4489ea92-4f46-4687-bd7f-c3d72463060f req-248d98b4-1cb6-4be6-8789-9c3fd748e405 service nova] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:44:11 user nova-compute[73484]: DEBUG nova.compute.manager [req-4489ea92-4f46-4687-bd7f-c3d72463060f req-248d98b4-1cb6-4be6-8789-9c3fd748e405 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] No waiting events found dispatching network-vif-plugged-290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:44:11 user nova-compute[73484]: WARNING nova.compute.manager [req-4489ea92-4f46-4687-bd7f-c3d72463060f req-248d98b4-1cb6-4be6-8789-9c3fd748e405 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Received unexpected event network-vif-plugged-290c0b61-ba11-4074-a7f2-cb172a576a19 for instance with vm_state deleted and task_state None.
Aug 14 13:44:11 user nova-compute[73484]: DEBUG nova.compute.manager [req-4489ea92-4f46-4687-bd7f-c3d72463060f req-248d98b4-1cb6-4be6-8789-9c3fd748e405 service nova] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Received event network-vif-deleted-290c0b61-ba11-4074-a7f2-cb172a576a19 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:44:11 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-47411160-c149-4223-b512-56a1f737eff1 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:44:11 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-47411160-c149-4223-b512-56a1f737eff1 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:44:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-47411160-c149-4223-b512-56a1f737eff1 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:44:11 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-47411160-c149-4223-b512-56a1f737eff1 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Deleted allocations for instance 66e161f1-2f3b-4777-9a0d-5f4d62e850d5
Aug 14 13:44:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-47411160-c149-4223-b512-56a1f737eff1 tempest-ServerStableDeviceRescueTest-779507232 tempest-ServerStableDeviceRescueTest-779507232-project-member] Lock "66e161f1-2f3b-4777-9a0d-5f4d62e850d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.657s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:44:13 user nova-compute[73484]: DEBUG nova.compute.manager [req-a41601d7-7ddc-444b-ab93-5b0f2542219b req-43ff9cf3-57ff-4fd8-84e6-c077e74c19e1 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-changed-ec36c6e8-45d2-469b-b874-e9d3a10314f9 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:44:13 user nova-compute[73484]: DEBUG nova.compute.manager [req-a41601d7-7ddc-444b-ab93-5b0f2542219b req-43ff9cf3-57ff-4fd8-84e6-c077e74c19e1 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Refreshing instance network info cache due to event network-changed-ec36c6e8-45d2-469b-b874-e9d3a10314f9. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:44:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a41601d7-7ddc-444b-ab93-5b0f2542219b req-43ff9cf3-57ff-4fd8-84e6-c077e74c19e1 service nova] Acquiring lock "refresh_cache-8a3b8885-1940-4a92-82f4-c65c84bbf11e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:44:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a41601d7-7ddc-444b-ab93-5b0f2542219b req-43ff9cf3-57ff-4fd8-84e6-c077e74c19e1 service nova] Acquired lock "refresh_cache-8a3b8885-1940-4a92-82f4-c65c84bbf11e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:44:13 user nova-compute[73484]: DEBUG nova.network.neutron [req-a41601d7-7ddc-444b-ab93-5b0f2542219b req-43ff9cf3-57ff-4fd8-84e6-c077e74c19e1 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Refreshing network info cache for port ec36c6e8-45d2-469b-b874-e9d3a10314f9 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:44:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:14 user nova-compute[73484]: DEBUG nova.network.neutron [req-a41601d7-7ddc-444b-ab93-5b0f2542219b req-43ff9cf3-57ff-4fd8-84e6-c077e74c19e1 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Updated VIF entry in instance network info cache for port ec36c6e8-45d2-469b-b874-e9d3a10314f9. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:44:14 user nova-compute[73484]: DEBUG nova.network.neutron [req-a41601d7-7ddc-444b-ab93-5b0f2542219b req-43ff9cf3-57ff-4fd8-84e6-c077e74c19e1 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Updating instance_info_cache with network_info: [{"id": "ec36c6e8-45d2-469b-b874-e9d3a10314f9", "address": "fa:16:3e:bf:2c:42", "network": {"id": "cf1afc3e-d2cd-48ff-b311-1c7415960df4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-690860686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec36c6e8-45", "ovs_interfaceid": "ec36c6e8-45d2-469b-b874-e9d3a10314f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "address": "fa:16:3e:7c:c1:ab", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5259f8bf-c5", "ovs_interfaceid": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45079f89-4586-4c56-824b-cf112200e102", "address": "fa:16:3e:16:d7:b1", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45079f89-45", "ovs_interfaceid": "45079f89-4586-4c56-824b-cf112200e102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "address": "fa:16:3e:fe:36:1f", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ddd484-97", "ovs_interfaceid": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f8f67d05-60f1-4a23-afdb-f26e4d8976ed", "address": "fa:16:3e:c4:ff:42", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f67d05-60", "ovs_interfaceid": "f8f67d05-60f1-4a23-afdb-f26e4d8976ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b192f20f-10a5-4370-8e81-4a6faa679942", "address": "fa:16:3e:38:e6:44", "network": {"id": "1511c9d9-7c94-4100-811f-af762219ba90", "bridge": "br-int", "label": "tempest-device-tagging-net2-709970726", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb192f20f-10", "ovs_interfaceid": "b192f20f-10a5-4370-8e81-4a6faa679942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4", "address": "fa:16:3e:f2:f3:58", "network": {"id": "1511c9d9-7c94-4100-811f-af762219ba90", "bridge": "br-int", "label": "tempest-device-tagging-net2-709970726", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda15c9a3-5f", "ovs_interfaceid": "da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:44:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a41601d7-7ddc-444b-ab93-5b0f2542219b req-43ff9cf3-57ff-4fd8-84e6-c077e74c19e1 service nova] Releasing lock "refresh_cache-8a3b8885-1940-4a92-82f4-c65c84bbf11e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:44:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:44:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:44:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:44:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:44:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:44:15 user nova-compute[73484]: INFO nova.compute.manager [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Terminating instance
Aug 14 13:44:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:44:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG nova.compute.manager [req-470c2e7a-0c7f-4908-83b8-36560714bed7 req-c8fc2bb7-2c3e-43f8-bd06-66a8b6245e31 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-unplugged-ec36c6e8-45d2-469b-b874-e9d3a10314f9 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-470c2e7a-0c7f-4908-83b8-36560714bed7 req-c8fc2bb7-2c3e-43f8-bd06-66a8b6245e31 service nova] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-470c2e7a-0c7f-4908-83b8-36560714bed7 req-c8fc2bb7-2c3e-43f8-bd06-66a8b6245e31 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-470c2e7a-0c7f-4908-83b8-36560714bed7 req-c8fc2bb7-2c3e-43f8-bd06-66a8b6245e31 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG nova.compute.manager [req-470c2e7a-0c7f-4908-83b8-36560714bed7 req-c8fc2bb7-2c3e-43f8-bd06-66a8b6245e31 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] No waiting events found dispatching network-vif-unplugged-ec36c6e8-45d2-469b-b874-e9d3a10314f9 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG nova.compute.manager [req-470c2e7a-0c7f-4908-83b8-36560714bed7 req-c8fc2bb7-2c3e-43f8-bd06-66a8b6245e31 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-unplugged-ec36c6e8-45d2-469b-b874-e9d3a10314f9 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG nova.compute.manager [req-9fc9eeaf-eca9-429e-965d-b8bea7ca910d req-99e3a7eb-b4bc-4c25-9703-fd8330e210c8 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-unplugged-5259f8bf-c556-4ac0-9587-1633b3cf47e4 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-9fc9eeaf-eca9-429e-965d-b8bea7ca910d req-99e3a7eb-b4bc-4c25-9703-fd8330e210c8 service nova] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-9fc9eeaf-eca9-429e-965d-b8bea7ca910d req-99e3a7eb-b4bc-4c25-9703-fd8330e210c8 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-9fc9eeaf-eca9-429e-965d-b8bea7ca910d req-99e3a7eb-b4bc-4c25-9703-fd8330e210c8 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG nova.compute.manager [req-9fc9eeaf-eca9-429e-965d-b8bea7ca910d req-99e3a7eb-b4bc-4c25-9703-fd8330e210c8 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] No waiting events found dispatching network-vif-unplugged-5259f8bf-c556-4ac0-9587-1633b3cf47e4 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG nova.compute.manager [req-9fc9eeaf-eca9-429e-965d-b8bea7ca910d req-99e3a7eb-b4bc-4c25-9703-fd8330e210c8 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-unplugged-5259f8bf-c556-4ac0-9587-1633b3cf47e4 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG nova.compute.manager [req-b0517b62-2988-4cb0-aa8e-7ab14a4ba931 req-a8389e5e-80e0-4f00-a343-e999fb0da460 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-unplugged-b192f20f-10a5-4370-8e81-4a6faa679942 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b0517b62-2988-4cb0-aa8e-7ab14a4ba931 req-a8389e5e-80e0-4f00-a343-e999fb0da460 service nova] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b0517b62-2988-4cb0-aa8e-7ab14a4ba931 req-a8389e5e-80e0-4f00-a343-e999fb0da460 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b0517b62-2988-4cb0-aa8e-7ab14a4ba931 req-a8389e5e-80e0-4f00-a343-e999fb0da460 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG nova.compute.manager [req-b0517b62-2988-4cb0-aa8e-7ab14a4ba931 req-a8389e5e-80e0-4f00-a343-e999fb0da460 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] No waiting events found dispatching network-vif-unplugged-b192f20f-10a5-4370-8e81-4a6faa679942 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG nova.compute.manager [req-b0517b62-2988-4cb0-aa8e-7ab14a4ba931 req-a8389e5e-80e0-4f00-a343-e999fb0da460 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-unplugged-b192f20f-10a5-4370-8e81-4a6faa679942 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:44:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:17 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Instance destroyed successfully.
Aug 14 13:44:17 user nova-compute[73484]: DEBUG nova.objects.instance [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lazy-loading 'resources' on Instance uuid 8a3b8885-1940-4a92-82f4-c65c84bbf11e {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:42:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-887610754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-887610754',id=19,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi0gS+WpIKrgrS0mV0bR1l62g9OmjDCiprCWZONRUMZMQmvGO1TchMpbMfyKFCnzFTqOV6VmF0HLgUjtWXXpnGjIQdt8wNFklgDRvpfiHHZ16Ur5FAWNB3hO3OjZ335hw==',key_name='tempest-keypair-672802766',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:43:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8d4635233ed41bca48d5dc2a709b076',ramdisk_id='',reservation_id='r-3ylp5ayp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1908642749',owner_user_name='tempest-TaggedBootDevicesTest-1908642749-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:43:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729ad05102d7403e8aaa34a6c17f1a1d',uuid=8a3b8885-1940-4a92-82f4-c65c84bbf11e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec36c6e8-45d2-469b-b874-e9d3a10314f9", "address": "fa:16:3e:bf:2c:42", "network": {"id": "cf1afc3e-d2cd-48ff-b311-1c7415960df4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-690860686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec36c6e8-45", "ovs_interfaceid": "ec36c6e8-45d2-469b-b874-e9d3a10314f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converting VIF {"id": "ec36c6e8-45d2-469b-b874-e9d3a10314f9", "address": "fa:16:3e:bf:2c:42", "network": {"id": "cf1afc3e-d2cd-48ff-b311-1c7415960df4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-690860686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec36c6e8-45", "ovs_interfaceid": "ec36c6e8-45d2-469b-b874-e9d3a10314f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:2c:42,bridge_name='br-int',has_traffic_filtering=True,id=ec36c6e8-45d2-469b-b874-e9d3a10314f9,network=Network(cf1afc3e-d2cd-48ff-b311-1c7415960df4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec36c6e8-45') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG os_vif [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:2c:42,bridge_name='br-int',has_traffic_filtering=True,id=ec36c6e8-45d2-469b-b874-e9d3a10314f9,network=Network(cf1afc3e-d2cd-48ff-b311-1c7415960df4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec36c6e8-45') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec36c6e8-45, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:17 user nova-compute[73484]: INFO os_vif [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:2c:42,bridge_name='br-int',has_traffic_filtering=True,id=ec36c6e8-45d2-469b-b874-e9d3a10314f9,network=Network(cf1afc3e-d2cd-48ff-b311-1c7415960df4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec36c6e8-45')
Aug 14 13:44:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:42:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-887610754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-887610754',id=19,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi0gS+WpIKrgrS0mV0bR1l62g9OmjDCiprCWZONRUMZMQmvGO1TchMpbMfyKFCnzFTqOV6VmF0HLgUjtWXXpnGjIQdt8wNFklgDRvpfiHHZ16Ur5FAWNB3hO3OjZ335hw==',key_name='tempest-keypair-672802766',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:43:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8d4635233ed41bca48d5dc2a709b076',ramdisk_id='',reservation_id='r-3ylp5ayp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1908642749',owner_user_name='tempest-TaggedBootDevicesTest-1908642749-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:43:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729ad05102d7403e8aaa34a6c17f1a1d',uuid=8a3b8885-1940-4a92-82f4-c65c84bbf11e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "address": "fa:16:3e:7c:c1:ab", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5259f8bf-c5", "ovs_interfaceid": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converting VIF {"id": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "address": "fa:16:3e:7c:c1:ab", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5259f8bf-c5", "ovs_interfaceid": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c1:ab,bridge_name='br-int',has_traffic_filtering=True,id=5259f8bf-c556-4ac0-9587-1633b3cf47e4,network=Network(cca9bd37-0d08-4714-a528-3c47a406ad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5259f8bf-c5') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG os_vif [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c1:ab,bridge_name='br-int',has_traffic_filtering=True,id=5259f8bf-c556-4ac0-9587-1633b3cf47e4,network=Network(cca9bd37-0d08-4714-a528-3c47a406ad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5259f8bf-c5') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5259f8bf-c5, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:17 user nova-compute[73484]: INFO os_vif [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:c1:ab,bridge_name='br-int',has_traffic_filtering=True,id=5259f8bf-c556-4ac0-9587-1633b3cf47e4,network=Network(cca9bd37-0d08-4714-a528-3c47a406ad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5259f8bf-c5')
Aug 14 13:44:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:42:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-887610754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-887610754',id=19,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi0gS+WpIKrgrS0mV0bR1l62g9OmjDCiprCWZONRUMZMQmvGO1TchMpbMfyKFCnzFTqOV6VmF0HLgUjtWXXpnGjIQdt8wNFklgDRvpfiHHZ16Ur5FAWNB3hO3OjZ335hw==',key_name='tempest-keypair-672802766',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:43:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8d4635233ed41bca48d5dc2a709b076',ramdisk_id='',reservation_id='r-3ylp5ayp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1908642749',owner_user_name='tempest-TaggedBootDevicesTest-1908642749-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:43:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729ad05102d7403e8aaa34a6c17f1a1d',uuid=8a3b8885-1940-4a92-82f4-c65c84bbf11e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45079f89-4586-4c56-824b-cf112200e102", "address": "fa:16:3e:16:d7:b1", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45079f89-45", "ovs_interfaceid": "45079f89-4586-4c56-824b-cf112200e102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converting VIF {"id": "45079f89-4586-4c56-824b-cf112200e102", "address": "fa:16:3e:16:d7:b1", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45079f89-45", "ovs_interfaceid": "45079f89-4586-4c56-824b-cf112200e102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:d7:b1,bridge_name='br-int',has_traffic_filtering=True,id=45079f89-4586-4c56-824b-cf112200e102,network=Network(cca9bd37-0d08-4714-a528-3c47a406ad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap45079f89-45') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG os_vif [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:d7:b1,bridge_name='br-int',has_traffic_filtering=True,id=45079f89-4586-4c56-824b-cf112200e102,network=Network(cca9bd37-0d08-4714-a528-3c47a406ad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap45079f89-45') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45079f89-45, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:17 user nova-compute[73484]: INFO os_vif [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:d7:b1,bridge_name='br-int',has_traffic_filtering=True,id=45079f89-4586-4c56-824b-cf112200e102,network=Network(cca9bd37-0d08-4714-a528-3c47a406ad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap45079f89-45')
Aug 14 13:44:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:42:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-887610754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-887610754',id=19,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi0gS+WpIKrgrS0mV0bR1l62g9OmjDCiprCWZONRUMZMQmvGO1TchMpbMfyKFCnzFTqOV6VmF0HLgUjtWXXpnGjIQdt8wNFklgDRvpfiHHZ16Ur5FAWNB3hO3OjZ335hw==',key_name='tempest-keypair-672802766',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:43:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8d4635233ed41bca48d5dc2a709b076',ramdisk_id='',reservation_id='r-3ylp5ayp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1908642749',owner_user_name='tempest-TaggedBootDevicesTest-1908642749-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:43:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729ad05102d7403e8aaa34a6c17f1a1d',uuid=8a3b8885-1940-4a92-82f4-c65c84bbf11e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "address": "fa:16:3e:fe:36:1f", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ddd484-97", "ovs_interfaceid": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converting VIF {"id": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "address": "fa:16:3e:fe:36:1f", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ddd484-97", "ovs_interfaceid": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:36:1f,bridge_name='br-int',has_traffic_filtering=True,id=e1ddd484-97b4-4cfe-be1e-a3be0128bfdb,network=Network(cca9bd37-0d08-4714-a528-3c47a406ad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1ddd484-97') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG os_vif [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:36:1f,bridge_name='br-int',has_traffic_filtering=True,id=e1ddd484-97b4-4cfe-be1e-a3be0128bfdb,network=Network(cca9bd37-0d08-4714-a528-3c47a406ad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1ddd484-97') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1ddd484-97, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:17 user nova-compute[73484]: INFO os_vif [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:36:1f,bridge_name='br-int',has_traffic_filtering=True,id=e1ddd484-97b4-4cfe-be1e-a3be0128bfdb,network=Network(cca9bd37-0d08-4714-a528-3c47a406ad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1ddd484-97')
Aug 14 13:44:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:42:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-887610754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-887610754',id=19,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi0gS+WpIKrgrS0mV0bR1l62g9OmjDCiprCWZONRUMZMQmvGO1TchMpbMfyKFCnzFTqOV6VmF0HLgUjtWXXpnGjIQdt8wNFklgDRvpfiHHZ16Ur5FAWNB3hO3OjZ335hw==',key_name='tempest-keypair-672802766',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:43:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8d4635233ed41bca48d5dc2a709b076',ramdisk_id='',reservation_id='r-3ylp5ayp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1908642749',owner_user_name='tempest-TaggedBootDevicesTest-1908642749-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:43:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729ad05102d7403e8aaa34a6c17f1a1d',uuid=8a3b8885-1940-4a92-82f4-c65c84bbf11e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8f67d05-60f1-4a23-afdb-f26e4d8976ed", "address": "fa:16:3e:c4:ff:42", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f67d05-60", "ovs_interfaceid": "f8f67d05-60f1-4a23-afdb-f26e4d8976ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converting VIF {"id": "f8f67d05-60f1-4a23-afdb-f26e4d8976ed", "address": "fa:16:3e:c4:ff:42", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8f67d05-60", "ovs_interfaceid": "f8f67d05-60f1-4a23-afdb-f26e4d8976ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:ff:42,bridge_name='br-int',has_traffic_filtering=True,id=f8f67d05-60f1-4a23-afdb-f26e4d8976ed,network=Network(cca9bd37-0d08-4714-a528-3c47a406ad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8f67d05-60') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG os_vif [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:ff:42,bridge_name='br-int',has_traffic_filtering=True,id=f8f67d05-60f1-4a23-afdb-f26e4d8976ed,network=Network(cca9bd37-0d08-4714-a528-3c47a406ad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8f67d05-60') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8f67d05-60, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:17 user nova-compute[73484]: INFO os_vif [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:ff:42,bridge_name='br-int',has_traffic_filtering=True,id=f8f67d05-60f1-4a23-afdb-f26e4d8976ed,network=Network(cca9bd37-0d08-4714-a528-3c47a406ad1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8f67d05-60')
Aug 14 13:44:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:42:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-887610754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-887610754',id=19,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi0gS+WpIKrgrS0mV0bR1l62g9OmjDCiprCWZONRUMZMQmvGO1TchMpbMfyKFCnzFTqOV6VmF0HLgUjtWXXpnGjIQdt8wNFklgDRvpfiHHZ16Ur5FAWNB3hO3OjZ335hw==',key_name='tempest-keypair-672802766',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:43:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8d4635233ed41bca48d5dc2a709b076',ramdisk_id='',reservation_id='r-3ylp5ayp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1908642749',owner_user_name='tempest-TaggedBootDevicesTest-1908642749-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:43:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729ad05102d7403e8aaa34a6c17f1a1d',uuid=8a3b8885-1940-4a92-82f4-c65c84bbf11e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b192f20f-10a5-4370-8e81-4a6faa679942", "address": "fa:16:3e:38:e6:44", "network": {"id": "1511c9d9-7c94-4100-811f-af762219ba90", "bridge": "br-int", "label": "tempest-device-tagging-net2-709970726", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb192f20f-10", "ovs_interfaceid": "b192f20f-10a5-4370-8e81-4a6faa679942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converting VIF {"id": "b192f20f-10a5-4370-8e81-4a6faa679942", "address": "fa:16:3e:38:e6:44", "network": {"id": "1511c9d9-7c94-4100-811f-af762219ba90", "bridge": "br-int", "label": "tempest-device-tagging-net2-709970726", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb192f20f-10", "ovs_interfaceid": "b192f20f-10a5-4370-8e81-4a6faa679942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:e6:44,bridge_name='br-int',has_traffic_filtering=True,id=b192f20f-10a5-4370-8e81-4a6faa679942,network=Network(1511c9d9-7c94-4100-811f-af762219ba90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb192f20f-10') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG os_vif [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:e6:44,bridge_name='br-int',has_traffic_filtering=True,id=b192f20f-10a5-4370-8e81-4a6faa679942,network=Network(1511c9d9-7c94-4100-811f-af762219ba90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb192f20f-10') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb192f20f-10, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:44:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:18 user nova-compute[73484]: INFO os_vif [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:e6:44,bridge_name='br-int',has_traffic_filtering=True,id=b192f20f-10a5-4370-8e81-4a6faa679942,network=Network(1511c9d9-7c94-4100-811f-af762219ba90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb192f20f-10')
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T13:42:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-887610754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-887610754',id=19,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi0gS+WpIKrgrS0mV0bR1l62g9OmjDCiprCWZONRUMZMQmvGO1TchMpbMfyKFCnzFTqOV6VmF0HLgUjtWXXpnGjIQdt8wNFklgDRvpfiHHZ16Ur5FAWNB3hO3OjZ335hw==',key_name='tempest-keypair-672802766',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:43:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8d4635233ed41bca48d5dc2a709b076',ramdisk_id='',reservation_id='r-3ylp5ayp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1908642749',owner_user_name='tempest-TaggedBootDevicesTest-1908642749-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:43:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='729ad05102d7403e8aaa34a6c17f1a1d',uuid=8a3b8885-1940-4a92-82f4-c65c84bbf11e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4", "address": "fa:16:3e:f2:f3:58", "network": {"id": "1511c9d9-7c94-4100-811f-af762219ba90", "bridge": "br-int", "label": "tempest-device-tagging-net2-709970726", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda15c9a3-5f", "ovs_interfaceid": "da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converting VIF {"id": "da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4", "address": "fa:16:3e:f2:f3:58", "network": {"id": "1511c9d9-7c94-4100-811f-af762219ba90", "bridge": "br-int", "label": "tempest-device-tagging-net2-709970726", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda15c9a3-5f", "ovs_interfaceid": "da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:f3:58,bridge_name='br-int',has_traffic_filtering=True,id=da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4,network=Network(1511c9d9-7c94-4100-811f-af762219ba90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda15c9a3-5f') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_vif [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:f3:58,bridge_name='br-int',has_traffic_filtering=True,id=da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4,network=Network(1511c9d9-7c94-4100-811f-af762219ba90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda15c9a3-5f') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda15c9a3-5f, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:18 user nova-compute[73484]: INFO os_vif [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:f3:58,bridge_name='br-int',has_traffic_filtering=True,id=da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4,network=Network(1511c9d9-7c94-4100-811f-af762219ba90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda15c9a3-5f')
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMwHfiXQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:44:18 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16cad3a-4a71-4e60-b27f-0128eb9159d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd327309-a705-4dec-95c2-51f5644de0fe]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:44:18 user nova-compute[73484]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)
Aug 14 13:44:18 user nova-compute[73484]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)
Aug 14 13:44:18 user nova-compute[73484]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 (non-flash)
Aug 14 13:44:18 user nova-compute[73484]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:44:18 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:44:18 user nova-compute[73484]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a (non-flash)
Aug 14 13:44:18 user nova-compute[73484]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)
Aug 14 13:44:18 user nova-compute[73484]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 (non-flash)
Aug 14 13:44:18 user nova-compute[73484]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:44:18 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4587df9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a'): ({'sdd'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Removing single pathed devices sdd {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5010e8f-a2a3-4c5c-aed2-168a6deafb35]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb163969-ba40-4cee-817d-0856b4473ce7]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Flushing IO for device /dev/sdd {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[445b15fc-4af2-40d2-a401-c0654c138d9b]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfd008d-87ec-482f-9d1a-edf1e732c03b]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] SCSI volumes sdd have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[faae8aad-207c-499e-acce-617e161bfe79]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a717a73-21fb-48df-bba9-2da97257ba9f]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a, portal: 172.16.0.220,3260]
Aug 14 13:44:18 user nova-compute[73484]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a, portal: 172.16.0.220,3260] successful.
Aug 14 13:44:18 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-82b536d8-8d39-4d16-a041-31c10e81b6f5 req-61a38bf7-e62b-4e82-9866-a3135b5f7184 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-plugged-5259f8bf-c556-4ac0-9587-1633b3cf47e4 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-82b536d8-8d39-4d16-a041-31c10e81b6f5 req-61a38bf7-e62b-4e82-9866-a3135b5f7184 service nova] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-82b536d8-8d39-4d16-a041-31c10e81b6f5 req-61a38bf7-e62b-4e82-9866-a3135b5f7184 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-82b536d8-8d39-4d16-a041-31c10e81b6f5 req-61a38bf7-e62b-4e82-9866-a3135b5f7184 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-82b536d8-8d39-4d16-a041-31c10e81b6f5 req-61a38bf7-e62b-4e82-9866-a3135b5f7184 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] No waiting events found dispatching network-vif-plugged-5259f8bf-c556-4ac0-9587-1633b3cf47e4 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:44:18 user nova-compute[73484]: WARNING nova.compute.manager [req-82b536d8-8d39-4d16-a041-31c10e81b6f5 req-61a38bf7-e62b-4e82-9866-a3135b5f7184 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received unexpected event network-vif-plugged-5259f8bf-c556-4ac0-9587-1633b3cf47e4 for instance with vm_state active and task_state deleting.
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-82b536d8-8d39-4d16-a041-31c10e81b6f5 req-61a38bf7-e62b-4e82-9866-a3135b5f7184 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-unplugged-e1ddd484-97b4-4cfe-be1e-a3be0128bfdb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-82b536d8-8d39-4d16-a041-31c10e81b6f5 req-61a38bf7-e62b-4e82-9866-a3135b5f7184 service nova] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-82b536d8-8d39-4d16-a041-31c10e81b6f5 req-61a38bf7-e62b-4e82-9866-a3135b5f7184 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-82b536d8-8d39-4d16-a041-31c10e81b6f5 req-61a38bf7-e62b-4e82-9866-a3135b5f7184 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-82b536d8-8d39-4d16-a041-31c10e81b6f5 req-61a38bf7-e62b-4e82-9866-a3135b5f7184 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] No waiting events found dispatching network-vif-unplugged-e1ddd484-97b4-4cfe-be1e-a3be0128bfdb {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-82b536d8-8d39-4d16-a041-31c10e81b6f5 req-61a38bf7-e62b-4e82-9866-a3135b5f7184 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-unplugged-e1ddd484-97b4-4cfe-be1e-a3be0128bfdb for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-82b536d8-8d39-4d16-a041-31c10e81b6f5 req-61a38bf7-e62b-4e82-9866-a3135b5f7184 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-plugged-e1ddd484-97b4-4cfe-be1e-a3be0128bfdb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-82b536d8-8d39-4d16-a041-31c10e81b6f5 req-61a38bf7-e62b-4e82-9866-a3135b5f7184 service nova] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-82b536d8-8d39-4d16-a041-31c10e81b6f5 req-61a38bf7-e62b-4e82-9866-a3135b5f7184 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-82b536d8-8d39-4d16-a041-31c10e81b6f5 req-61a38bf7-e62b-4e82-9866-a3135b5f7184 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-82b536d8-8d39-4d16-a041-31c10e81b6f5 req-61a38bf7-e62b-4e82-9866-a3135b5f7184 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] No waiting events found dispatching network-vif-plugged-e1ddd484-97b4-4cfe-be1e-a3be0128bfdb {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:44:18 user nova-compute[73484]: WARNING nova.compute.manager [req-82b536d8-8d39-4d16-a041-31c10e81b6f5 req-61a38bf7-e62b-4e82-9866-a3135b5f7184 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received unexpected event network-vif-plugged-e1ddd484-97b4-4cfe-be1e-a3be0128bfdb for instance with vm_state active and task_state deleting.
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-plugged-ec36c6e8-45d2-469b-b874-e9d3a10314f9 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] No waiting events found dispatching network-vif-plugged-ec36c6e8-45d2-469b-b874-e9d3a10314f9 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:44:18 user nova-compute[73484]: WARNING nova.compute.manager [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received unexpected event network-vif-plugged-ec36c6e8-45d2-469b-b874-e9d3a10314f9 for instance with vm_state active and task_state deleting.
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-unplugged-45079f89-4586-4c56-824b-cf112200e102 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] No waiting events found dispatching network-vif-unplugged-45079f89-4586-4c56-824b-cf112200e102 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-unplugged-45079f89-4586-4c56-824b-cf112200e102 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-plugged-45079f89-4586-4c56-824b-cf112200e102 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] No waiting events found dispatching network-vif-plugged-45079f89-4586-4c56-824b-cf112200e102 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:44:18 user nova-compute[73484]: WARNING nova.compute.manager [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received unexpected event network-vif-plugged-45079f89-4586-4c56-824b-cf112200e102 for instance with vm_state active and task_state deleting.
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-unplugged-f8f67d05-60f1-4a23-afdb-f26e4d8976ed {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] No waiting events found dispatching network-vif-unplugged-f8f67d05-60f1-4a23-afdb-f26e4d8976ed {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-unplugged-f8f67d05-60f1-4a23-afdb-f26e4d8976ed for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-plugged-f8f67d05-60f1-4a23-afdb-f26e4d8976ed {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] No waiting events found dispatching network-vif-plugged-f8f67d05-60f1-4a23-afdb-f26e4d8976ed {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:44:18 user nova-compute[73484]: WARNING nova.compute.manager [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received unexpected event network-vif-plugged-f8f67d05-60f1-4a23-afdb-f26e4d8976ed for instance with vm_state active and task_state deleting.
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-unplugged-da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] No waiting events found dispatching network-vif-unplugged-da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-unplugged-da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-plugged-da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] No waiting events found dispatching network-vif-plugged-da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:44:18 user nova-compute[73484]: WARNING nova.compute.manager [req-ada98b70-9ca6-4384-a7bd-70e3ecf40f62 req-1fe9ee2e-df32-436c-83d5-514b89c6a2f1 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received unexpected event network-vif-plugged-da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4 for instance with vm_state active and task_state deleting.
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044c4ce7-3e17-43b4-8d37-7d9b371bad8a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64c03d4-ee94-44d3-a51e-e73a18be7d2f]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] <== disconnect_volume: return (330ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iGnqtlAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:44:18 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad26a96-d97f-48f3-be79-02b71538f42a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3371961d-e23e-4137-8244-45c23c515551]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:44:18 user nova-compute[73484]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)
Aug 14 13:44:18 user nova-compute[73484]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 (non-flash)
Aug 14 13:44:18 user nova-compute[73484]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:44:18 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:44:18 user nova-compute[73484]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 (non-flash)
Aug 14 13:44:18 user nova-compute[73484]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 (non-flash)
Aug 14 13:44:18 user nova-compute[73484]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:44:18 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4953a9240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3'): ({'sde'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Removing single pathed devices sde {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[573e8a1c-9ff4-4d5e-801b-7a1ec5c97800]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[907ffd6f-861e-4091-84f7-7209f508f090]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Flushing IO for device /dev/sde {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[214a5d90-5672-43d1-91fa-3abb6075da27]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[304c1d34-691a-44da-91ee-54221b581d08]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] SCSI volumes sde have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[408ff4f1-de53-4b55-80ad-7e0ac2425786]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd7ff45-5871-42a6-aef5-0f412eeeb7eb]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3, portal: 172.16.0.220,3260]
Aug 14 13:44:18 user nova-compute[73484]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3, portal: 172.16.0.220,3260] successful.
Aug 14 13:44:18 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a997e7-86e6-47a2-b8f1-7f783c53f9d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ce6bf3-171d-4aba-a32e-a9d812442695]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] <== disconnect_volume: return (307ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXFLJfej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:44:18 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4ee8d3-5c08-4d0c-825e-29e48a61dd30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5ff3d6-5dfd-468c-bbeb-11c1e0a0615c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:44:18 user nova-compute[73484]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 (non-flash)
Aug 14 13:44:18 user nova-compute[73484]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:44:18 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:44:18 user nova-compute[73484]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 (non-flash)
Aug 14 13:44:18 user nova-compute[73484]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:44:18 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4953a9240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467'): ({'sdf'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Removing single pathed devices sdf {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc77c23d-7d7f-4c1b-af23-9a7b1d0a4d0e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[add39e99-1534-406a-a784-0f4628cc63be]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Flushing IO for device /dev/sdf {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0246ba68-20d0-476a-8752-33de3ae58313]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-93bc47e2-42b1-4639-9408-940f86d82632 req-9702998f-bffe-4125-bb02-5e5ee6f80d87 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-plugged-b192f20f-10a5-4370-8e81-4a6faa679942 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-93bc47e2-42b1-4639-9408-940f86d82632 req-9702998f-bffe-4125-bb02-5e5ee6f80d87 service nova] Acquiring lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-93bc47e2-42b1-4639-9408-940f86d82632 req-9702998f-bffe-4125-bb02-5e5ee6f80d87 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-93bc47e2-42b1-4639-9408-940f86d82632 req-9702998f-bffe-4125-bb02-5e5ee6f80d87 service nova] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-93bc47e2-42b1-4639-9408-940f86d82632 req-9702998f-bffe-4125-bb02-5e5ee6f80d87 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] No waiting events found dispatching network-vif-plugged-b192f20f-10a5-4370-8e81-4a6faa679942 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:44:18 user nova-compute[73484]: WARNING nova.compute.manager [req-93bc47e2-42b1-4639-9408-940f86d82632 req-9702998f-bffe-4125-bb02-5e5ee6f80d87 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received unexpected event network-vif-plugged-b192f20f-10a5-4370-8e81-4a6faa679942 for instance with vm_state active and task_state deleting.
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43ecad2-9bd4-4fb1-b25a-03dbcb665355]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] SCSI volumes sdf have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.064s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[97dfcd20-5c6d-452a-86bb-e863b01cbab2]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[672f9dec-ffc6-4144-8412-64240cf08de0]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467, portal: 172.16.0.220,3260]
Aug 14 13:44:18 user nova-compute[73484]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467, portal: 172.16.0.220,3260] successful.
Aug 14 13:44:18 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5662fa5-2d57-4576-baf1-6ebdd75d0467 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a455e80f-43c9-41ed-b622-df455be4ff98]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:44:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:44:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:44:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] <== disconnect_volume: return (326ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:44:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:44:19 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Deleting instance files /opt/stack/data/nova/instances/8a3b8885-1940-4a92-82f4-c65c84bbf11e_del
Aug 14 13:44:19 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Deletion of /opt/stack/data/nova/instances/8a3b8885-1940-4a92-82f4-c65c84bbf11e_del complete
Aug 14 13:44:19 user nova-compute[73484]: INFO nova.compute.manager [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Took 3.37 seconds to destroy the instance on the hypervisor.
Aug 14 13:44:19 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:44:19 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:44:19 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:44:20 user nova-compute[73484]: DEBUG nova.compute.manager [req-8c1b7ada-0f5a-4333-b196-6b99c7ff6fe1 req-d967a72b-acf6-4e81-aedd-a4f2586d3da2 service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Received event network-changed-0b54646a-71ed-4087-adf7-66645e7d2907 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:44:20 user nova-compute[73484]: DEBUG nova.compute.manager [req-8c1b7ada-0f5a-4333-b196-6b99c7ff6fe1 req-d967a72b-acf6-4e81-aedd-a4f2586d3da2 service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Refreshing instance network info cache due to event network-changed-0b54646a-71ed-4087-adf7-66645e7d2907. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:44:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8c1b7ada-0f5a-4333-b196-6b99c7ff6fe1 req-d967a72b-acf6-4e81-aedd-a4f2586d3da2 service nova] Acquiring lock "refresh_cache-09ba29fd-8161-485c-ba6d-71d24ab086bc" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:44:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8c1b7ada-0f5a-4333-b196-6b99c7ff6fe1 req-d967a72b-acf6-4e81-aedd-a4f2586d3da2 service nova] Acquired lock "refresh_cache-09ba29fd-8161-485c-ba6d-71d24ab086bc" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:44:20 user nova-compute[73484]: DEBUG nova.network.neutron [req-8c1b7ada-0f5a-4333-b196-6b99c7ff6fe1 req-d967a72b-acf6-4e81-aedd-a4f2586d3da2 service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Refreshing network info cache for port 0b54646a-71ed-4087-adf7-66645e7d2907 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:44:21 user nova-compute[73484]: DEBUG nova.compute.manager [req-a0e99e05-b454-4c37-8e02-46f9a643cc32 req-e63841dd-0b1e-45cd-9018-edc2ba151aaa service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-deleted-f8f67d05-60f1-4a23-afdb-f26e4d8976ed {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:44:21 user nova-compute[73484]: INFO nova.compute.manager [req-a0e99e05-b454-4c37-8e02-46f9a643cc32 req-e63841dd-0b1e-45cd-9018-edc2ba151aaa service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Neutron deleted interface f8f67d05-60f1-4a23-afdb-f26e4d8976ed; detaching it from the instance and deleting it from the info cache
Aug 14 13:44:21 user nova-compute[73484]: DEBUG nova.network.neutron [req-a0e99e05-b454-4c37-8e02-46f9a643cc32 req-e63841dd-0b1e-45cd-9018-edc2ba151aaa service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Updating instance_info_cache with network_info: [{"id": "ec36c6e8-45d2-469b-b874-e9d3a10314f9", "address": "fa:16:3e:bf:2c:42", "network": {"id": "cf1afc3e-d2cd-48ff-b311-1c7415960df4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-690860686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec36c6e8-45", "ovs_interfaceid": "ec36c6e8-45d2-469b-b874-e9d3a10314f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "address": "fa:16:3e:7c:c1:ab", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5259f8bf-c5", "ovs_interfaceid": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45079f89-4586-4c56-824b-cf112200e102", "address": "fa:16:3e:16:d7:b1", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45079f89-45", "ovs_interfaceid": "45079f89-4586-4c56-824b-cf112200e102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "address": "fa:16:3e:fe:36:1f", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ddd484-97", "ovs_interfaceid": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b192f20f-10a5-4370-8e81-4a6faa679942", "address": "fa:16:3e:38:e6:44", "network": {"id": "1511c9d9-7c94-4100-811f-af762219ba90", "bridge": "br-int", "label": "tempest-device-tagging-net2-709970726", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb192f20f-10", "ovs_interfaceid": "b192f20f-10a5-4370-8e81-4a6faa679942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4", "address": "fa:16:3e:f2:f3:58", "network": {"id": "1511c9d9-7c94-4100-811f-af762219ba90", "bridge": "br-int", "label": "tempest-device-tagging-net2-709970726", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda15c9a3-5f", "ovs_interfaceid": "da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:44:21 user nova-compute[73484]: DEBUG nova.compute.manager [req-a0e99e05-b454-4c37-8e02-46f9a643cc32 req-e63841dd-0b1e-45cd-9018-edc2ba151aaa service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Detach interface failed, port_id=f8f67d05-60f1-4a23-afdb-f26e4d8976ed, reason: Instance 8a3b8885-1940-4a92-82f4-c65c84bbf11e could not be found. {{(pid=73484) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 13:44:21 user nova-compute[73484]: DEBUG nova.network.neutron [req-8c1b7ada-0f5a-4333-b196-6b99c7ff6fe1 req-d967a72b-acf6-4e81-aedd-a4f2586d3da2 service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Updated VIF entry in instance network info cache for port 0b54646a-71ed-4087-adf7-66645e7d2907. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:44:21 user nova-compute[73484]: DEBUG nova.network.neutron [req-8c1b7ada-0f5a-4333-b196-6b99c7ff6fe1 req-d967a72b-acf6-4e81-aedd-a4f2586d3da2 service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Updating instance_info_cache with network_info: [{"id": "0b54646a-71ed-4087-adf7-66645e7d2907", "address": "fa:16:3e:30:6a:b2", "network": {"id": "a417bb93-b1ed-47a4-be83-6679c2ea34b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872770450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07a8a61d3f14061b44b8f37968c54e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b54646a-71", "ovs_interfaceid": "0b54646a-71ed-4087-adf7-66645e7d2907", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:44:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8c1b7ada-0f5a-4333-b196-6b99c7ff6fe1 req-d967a72b-acf6-4e81-aedd-a4f2586d3da2 service nova] Releasing lock "refresh_cache-09ba29fd-8161-485c-ba6d-71d24ab086bc" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:44:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:23 user nova-compute[73484]: DEBUG nova.compute.manager [req-a250aa4b-cb94-4ed0-aef4-32ece2632fb1 req-3e999585-de2a-4141-af96-ca694ab8e931 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-deleted-da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:44:23 user nova-compute[73484]: INFO nova.compute.manager [req-a250aa4b-cb94-4ed0-aef4-32ece2632fb1 req-3e999585-de2a-4141-af96-ca694ab8e931 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Neutron deleted interface da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4; detaching it from the instance and deleting it from the info cache
Aug 14 13:44:23 user nova-compute[73484]: DEBUG nova.network.neutron [req-a250aa4b-cb94-4ed0-aef4-32ece2632fb1 req-3e999585-de2a-4141-af96-ca694ab8e931 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Updating instance_info_cache with network_info: [{"id": "ec36c6e8-45d2-469b-b874-e9d3a10314f9", "address": "fa:16:3e:bf:2c:42", "network": {"id": "cf1afc3e-d2cd-48ff-b311-1c7415960df4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-690860686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec36c6e8-45", "ovs_interfaceid": "ec36c6e8-45d2-469b-b874-e9d3a10314f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "address": "fa:16:3e:7c:c1:ab", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5259f8bf-c5", "ovs_interfaceid": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45079f89-4586-4c56-824b-cf112200e102", "address": "fa:16:3e:16:d7:b1", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45079f89-45", "ovs_interfaceid": "45079f89-4586-4c56-824b-cf112200e102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "address": "fa:16:3e:fe:36:1f", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ddd484-97", "ovs_interfaceid": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b192f20f-10a5-4370-8e81-4a6faa679942", "address": "fa:16:3e:38:e6:44", "network": {"id": "1511c9d9-7c94-4100-811f-af762219ba90", "bridge": "br-int", "label": "tempest-device-tagging-net2-709970726", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb192f20f-10", "ovs_interfaceid": "b192f20f-10a5-4370-8e81-4a6faa679942", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:44:23 user nova-compute[73484]: DEBUG nova.compute.manager [req-a250aa4b-cb94-4ed0-aef4-32ece2632fb1 req-3e999585-de2a-4141-af96-ca694ab8e931 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Detach interface failed, port_id=da15c9a3-5f3c-4e8b-8653-2e0b00ae76d4, reason: Instance 8a3b8885-1940-4a92-82f4-c65c84bbf11e could not be found. {{(pid=73484) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 13:44:23 user nova-compute[73484]: DEBUG nova.compute.manager [req-a250aa4b-cb94-4ed0-aef4-32ece2632fb1 req-3e999585-de2a-4141-af96-ca694ab8e931 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-deleted-b192f20f-10a5-4370-8e81-4a6faa679942 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:44:23 user nova-compute[73484]: INFO nova.compute.manager [req-a250aa4b-cb94-4ed0-aef4-32ece2632fb1 req-3e999585-de2a-4141-af96-ca694ab8e931 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Neutron deleted interface b192f20f-10a5-4370-8e81-4a6faa679942; detaching it from the instance and deleting it from the info cache
Aug 14 13:44:23 user nova-compute[73484]: DEBUG nova.network.neutron [req-a250aa4b-cb94-4ed0-aef4-32ece2632fb1 req-3e999585-de2a-4141-af96-ca694ab8e931 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Updating instance_info_cache with network_info: [{"id": "ec36c6e8-45d2-469b-b874-e9d3a10314f9", "address": "fa:16:3e:bf:2c:42", "network": {"id": "cf1afc3e-d2cd-48ff-b311-1c7415960df4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-690860686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec36c6e8-45", "ovs_interfaceid": "ec36c6e8-45d2-469b-b874-e9d3a10314f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "address": "fa:16:3e:7c:c1:ab", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5259f8bf-c5", "ovs_interfaceid": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45079f89-4586-4c56-824b-cf112200e102", "address": "fa:16:3e:16:d7:b1", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45079f89-45", "ovs_interfaceid": "45079f89-4586-4c56-824b-cf112200e102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "address": "fa:16:3e:fe:36:1f", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ddd484-97", "ovs_interfaceid": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:44:23 user nova-compute[73484]: DEBUG nova.compute.manager [req-a250aa4b-cb94-4ed0-aef4-32ece2632fb1 req-3e999585-de2a-4141-af96-ca694ab8e931 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Detach interface failed, port_id=b192f20f-10a5-4370-8e81-4a6faa679942, reason: Instance 8a3b8885-1940-4a92-82f4-c65c84bbf11e could not be found. {{(pid=73484) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 13:44:23 user nova-compute[73484]: DEBUG nova.compute.manager [req-a250aa4b-cb94-4ed0-aef4-32ece2632fb1 req-3e999585-de2a-4141-af96-ca694ab8e931 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-deleted-ec36c6e8-45d2-469b-b874-e9d3a10314f9 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:44:23 user nova-compute[73484]: INFO nova.compute.manager [req-a250aa4b-cb94-4ed0-aef4-32ece2632fb1 req-3e999585-de2a-4141-af96-ca694ab8e931 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Neutron deleted interface ec36c6e8-45d2-469b-b874-e9d3a10314f9; detaching it from the instance and deleting it from the info cache
Aug 14 13:44:23 user nova-compute[73484]: DEBUG nova.network.neutron [req-a250aa4b-cb94-4ed0-aef4-32ece2632fb1 req-3e999585-de2a-4141-af96-ca694ab8e931 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Updating instance_info_cache with network_info: [{"id": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "address": "fa:16:3e:7c:c1:ab", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5259f8bf-c5", "ovs_interfaceid": "5259f8bf-c556-4ac0-9587-1633b3cf47e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "45079f89-4586-4c56-824b-cf112200e102", "address": "fa:16:3e:16:d7:b1", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45079f89-45", "ovs_interfaceid": "45079f89-4586-4c56-824b-cf112200e102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "address": "fa:16:3e:fe:36:1f", "network": {"id": "cca9bd37-0d08-4714-a528-3c47a406ad1d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1880556329", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d8d4635233ed41bca48d5dc2a709b076", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1ddd484-97", "ovs_interfaceid": "e1ddd484-97b4-4cfe-be1e-a3be0128bfdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:44:23 user nova-compute[73484]: DEBUG nova.compute.manager [req-a250aa4b-cb94-4ed0-aef4-32ece2632fb1 req-3e999585-de2a-4141-af96-ca694ab8e931 service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Detach interface failed, port_id=ec36c6e8-45d2-469b-b874-e9d3a10314f9, reason: Instance 8a3b8885-1940-4a92-82f4-c65c84bbf11e could not be found. {{(pid=73484) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 13:44:23 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:44:23 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Took 4.55 seconds to deallocate network for instance.
Aug 14 13:44:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:24 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692020649.5641165, 66e161f1-2f3b-4777-9a0d-5f4d62e850d5 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:44:24 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] VM Stopped (Lifecycle Event)
Aug 14 13:44:24 user nova-compute[73484]: DEBUG nova.compute.manager [None req-3f565125-5ae5-4a58-9c32-30e64bd16162 None None] [instance: 66e161f1-2f3b-4777-9a0d-5f4d62e850d5] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:44:25 user nova-compute[73484]: DEBUG nova.compute.manager [req-058104d8-2fca-426e-9061-7f114c43829e req-37ec949b-cdd9-4d97-9df2-091d7bf26d9e service nova] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Received event network-vif-deleted-e1ddd484-97b4-4cfe-be1e-a3be0128bfdb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:44:25 user nova-compute[73484]: INFO nova.compute.manager [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Took 2.12 seconds to detach 3 volumes for instance.
Aug 14 13:44:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:44:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:44:26 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:44:26 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:44:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:44:26 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Deleted allocations for instance 8a3b8885-1940-4a92-82f4-c65c84bbf11e
Aug 14 13:44:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e3fb2b5f-7949-415a-b9a0-7aaed48a1e84 tempest-TaggedBootDevicesTest-1908642749 tempest-TaggedBootDevicesTest-1908642749-project-member] Lock "8a3b8885-1940-4a92-82f4-c65c84bbf11e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.562s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:44:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:32 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692020657.4810076, 8a3b8885-1940-4a92-82f4-c65c84bbf11e => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:44:32 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] VM Stopped (Lifecycle Event)
Aug 14 13:44:32 user nova-compute[73484]: DEBUG nova.compute.manager [None req-fb6fe6c6-b72a-4d1a-bd96-5f3c7a4ebbb2 None None] [instance: 8a3b8885-1940-4a92-82f4-c65c84bbf11e] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:44:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:36 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:44:36 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:44:36 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 13:44:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-07bac569-8b2c-4555-b4d5-a74f7384630b" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:44:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-07bac569-8b2c-4555-b4d5-a74f7384630b" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:44:36 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 13:44:37 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Updating instance_info_cache with network_info: [{"id": "cb7f3901-875e-489a-87f8-5642b9fded9c", "address": "fa:16:3e:6c:13:9e", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7f3901-87", "ovs_interfaceid": "cb7f3901-875e-489a-87f8-5642b9fded9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:44:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-07bac569-8b2c-4555-b4d5-a74f7384630b" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:44:37 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 13:44:37 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:44:37 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:44:37 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 13:44:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-bcefb353-a57a-4814-85f9-86b128024140 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Acquiring lock "29855792-6422-4626-ae64-923c346b1eb9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:44:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-bcefb353-a57a-4814-85f9-86b128024140 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "29855792-6422-4626-ae64-923c346b1eb9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:44:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-bcefb353-a57a-4814-85f9-86b128024140 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Acquiring lock "29855792-6422-4626-ae64-923c346b1eb9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:44:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-bcefb353-a57a-4814-85f9-86b128024140 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "29855792-6422-4626-ae64-923c346b1eb9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:44:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-bcefb353-a57a-4814-85f9-86b128024140 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "29855792-6422-4626-ae64-923c346b1eb9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:44:37 user nova-compute[73484]: INFO nova.compute.manager [None req-bcefb353-a57a-4814-85f9-86b128024140 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Terminating instance
Aug 14 13:44:37 user nova-compute[73484]: DEBUG nova.compute.manager [None req-bcefb353-a57a-4814-85f9-86b128024140 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:44:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:37 user nova-compute[73484]: DEBUG nova.compute.manager [req-d4703279-20a7-4646-b4b7-a03d31dd2351 req-25e64e09-6bbd-4d72-8f0e-dfbe79980751 service nova] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Received event network-vif-unplugged-2c48d537-2b53-4807-a789-e7444e76ca45 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:44:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d4703279-20a7-4646-b4b7-a03d31dd2351 req-25e64e09-6bbd-4d72-8f0e-dfbe79980751 service nova] Acquiring lock "29855792-6422-4626-ae64-923c346b1eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:44:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d4703279-20a7-4646-b4b7-a03d31dd2351 req-25e64e09-6bbd-4d72-8f0e-dfbe79980751 service nova] Lock "29855792-6422-4626-ae64-923c346b1eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:44:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d4703279-20a7-4646-b4b7-a03d31dd2351 req-25e64e09-6bbd-4d72-8f0e-dfbe79980751 service nova] Lock "29855792-6422-4626-ae64-923c346b1eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:44:37 user nova-compute[73484]: DEBUG nova.compute.manager [req-d4703279-20a7-4646-b4b7-a03d31dd2351 req-25e64e09-6bbd-4d72-8f0e-dfbe79980751 service nova] [instance: 29855792-6422-4626-ae64-923c346b1eb9] No waiting events found dispatching network-vif-unplugged-2c48d537-2b53-4807-a789-e7444e76ca45 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:44:37 user nova-compute[73484]: DEBUG nova.compute.manager [req-d4703279-20a7-4646-b4b7-a03d31dd2351 req-25e64e09-6bbd-4d72-8f0e-dfbe79980751 service nova] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Received event network-vif-unplugged-2c48d537-2b53-4807-a789-e7444e76ca45 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:44:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:37 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Instance destroyed successfully.
Aug 14 13:44:37 user nova-compute[73484]: DEBUG nova.objects.instance [None req-bcefb353-a57a-4814-85f9-86b128024140 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lazy-loading 'resources' on Instance uuid 29855792-6422-4626-ae64-923c346b1eb9 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:44:38 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-bcefb353-a57a-4814-85f9-86b128024140 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:42:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1103453138',display_name='tempest-ServersNegativeTestJSON-server-1103453138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1103453138',id=21,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:42:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76ff7afafc2d4b1fa74902cdf0ce08d6',ramdisk_id='',reservation_id='r-clk068qh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-287955364',owner_user_name='tempest-ServersNegativeTestJSON-287955364-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:42:56Z,user_data=None,user_id='33fea6b1b7dd4b2297bac12011f57a17',uuid=29855792-6422-4626-ae64-923c346b1eb9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c48d537-2b53-4807-a789-e7444e76ca45", "address": "fa:16:3e:80:b2:13", "network": {"id": "893008ed-2c71-42ba-bf31-28baba1b8c2c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1936284602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ff7afafc2d4b1fa74902cdf0ce08d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c48d537-2b", "ovs_interfaceid": "2c48d537-2b53-4807-a789-e7444e76ca45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:44:38 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-bcefb353-a57a-4814-85f9-86b128024140 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Converting VIF {"id": "2c48d537-2b53-4807-a789-e7444e76ca45", "address": "fa:16:3e:80:b2:13", "network": {"id": "893008ed-2c71-42ba-bf31-28baba1b8c2c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1936284602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ff7afafc2d4b1fa74902cdf0ce08d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c48d537-2b", "ovs_interfaceid": "2c48d537-2b53-4807-a789-e7444e76ca45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:44:38 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-bcefb353-a57a-4814-85f9-86b128024140 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:b2:13,bridge_name='br-int',has_traffic_filtering=True,id=2c48d537-2b53-4807-a789-e7444e76ca45,network=Network(893008ed-2c71-42ba-bf31-28baba1b8c2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c48d537-2b') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:44:38 user nova-compute[73484]: DEBUG os_vif [None req-bcefb353-a57a-4814-85f9-86b128024140 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:b2:13,bridge_name='br-int',has_traffic_filtering=True,id=2c48d537-2b53-4807-a789-e7444e76ca45,network=Network(893008ed-2c71-42ba-bf31-28baba1b8c2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c48d537-2b') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:44:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c48d537-2b, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:44:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:44:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:38 user nova-compute[73484]: INFO os_vif [None req-bcefb353-a57a-4814-85f9-86b128024140 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:b2:13,bridge_name='br-int',has_traffic_filtering=True,id=2c48d537-2b53-4807-a789-e7444e76ca45,network=Network(893008ed-2c71-42ba-bf31-28baba1b8c2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c48d537-2b')
Aug 14 13:44:38 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-bcefb353-a57a-4814-85f9-86b128024140 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Deleting instance files /opt/stack/data/nova/instances/29855792-6422-4626-ae64-923c346b1eb9_del
Aug 14 13:44:38 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-bcefb353-a57a-4814-85f9-86b128024140 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Deletion of /opt/stack/data/nova/instances/29855792-6422-4626-ae64-923c346b1eb9_del complete
Aug 14 13:44:38 user nova-compute[73484]: INFO nova.compute.manager [None req-bcefb353-a57a-4814-85f9-86b128024140 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Took 0.66 seconds to destroy the instance on the hypervisor.
Aug 14 13:44:38 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-bcefb353-a57a-4814-85f9-86b128024140 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:44:38 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:44:38 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 29855792-6422-4626-ae64-923c346b1eb9] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:44:38 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:44:38 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:44:38 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Took 0.53 seconds to deallocate network for instance.
Aug 14 13:44:38 user nova-compute[73484]: DEBUG nova.compute.manager [req-3040b79e-e425-4c1a-90c8-b9664e050873 req-2f99a956-be5c-423c-a7b8-7e4d1e1cf036 service nova] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Received event network-vif-deleted-2c48d537-2b53-4807-a789-e7444e76ca45 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:44:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-bcefb353-a57a-4814-85f9-86b128024140 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:44:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-bcefb353-a57a-4814-85f9-86b128024140 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:44:38 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:44:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:44:38 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-bcefb353-a57a-4814-85f9-86b128024140 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:44:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:39 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-bcefb353-a57a-4814-85f9-86b128024140 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:44:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-bcefb353-a57a-4814-85f9-86b128024140 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:44:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.208s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:44:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:44:39 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 13:44:39 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-bcefb353-a57a-4814-85f9-86b128024140 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Deleted allocations for instance 29855792-6422-4626-ae64-923c346b1eb9
Aug 14 13:44:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-bcefb353-a57a-4814-85f9-86b128024140 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "29855792-6422-4626-ae64-923c346b1eb9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.758s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:44:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:39 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:44:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-97c47177-7bd2-42e3-bec2-8f62a5aacc94 req-b2e51469-c667-4603-a5f0-56209a9346f9 service nova] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Received event network-vif-plugged-2c48d537-2b53-4807-a789-e7444e76ca45 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:44:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-97c47177-7bd2-42e3-bec2-8f62a5aacc94 req-b2e51469-c667-4603-a5f0-56209a9346f9 service nova] Acquiring lock "29855792-6422-4626-ae64-923c346b1eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:44:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-97c47177-7bd2-42e3-bec2-8f62a5aacc94 req-b2e51469-c667-4603-a5f0-56209a9346f9 service nova] Lock "29855792-6422-4626-ae64-923c346b1eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:44:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-97c47177-7bd2-42e3-bec2-8f62a5aacc94 req-b2e51469-c667-4603-a5f0-56209a9346f9 service nova] Lock "29855792-6422-4626-ae64-923c346b1eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:44:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-97c47177-7bd2-42e3-bec2-8f62a5aacc94 req-b2e51469-c667-4603-a5f0-56209a9346f9 service nova] [instance: 29855792-6422-4626-ae64-923c346b1eb9] No waiting events found dispatching network-vif-plugged-2c48d537-2b53-4807-a789-e7444e76ca45 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:44:39 user nova-compute[73484]: WARNING nova.compute.manager [req-97c47177-7bd2-42e3-bec2-8f62a5aacc94 req-b2e51469-c667-4603-a5f0-56209a9346f9 service nova] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Received unexpected event network-vif-plugged-2c48d537-2b53-4807-a789-e7444e76ca45 for instance with vm_state deleted and task_state None.
Aug 14 13:44:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:41 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:44:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eed5f58-f09b-419a-ba10-7b1dd6f27f7f/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eed5f58-f09b-419a-ba10-7b1dd6f27f7f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eed5f58-f09b-419a-ba10-7b1dd6f27f7f/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eed5f58-f09b-419a-ba10-7b1dd6f27f7f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:42 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:44:42 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:44:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=7691MB free_disk=25.468429565429688GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 13:44:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:44:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:44:42 user nova-compute[73484]: DEBUG nova.objects.instance [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'flavor' on Instance uuid 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:44:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "refresh_cache-0a3a174b-d870-4164-891e-a2fa8cc8c8b8" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:44:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquired lock "refresh_cache-0a3a174b-d870-4164-891e-a2fa8cc8c8b8" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:44:42 user nova-compute[73484]: DEBUG nova.network.neutron [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:44:42 user nova-compute[73484]: DEBUG nova.objects.instance [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'info_cache' on Instance uuid 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:44:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance f4f7788c-fcca-47c1-b5b8-72892253982d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:44:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:44:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 07bac569-8b2c-4555-b4d5-a74f7384630b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:44:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance eaaccbea-d453-4943-9663-949c66029d87 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:44:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance a9d4ec42-3db9-439b-87a7-02bcaab514a4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:44:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance ed239af5-980e-42d3-8ebd-ca100ccb2708 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:44:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance bd43e3a9-0413-4e55-b6a1-7f3f792ba872 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:44:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 09ba29fd-8161-485c-ba6d-71d24ab086bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:44:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:44:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 13:44:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 13:44:42 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:44:42 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:44:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 13:44:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.434s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG nova.network.neutron [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Updating instance_info_cache with network_info: [{"id": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "address": "fa:16:3e:b8:35:a4", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511cc5ad-6f", "ovs_interfaceid": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Releasing lock "refresh_cache-0a3a174b-d870-4164-891e-a2fa8cc8c8b8" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:44:43 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Instance destroyed successfully.
Aug 14 13:44:43 user nova-compute[73484]: DEBUG nova.objects.instance [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'resources' on Instance uuid 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:36:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1545874430',display_name='tempest-AttachVolumeTestJSON-server-1545874430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1545874430',id=2,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALz2dA1fCV3zsqvRCM3si65BX/s2RWbHAvxkMavxCm+Cz33FBQTUMagzswhJU7/mAqiPPhCjI04IhkLCYoINFrAPHP37QxwSFtMKgaz77wIK1BXGoScfZ85G5EKo7vD3A==',key_name='tempest-keypair-1440897791',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:37:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3d2114819cda450ca1827ddd5557da23',ramdisk_id='',reservation_id='r-ifpiz561',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-852428779',owner_user_name='tempest-AttachVolumeTestJSON-852428779-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:42:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fac94bacad00447d9743d8a44118ea47',uuid=0a3a174b-d870-4164-891e-a2fa8cc8c8b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "address": "fa:16:3e:b8:35:a4", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511cc5ad-6f", "ovs_interfaceid": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Converting VIF {"id": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "address": "fa:16:3e:b8:35:a4", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511cc5ad-6f", "ovs_interfaceid": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:35:a4,bridge_name='br-int',has_traffic_filtering=True,id=511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a,network=Network(cddd6eb8-767a-42c5-8cca-a1fe1d2eb604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511cc5ad-6f') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG os_vif [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:35:a4,bridge_name='br-int',has_traffic_filtering=True,id=511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a,network=Network(cddd6eb8-767a-42c5-8cca-a1fe1d2eb604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511cc5ad-6f') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap511cc5ad-6f, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:44:43 user nova-compute[73484]: INFO os_vif [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:35:a4,bridge_name='br-int',has_traffic_filtering=True,id=511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a,network=Network(cddd6eb8-767a-42c5-8cca-a1fe1d2eb604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511cc5ad-6f')
Aug 14 13:44:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Start _get_guest_xml network_info=[{"id": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "address": "fa:16:3e:b8:35:a4", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511cc5ad-6f", "ovs_interfaceid": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG nova.objects.instance [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'numa_topology' on Instance uuid 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:44:43 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:44:43 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:44:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG nova.objects.instance [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:36:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1545874430',display_name='tempest-AttachVolumeTestJSON-server-1545874430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1545874430',id=2,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALz2dA1fCV3zsqvRCM3si65BX/s2RWbHAvxkMavxCm+Cz33FBQTUMagzswhJU7/mAqiPPhCjI04IhkLCYoINFrAPHP37QxwSFtMKgaz77wIK1BXGoScfZ85G5EKo7vD3A==',key_name='tempest-keypair-1440897791',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:37:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3d2114819cda450ca1827ddd5557da23',ramdisk_id='',reservation_id='r-ifpiz561',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-852428779',owner_user_name='tempest-AttachVolumeTestJSON-852428779-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:42:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fac94bacad00447d9743d8a44118ea47',uuid=0a3a174b-d870-4164-891e-a2fa8cc8c8b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "address": "fa:16:3e:b8:35:a4", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511cc5ad-6f", "ovs_interfaceid": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Converting VIF {"id": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "address": "fa:16:3e:b8:35:a4", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511cc5ad-6f", "ovs_interfaceid": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:35:a4,bridge_name='br-int',has_traffic_filtering=True,id=511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a,network=Network(cddd6eb8-767a-42c5-8cca-a1fe1d2eb604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511cc5ad-6f') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG nova.objects.instance [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:44:43 user nova-compute[73484]:   <uuid>0a3a174b-d870-4164-891e-a2fa8cc8c8b8</uuid>
Aug 14 13:44:43 user nova-compute[73484]:   <name>instance-00000002</name>
Aug 14 13:44:43 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:44:43 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:44:43 user nova-compute[73484]:   <metadata>
Aug 14 13:44:43 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:44:43 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:44:43 user nova-compute[73484]:       <nova:name>tempest-AttachVolumeTestJSON-server-1545874430</nova:name>
Aug 14 13:44:43 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:44:43</nova:creationTime>
Aug 14 13:44:43 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:44:43 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:44:43 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:44:43 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:44:43 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:44:43 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:44:43 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:44:43 user nova-compute[73484]:       <nova:owner>
Aug 14 13:44:43 user nova-compute[73484]:         <nova:user uuid="fac94bacad00447d9743d8a44118ea47">tempest-AttachVolumeTestJSON-852428779-project-member</nova:user>
Aug 14 13:44:43 user nova-compute[73484]:         <nova:project uuid="3d2114819cda450ca1827ddd5557da23">tempest-AttachVolumeTestJSON-852428779</nova:project>
Aug 14 13:44:43 user nova-compute[73484]:       </nova:owner>
Aug 14 13:44:43 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:44:43 user nova-compute[73484]:       <nova:ports>
Aug 14 13:44:43 user nova-compute[73484]:         <nova:port uuid="511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a">
Aug 14 13:44:43 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 13:44:43 user nova-compute[73484]:         </nova:port>
Aug 14 13:44:43 user nova-compute[73484]:       </nova:ports>
Aug 14 13:44:43 user nova-compute[73484]:     </nova:instance>
Aug 14 13:44:43 user nova-compute[73484]:   </metadata>
Aug 14 13:44:43 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:44:43 user nova-compute[73484]:     <system>
Aug 14 13:44:43 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:44:43 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:44:43 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:44:43 user nova-compute[73484]:       <entry name="serial">0a3a174b-d870-4164-891e-a2fa8cc8c8b8</entry>
Aug 14 13:44:43 user nova-compute[73484]:       <entry name="uuid">0a3a174b-d870-4164-891e-a2fa8cc8c8b8</entry>
Aug 14 13:44:43 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:44:43 user nova-compute[73484]:     </system>
Aug 14 13:44:43 user nova-compute[73484]:   </sysinfo>
Aug 14 13:44:43 user nova-compute[73484]:   <os>
Aug 14 13:44:43 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:44:43 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:44:43 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:44:43 user nova-compute[73484]:   </os>
Aug 14 13:44:43 user nova-compute[73484]:   <features>
Aug 14 13:44:43 user nova-compute[73484]:     <acpi/>
Aug 14 13:44:43 user nova-compute[73484]:     <apic/>
Aug 14 13:44:43 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:44:43 user nova-compute[73484]:   </features>
Aug 14 13:44:43 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:44:43 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:44:43 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:44:43 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:44:43 user nova-compute[73484]:   </clock>
Aug 14 13:44:43 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:44:43 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:44:43 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:44:43 user nova-compute[73484]:   </cpu>
Aug 14 13:44:43 user nova-compute[73484]:   <devices>
Aug 14 13:44:43 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:44:43 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:44:43 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk"/>
Aug 14 13:44:43 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:44:43 user nova-compute[73484]:     </disk>
Aug 14 13:44:43 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:44:43 user nova-compute[73484]:       <mac address="fa:16:3e:b8:35:a4"/>
Aug 14 13:44:43 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:44:43 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:44:43 user nova-compute[73484]:       <target dev="tap511cc5ad-6f"/>
Aug 14 13:44:43 user nova-compute[73484]:     </interface>
Aug 14 13:44:43 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:44:43 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/console.log" append="off"/>
Aug 14 13:44:43 user nova-compute[73484]:     </serial>
Aug 14 13:44:43 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:44:43 user nova-compute[73484]:     <video>
Aug 14 13:44:43 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:44:43 user nova-compute[73484]:     </video>
Aug 14 13:44:43 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:44:43 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:44:43 user nova-compute[73484]:     </rng>
Aug 14 13:44:43 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:44:43 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:44:43 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:44:43 user nova-compute[73484]:     </memballoon>
Aug 14 13:44:43 user nova-compute[73484]:   </devices>
Aug 14 13:44:43 user nova-compute[73484]: </domain>
Aug 14 13:44:43 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:44:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:44 user nova-compute[73484]: DEBUG nova.objects.instance [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:44:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.182s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:44 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:44:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:44:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:44:44 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Cannot resize image /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:44:44 user nova-compute[73484]: DEBUG nova.objects.instance [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'migration_context' on Instance uuid 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:44:44 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:36:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1545874430',display_name='tempest-AttachVolumeTestJSON-server-1545874430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1545874430',id=2,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALz2dA1fCV3zsqvRCM3si65BX/s2RWbHAvxkMavxCm+Cz33FBQTUMagzswhJU7/mAqiPPhCjI04IhkLCYoINFrAPHP37QxwSFtMKgaz77wIK1BXGoScfZ85G5EKo7vD3A==',key_name='tempest-keypair-1440897791',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:37:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='3d2114819cda450ca1827ddd5557da23',ramdisk_id='',reservation_id='r-ifpiz561',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-852428779',owner_user_name='tempest-AttachVolumeTestJSON-852428779-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:42:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fac94bacad00447d9743d8a44118ea47',uuid=0a3a174b-d870-4164-891e-a2fa8cc8c8b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "address": "fa:16:3e:b8:35:a4", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511cc5ad-6f", "ovs_interfaceid": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:44:44 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Converting VIF {"id": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "address": "fa:16:3e:b8:35:a4", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511cc5ad-6f", "ovs_interfaceid": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:44:44 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:35:a4,bridge_name='br-int',has_traffic_filtering=True,id=511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a,network=Network(cddd6eb8-767a-42c5-8cca-a1fe1d2eb604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511cc5ad-6f') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:44:44 user nova-compute[73484]: DEBUG os_vif [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:35:a4,bridge_name='br-int',has_traffic_filtering=True,id=511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a,network=Network(cddd6eb8-767a-42c5-8cca-a1fe1d2eb604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511cc5ad-6f') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:44:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:44:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:44:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap511cc5ad-6f, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:44:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap511cc5ad-6f, col_values=(('external_ids', {'iface-id': '511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:35:a4', 'vm-uuid': '0a3a174b-d870-4164-891e-a2fa8cc8c8b8'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:44:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:44:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:44 user nova-compute[73484]: INFO os_vif [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:35:a4,bridge_name='br-int',has_traffic_filtering=True,id=511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a,network=Network(cddd6eb8-767a-42c5-8cca-a1fe1d2eb604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511cc5ad-6f')
Aug 14 13:44:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:46 user nova-compute[73484]: DEBUG nova.compute.manager [req-81c5bfd3-f970-4a12-a447-07baa3d522d2 req-6a68613f-aebf-4e03-a74d-f4dbd0894812 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received event network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:44:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-81c5bfd3-f970-4a12-a447-07baa3d522d2 req-6a68613f-aebf-4e03-a74d-f4dbd0894812 service nova] Acquiring lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:44:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-81c5bfd3-f970-4a12-a447-07baa3d522d2 req-6a68613f-aebf-4e03-a74d-f4dbd0894812 service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:44:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-81c5bfd3-f970-4a12-a447-07baa3d522d2 req-6a68613f-aebf-4e03-a74d-f4dbd0894812 service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:44:46 user nova-compute[73484]: DEBUG nova.compute.manager [req-81c5bfd3-f970-4a12-a447-07baa3d522d2 req-6a68613f-aebf-4e03-a74d-f4dbd0894812 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] No waiting events found dispatching network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:44:46 user nova-compute[73484]: WARNING nova.compute.manager [req-81c5bfd3-f970-4a12-a447-07baa3d522d2 req-6a68613f-aebf-4e03-a74d-f4dbd0894812 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received unexpected event network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a for instance with vm_state stopped and task_state powering-on.
Aug 14 13:44:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:48 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020688.2419786, 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:44:48 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] VM Resumed (Lifecycle Event)
Aug 14 13:44:48 user nova-compute[73484]: DEBUG nova.compute.manager [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:44:48 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Instance rebooted successfully.
Aug 14 13:44:48 user nova-compute[73484]: DEBUG nova.compute.manager [None req-84d71929-6e61-4d30-beae-35839fd52332 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:44:48 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:44:48 user nova-compute[73484]: DEBUG nova.compute.manager [req-98fc7692-25dc-477c-846b-43770a0136d0 req-31ef05e6-ded3-4d46-94f1-699178979515 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received event network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:44:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-98fc7692-25dc-477c-846b-43770a0136d0 req-31ef05e6-ded3-4d46-94f1-699178979515 service nova] Acquiring lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:44:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-98fc7692-25dc-477c-846b-43770a0136d0 req-31ef05e6-ded3-4d46-94f1-699178979515 service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:44:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-98fc7692-25dc-477c-846b-43770a0136d0 req-31ef05e6-ded3-4d46-94f1-699178979515 service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:44:48 user nova-compute[73484]: DEBUG nova.compute.manager [req-98fc7692-25dc-477c-846b-43770a0136d0 req-31ef05e6-ded3-4d46-94f1-699178979515 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] No waiting events found dispatching network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:44:48 user nova-compute[73484]: WARNING nova.compute.manager [req-98fc7692-25dc-477c-846b-43770a0136d0 req-31ef05e6-ded3-4d46-94f1-699178979515 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received unexpected event network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a for instance with vm_state stopped and task_state powering-on.
Aug 14 13:44:48 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:44:48 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 14 13:44:48 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020688.2476747, 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:44:48 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] VM Started (Lifecycle Event)
Aug 14 13:44:48 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:44:48 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:44:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:52 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692020677.9888208, 29855792-6422-4626-ae64-923c346b1eb9 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:44:52 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 29855792-6422-4626-ae64-923c346b1eb9] VM Stopped (Lifecycle Event)
Aug 14 13:44:53 user nova-compute[73484]: DEBUG nova.compute.manager [None req-2b4c7a96-8f50-4e7f-87cd-dc491bd129d0 None None] [instance: 29855792-6422-4626-ae64-923c346b1eb9] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:44:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:44:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:02 user nova-compute[73484]: DEBUG nova.compute.manager [req-875a72bd-9a7d-4f7c-8bf8-fadcfd4df87a req-3906be8d-ea03-4a4f-a0ef-499333cd8a85 service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Received event network-changed-64496447-3d0b-4259-9c93-8ec02b4546fc {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:45:02 user nova-compute[73484]: DEBUG nova.compute.manager [req-875a72bd-9a7d-4f7c-8bf8-fadcfd4df87a req-3906be8d-ea03-4a4f-a0ef-499333cd8a85 service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Refreshing instance network info cache due to event network-changed-64496447-3d0b-4259-9c93-8ec02b4546fc. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:45:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-875a72bd-9a7d-4f7c-8bf8-fadcfd4df87a req-3906be8d-ea03-4a4f-a0ef-499333cd8a85 service nova] Acquiring lock "refresh_cache-9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:45:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-875a72bd-9a7d-4f7c-8bf8-fadcfd4df87a req-3906be8d-ea03-4a4f-a0ef-499333cd8a85 service nova] Acquired lock "refresh_cache-9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:45:02 user nova-compute[73484]: DEBUG nova.network.neutron [req-875a72bd-9a7d-4f7c-8bf8-fadcfd4df87a req-3906be8d-ea03-4a4f-a0ef-499333cd8a85 service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Refreshing network info cache for port 64496447-3d0b-4259-9c93-8ec02b4546fc {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:45:03 user nova-compute[73484]: DEBUG nova.network.neutron [req-875a72bd-9a7d-4f7c-8bf8-fadcfd4df87a req-3906be8d-ea03-4a4f-a0ef-499333cd8a85 service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Updated VIF entry in instance network info cache for port 64496447-3d0b-4259-9c93-8ec02b4546fc. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:45:03 user nova-compute[73484]: DEBUG nova.network.neutron [req-875a72bd-9a7d-4f7c-8bf8-fadcfd4df87a req-3906be8d-ea03-4a4f-a0ef-499333cd8a85 service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Updating instance_info_cache with network_info: [{"id": "64496447-3d0b-4259-9c93-8ec02b4546fc", "address": "fa:16:3e:69:48:02", "network": {"id": "dcba25a0-5382-48d6-a1b3-7115a3eab557", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1037577426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26adad8a3f8460c9e0bf53812d66c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64496447-3d", "ovs_interfaceid": "64496447-3d0b-4259-9c93-8ec02b4546fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:45:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-875a72bd-9a7d-4f7c-8bf8-fadcfd4df87a req-3906be8d-ea03-4a4f-a0ef-499333cd8a85 service nova] Releasing lock "refresh_cache-9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:45:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Acquiring lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:03 user nova-compute[73484]: DEBUG nova.objects.instance [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lazy-loading 'flavor' on Instance uuid 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:45:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Acquiring lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:03 user nova-compute[73484]: INFO nova.compute.manager [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Attaching volume 9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb to /dev/vdb
Aug 14 13:45:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:04 user nova-compute[73484]: DEBUG os_brick.utils [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:45:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:04 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[95980709-f337-4c15-aa8d-ccd39fd11e9c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:04 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06bcba1-d27a-4f4c-a5d1-48d84f052317]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:04 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb947a64-bfeb-4612-87bb-59d42dc00d64]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:04 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5052ef2-1d3d-46ea-8c16-a0c832efdf82]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:45:04 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:45:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:45:04 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:45:04 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06a1014-7903-4e63-a50f-f46e6b8fbc28]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:04 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:45:04 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:45:04 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:45:04 user nova-compute[73484]: DEBUG os_brick.utils [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:45:04 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Updating existing volume attachment record: c8c8aab1-790a-4c62-82e5-c87213e3d9b3 {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:45:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvLlRiWd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:45:14 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:45:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:45:14 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:45:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:45:14 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff31412-4891-444a-9130-183e4cfb57b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:45:14 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d5383d-1fa9-412c-b8e4-bb4214bb9a97]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb] added
Aug 14 13:45:14 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e2b210-f321-4259-9f33-2bbed53f82bb]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6f4556-4c4d-47ea-9589-e1adfa0ece46]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvLlRiWd {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvLlRiWd" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3045c94b-067e-4022-a919-6f9bbc006530]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tvLlRiWd'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d89da21-50a3-401d-9c5e-85b986bd2009]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a77d1c-03e2-4a18-95f5-8e2a9162e692]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:45:14 user nova-compute[73484]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:45:14 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:45:14 user nova-compute[73484]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:45:14 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f077304-8251-4493-b9e9-9a64f9bb0717]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb, portal: 172.16.0.220,3260]
Aug 14 13:45:14 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb, portal: 172.16.0.220,3260] successful.
Aug 14 13:45:14 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae88106-2f54-40ab-b936-36e894cce74a]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b5a2d0-0d5d-4d5b-baf5-22167023537a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:45:14 user nova-compute[73484]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:45:14 user nova-compute[73484]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb (non-flash)
Aug 14 13:45:14 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:45:14 user nova-compute[73484]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:45:14 user nova-compute[73484]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb (non-flash)
Aug 14 13:45:14 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b61c8b-bc0b-4ef8-ac22-09e8593b2f21]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvLlRiWd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:45:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:15 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:45:15 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23161343531373936', 'path': '/dev/sdc'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:45:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161343531373936', 'path': '/dev/sdc'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:45:15 user nova-compute[73484]: DEBUG nova.objects.instance [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lazy-loading 'flavor' on Instance uuid 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:45:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 13:45:15 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:45:15 user nova-compute[73484]:   <source dev="/dev/sdc"/>
Aug 14 13:45:15 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:45:15 user nova-compute[73484]:   <serial>9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb</serial>
Aug 14 13:45:15 user nova-compute[73484]: </disk>
Aug 14 13:45:15 user nova-compute[73484]:  {{(pid=73484) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 13:45:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:45:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:45:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] No VIF found with MAC fa:16:3e:69:48:02, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:45:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d3a72d08-f93e-435f-ac2e-4aa7c69bd8d8 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.335s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Acquiring lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:21 user nova-compute[73484]: DEBUG nova.objects.instance [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lazy-loading 'flavor' on Instance uuid 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:45:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Acquiring lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:21 user nova-compute[73484]: INFO nova.compute.manager [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Attaching volume 916bbf66-dbba-4a8c-9d8f-0b2e7448339d to /dev/vdc
Aug 14 13:45:21 user nova-compute[73484]: DEBUG os_brick.utils [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:45:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[90616a35-8355-41ad-98ab-39ae7f60cef9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9ebffd-279b-483d-a5cf-05d71879523e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47e7e15-0f2a-425b-938e-1337a40a8b70]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b410f1-da05-4340-9fc0-d80cbdadb551]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:45:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:45:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:45:22 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:45:22 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cd0400-d5d9-4099-952c-fc6199b37fb7]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG os_brick.utils [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Updating existing volume attachment record: 26be7e85-5e47-4e06-8c9e-41082706211e {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "c0994bac-3b43-414e-aa81-a9d7198775a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "c0994bac-3b43-414e-aa81-a9d7198775a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG nova.compute.manager [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "8220a084-e402-435a-b6a7-ffd94f91a211" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "8220a084-e402-435a-b6a7-ffd94f91a211" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:22 user nova-compute[73484]: INFO nova.compute.manager [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Unshelving
Aug 14 13:45:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:45:22 user nova-compute[73484]: INFO nova.compute.claims [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Claim successful on node user
Aug 14 13:45:22 user nova-compute[73484]: INFO nova.virt.block_device [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Booting with volume e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c at /dev/vdc
Aug 14 13:45:22 user nova-compute[73484]: DEBUG os_brick.utils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11588b8-fcc8-44c9-a342-75c408f2f229]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9c0855-aadf-46a5-a3b8-293d8349f5b5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae4ee31-9fc4-47de-85a1-2994209ea6cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d633d2-00b2-475e-a86b-200e530b73c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:45:22 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:45:22 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fc17ec-652f-4468-856b-b3551469e600]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG os_brick.utils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:45:22 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Updating existing volume attachment record: 3043d6a8-3ff8-489d-9827-71fa6ceffde9 {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:45:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "782c6142-757a-49ae-9292-787a7f1e8a23" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "782c6142-757a-49ae-9292-787a7f1e8a23" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:23 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:45:23 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:45:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:23 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:45:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.668s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:23 user nova-compute[73484]: DEBUG nova.compute.manager [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:45:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.054s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:23 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:45:23 user nova-compute[73484]: INFO nova.compute.claims [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Claim successful on node user
Aug 14 13:45:23 user nova-compute[73484]: DEBUG nova.compute.manager [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:45:23 user nova-compute[73484]: DEBUG nova.network.neutron [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:45:23 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:45:23 user nova-compute[73484]: DEBUG nova.compute.manager [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:45:23 user nova-compute[73484]: DEBUG nova.policy [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a0f55ad018d4c0ca587d8bdd40df4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c7f2c51c0f84bf1aedcf493a9ff860f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:45:23 user nova-compute[73484]: DEBUG nova.compute.manager [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:45:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:45:23 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Creating image(s)
Aug 14 13:45:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "/opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "/opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "/opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.206s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:23 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:45:23 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:45:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.648s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:23 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:45:23 user nova-compute[73484]: DEBUG nova.compute.manager [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:45:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.210s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG nova.network.neutron [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk 1073741824" returned: 0 in 0.076s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:24 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:45:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:45:24 user nova-compute[73484]: INFO nova.compute.claims [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Claim successful on node user
Aug 14 13:45:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.199s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG nova.policy [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '45d86b9371024e3d95ece74ccb2c37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4df46bcfb843b7ac6c17d106703950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:45:24 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Creating image(s)
Aug 14 13:45:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "/opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "/opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "/opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Cannot resize image /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG nova.objects.instance [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lazy-loading 'migration_context' on Instance uuid c0994bac-3b43-414e-aa81-a9d7198775a6 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Ensure instance console log exists: /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG nova.network.neutron [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Successfully created port: 67b5678c-ab81-4b84-86cc-c882ff19b949 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.215s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.209s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk 1073741824" returned: 0 in 0.052s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:45:24 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG nova.network.neutron [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Successfully created port: 2246e004-4f6b-449d-91b2-8e67b4f51006 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.840s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG nova.compute.manager [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.230s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Checking if we can resize image /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG nova.compute.manager [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG nova.network.neutron [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:45:25 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:45:25 user nova-compute[73484]: DEBUG nova.compute.manager [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Cannot resize image /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG nova.objects.instance [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'migration_context' on Instance uuid 782c6142-757a-49ae-9292-787a7f1e8a23 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Ensure instance console log exists: /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG nova.policy [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '45d86b9371024e3d95ece74ccb2c37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4df46bcfb843b7ac6c17d106703950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG nova.compute.manager [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:45:25 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Creating image(s)
Aug 14 13:45:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "/opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "/opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "/opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.238s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG nova.network.neutron [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Successfully updated port: 67b5678c-ab81-4b84-86cc-c882ff19b949 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "refresh_cache-c0994bac-3b43-414e-aa81-a9d7198775a6" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquired lock "refresh_cache-c0994bac-3b43-414e-aa81-a9d7198775a6" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG nova.network.neutron [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG nova.compute.manager [req-a5c06310-f468-438c-b47b-9f722b380748 req-ecd1f590-0ca5-476e-acc6-e48e47578489 service nova] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Received event network-changed-67b5678c-ab81-4b84-86cc-c882ff19b949 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG nova.compute.manager [req-a5c06310-f468-438c-b47b-9f722b380748 req-ecd1f590-0ca5-476e-acc6-e48e47578489 service nova] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Refreshing instance network info cache due to event network-changed-67b5678c-ab81-4b84-86cc-c882ff19b949. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a5c06310-f468-438c-b47b-9f722b380748 req-ecd1f590-0ca5-476e-acc6-e48e47578489 service nova] Acquiring lock "refresh_cache-c0994bac-3b43-414e-aa81-a9d7198775a6" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG nova.network.neutron [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.217s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk 1073741824" returned: 0 in 0.058s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.network.neutron [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Successfully updated port: 2246e004-4f6b-449d-91b2-8e67b4f51006 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "refresh_cache-782c6142-757a-49ae-9292-787a7f1e8a23" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquired lock "refresh_cache-782c6142-757a-49ae-9292-787a7f1e8a23" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.network.neutron [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.compute.manager [req-96d431a7-7c99-420e-aa96-4d5441ee119b req-da548b43-659b-45c7-aae5-29abda912100 service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Received event network-changed-2246e004-4f6b-449d-91b2-8e67b4f51006 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.compute.manager [req-96d431a7-7c99-420e-aa96-4d5441ee119b req-da548b43-659b-45c7-aae5-29abda912100 service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Refreshing instance network info cache due to event network-changed-2246e004-4f6b-449d-91b2-8e67b4f51006. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-96d431a7-7c99-420e-aa96-4d5441ee119b req-da548b43-659b-45c7-aae5-29abda912100 service nova] Acquiring lock "refresh_cache-782c6142-757a-49ae-9292-787a7f1e8a23" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.220s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.network.neutron [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Cannot resize image /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.objects.instance [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'migration_context' on Instance uuid 03255d24-b6fd-459c-8ac6-f9c4063b54b2 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Ensure instance console log exists: /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.network.neutron [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Updating instance_info_cache with network_info: [{"id": "67b5678c-ab81-4b84-86cc-c882ff19b949", "address": "fa:16:3e:f8:d1:e3", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b5678c-ab", "ovs_interfaceid": "67b5678c-ab81-4b84-86cc-c882ff19b949", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Releasing lock "refresh_cache-c0994bac-3b43-414e-aa81-a9d7198775a6" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.compute.manager [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Instance network_info: |[{"id": "67b5678c-ab81-4b84-86cc-c882ff19b949", "address": "fa:16:3e:f8:d1:e3", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b5678c-ab", "ovs_interfaceid": "67b5678c-ab81-4b84-86cc-c882ff19b949", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a5c06310-f468-438c-b47b-9f722b380748 req-ecd1f590-0ca5-476e-acc6-e48e47578489 service nova] Acquired lock "refresh_cache-c0994bac-3b43-414e-aa81-a9d7198775a6" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.network.neutron [req-a5c06310-f468-438c-b47b-9f722b380748 req-ecd1f590-0ca5-476e-acc6-e48e47578489 service nova] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Refreshing network info cache for port 67b5678c-ab81-4b84-86cc-c882ff19b949 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Start _get_guest_xml network_info=[{"id": "67b5678c-ab81-4b84-86cc-c882ff19b949", "address": "fa:16:3e:f8:d1:e3", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b5678c-ab", "ovs_interfaceid": "67b5678c-ab81-4b84-86cc-c882ff19b949", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:45:26 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:45:26 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:45:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1086915947',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1086915947',id=23,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c7f2c51c0f84bf1aedcf493a9ff860f',ramdisk_id='',reservation_id='r-zxtjs5zf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-830908511',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:45:23Z,user_data=None,user_id='5a0f55ad018d4c0ca587d8bdd40df4c8',uuid=c0994bac-3b43-414e-aa81-a9d7198775a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67b5678c-ab81-4b84-86cc-c882ff19b949", "address": "fa:16:3e:f8:d1:e3", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b5678c-ab", "ovs_interfaceid": "67b5678c-ab81-4b84-86cc-c882ff19b949", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Converting VIF {"id": "67b5678c-ab81-4b84-86cc-c882ff19b949", "address": "fa:16:3e:f8:d1:e3", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b5678c-ab", "ovs_interfaceid": "67b5678c-ab81-4b84-86cc-c882ff19b949", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:d1:e3,bridge_name='br-int',has_traffic_filtering=True,id=67b5678c-ab81-4b84-86cc-c882ff19b949,network=Network(4ec437fc-4371-48d6-8026-b64423fbc0ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b5678c-ab') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.objects.instance [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lazy-loading 'pci_devices' on Instance uuid c0994bac-3b43-414e-aa81-a9d7198775a6 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:45:26 user nova-compute[73484]:   <uuid>c0994bac-3b43-414e-aa81-a9d7198775a6</uuid>
Aug 14 13:45:26 user nova-compute[73484]:   <name>instance-00000017</name>
Aug 14 13:45:26 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:45:26 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:45:26 user nova-compute[73484]:   <metadata>
Aug 14 13:45:26 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:45:26 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:45:26 user nova-compute[73484]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1086915947</nova:name>
Aug 14 13:45:26 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:45:26</nova:creationTime>
Aug 14 13:45:26 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:45:26 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:45:26 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:45:26 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:45:26 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:45:26 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:45:26 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:45:26 user nova-compute[73484]:       <nova:owner>
Aug 14 13:45:26 user nova-compute[73484]:         <nova:user uuid="5a0f55ad018d4c0ca587d8bdd40df4c8">tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member</nova:user>
Aug 14 13:45:26 user nova-compute[73484]:         <nova:project uuid="2c7f2c51c0f84bf1aedcf493a9ff860f">tempest-ServerBootFromVolumeStableRescueTest-830908511</nova:project>
Aug 14 13:45:26 user nova-compute[73484]:       </nova:owner>
Aug 14 13:45:26 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:45:26 user nova-compute[73484]:       <nova:ports>
Aug 14 13:45:26 user nova-compute[73484]:         <nova:port uuid="67b5678c-ab81-4b84-86cc-c882ff19b949">
Aug 14 13:45:26 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 13:45:26 user nova-compute[73484]:         </nova:port>
Aug 14 13:45:26 user nova-compute[73484]:       </nova:ports>
Aug 14 13:45:26 user nova-compute[73484]:     </nova:instance>
Aug 14 13:45:26 user nova-compute[73484]:   </metadata>
Aug 14 13:45:26 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:45:26 user nova-compute[73484]:     <system>
Aug 14 13:45:26 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:45:26 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:45:26 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:45:26 user nova-compute[73484]:       <entry name="serial">c0994bac-3b43-414e-aa81-a9d7198775a6</entry>
Aug 14 13:45:26 user nova-compute[73484]:       <entry name="uuid">c0994bac-3b43-414e-aa81-a9d7198775a6</entry>
Aug 14 13:45:26 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:45:26 user nova-compute[73484]:     </system>
Aug 14 13:45:26 user nova-compute[73484]:   </sysinfo>
Aug 14 13:45:26 user nova-compute[73484]:   <os>
Aug 14 13:45:26 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:45:26 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:45:26 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:45:26 user nova-compute[73484]:   </os>
Aug 14 13:45:26 user nova-compute[73484]:   <features>
Aug 14 13:45:26 user nova-compute[73484]:     <acpi/>
Aug 14 13:45:26 user nova-compute[73484]:     <apic/>
Aug 14 13:45:26 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:45:26 user nova-compute[73484]:   </features>
Aug 14 13:45:26 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:45:26 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:45:26 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:45:26 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:45:26 user nova-compute[73484]:   </clock>
Aug 14 13:45:26 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:45:26 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:45:26 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:45:26 user nova-compute[73484]:   </cpu>
Aug 14 13:45:26 user nova-compute[73484]:   <devices>
Aug 14 13:45:26 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:45:26 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:45:26 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk"/>
Aug 14 13:45:26 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:45:26 user nova-compute[73484]:     </disk>
Aug 14 13:45:26 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:45:26 user nova-compute[73484]:       <mac address="fa:16:3e:f8:d1:e3"/>
Aug 14 13:45:26 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:45:26 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:45:26 user nova-compute[73484]:       <target dev="tap67b5678c-ab"/>
Aug 14 13:45:26 user nova-compute[73484]:     </interface>
Aug 14 13:45:26 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:45:26 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/console.log" append="off"/>
Aug 14 13:45:26 user nova-compute[73484]:     </serial>
Aug 14 13:45:26 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:45:26 user nova-compute[73484]:     <video>
Aug 14 13:45:26 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:45:26 user nova-compute[73484]:     </video>
Aug 14 13:45:26 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:45:26 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:45:26 user nova-compute[73484]:     </rng>
Aug 14 13:45:26 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:45:26 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:45:26 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:45:26 user nova-compute[73484]:     </memballoon>
Aug 14 13:45:26 user nova-compute[73484]:   </devices>
Aug 14 13:45:26 user nova-compute[73484]: </domain>
Aug 14 13:45:26 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:45:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1086915947',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1086915947',id=23,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c7f2c51c0f84bf1aedcf493a9ff860f',ramdisk_id='',reservation_id='r-zxtjs5zf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-830908511',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:45:23Z,user_data=None,user_id='5a0f55ad018d4c0ca587d8bdd40df4c8',uuid=c0994bac-3b43-414e-aa81-a9d7198775a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67b5678c-ab81-4b84-86cc-c882ff19b949", "address": "fa:16:3e:f8:d1:e3", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b5678c-ab", "ovs_interfaceid": "67b5678c-ab81-4b84-86cc-c882ff19b949", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Converting VIF {"id": "67b5678c-ab81-4b84-86cc-c882ff19b949", "address": "fa:16:3e:f8:d1:e3", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b5678c-ab", "ovs_interfaceid": "67b5678c-ab81-4b84-86cc-c882ff19b949", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:d1:e3,bridge_name='br-int',has_traffic_filtering=True,id=67b5678c-ab81-4b84-86cc-c882ff19b949,network=Network(4ec437fc-4371-48d6-8026-b64423fbc0ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b5678c-ab') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG os_vif [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:d1:e3,bridge_name='br-int',has_traffic_filtering=True,id=67b5678c-ab81-4b84-86cc-c882ff19b949,network=Network(4ec437fc-4371-48d6-8026-b64423fbc0ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b5678c-ab') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67b5678c-ab, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap67b5678c-ab, col_values=(('external_ids', {'iface-id': '67b5678c-ab81-4b84-86cc-c882ff19b949', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:d1:e3', 'vm-uuid': 'c0994bac-3b43-414e-aa81-a9d7198775a6'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.network.neutron [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Updating instance_info_cache with network_info: [{"id": "2246e004-4f6b-449d-91b2-8e67b4f51006", "address": "fa:16:3e:31:2a:06", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2246e004-4f", "ovs_interfaceid": "2246e004-4f6b-449d-91b2-8e67b4f51006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:26 user nova-compute[73484]: INFO os_vif [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:d1:e3,bridge_name='br-int',has_traffic_filtering=True,id=67b5678c-ab81-4b84-86cc-c882ff19b949,network=Network(4ec437fc-4371-48d6-8026-b64423fbc0ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b5678c-ab')
Aug 14 13:45:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Releasing lock "refresh_cache-782c6142-757a-49ae-9292-787a7f1e8a23" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Instance network_info: |[{"id": "2246e004-4f6b-449d-91b2-8e67b4f51006", "address": "fa:16:3e:31:2a:06", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2246e004-4f", "ovs_interfaceid": "2246e004-4f6b-449d-91b2-8e67b4f51006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-96d431a7-7c99-420e-aa96-4d5441ee119b req-da548b43-659b-45c7-aae5-29abda912100 service nova] Acquired lock "refresh_cache-782c6142-757a-49ae-9292-787a7f1e8a23" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.network.neutron [req-96d431a7-7c99-420e-aa96-4d5441ee119b req-da548b43-659b-45c7-aae5-29abda912100 service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Refreshing network info cache for port 2246e004-4f6b-449d-91b2-8e67b4f51006 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Start _get_guest_xml network_info=[{"id": "2246e004-4f6b-449d-91b2-8e67b4f51006", "address": "fa:16:3e:31:2a:06", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2246e004-4f", "ovs_interfaceid": "2246e004-4f6b-449d-91b2-8e67b4f51006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:45:26 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:45:26 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:45:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-260357687',display_name='tempest-ServerRescueNegativeTestJSON-server-260357687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-260357687',id=24,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f4df46bcfb843b7ac6c17d106703950',ramdisk_id='',reservation_id='r-07yebak7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-496474583',owner_user_name='tempest-ServerRescueNegativeTestJSON-496474583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:45:24Z,user_data=None,user_id='45d86b9371024e3d95ece74ccb2c37d9',uuid=782c6142-757a-49ae-9292-787a7f1e8a23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2246e004-4f6b-449d-91b2-8e67b4f51006", "address": "fa:16:3e:31:2a:06", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2246e004-4f", "ovs_interfaceid": "2246e004-4f6b-449d-91b2-8e67b4f51006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Converting VIF {"id": "2246e004-4f6b-449d-91b2-8e67b4f51006", "address": "fa:16:3e:31:2a:06", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2246e004-4f", "ovs_interfaceid": "2246e004-4f6b-449d-91b2-8e67b4f51006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:2a:06,bridge_name='br-int',has_traffic_filtering=True,id=2246e004-4f6b-449d-91b2-8e67b4f51006,network=Network(cad53782-5ecf-4140-b113-62e807bf87df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2246e004-4f') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.objects.instance [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'pci_devices' on Instance uuid 782c6142-757a-49ae-9292-787a7f1e8a23 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:45:26 user nova-compute[73484]:   <uuid>782c6142-757a-49ae-9292-787a7f1e8a23</uuid>
Aug 14 13:45:26 user nova-compute[73484]:   <name>instance-00000018</name>
Aug 14 13:45:26 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:45:26 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:45:26 user nova-compute[73484]:   <metadata>
Aug 14 13:45:26 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:45:26 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:45:26 user nova-compute[73484]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-260357687</nova:name>
Aug 14 13:45:26 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:45:26</nova:creationTime>
Aug 14 13:45:26 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:45:26 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:45:26 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:45:26 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:45:26 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:45:26 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:45:26 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:45:26 user nova-compute[73484]:       <nova:owner>
Aug 14 13:45:26 user nova-compute[73484]:         <nova:user uuid="45d86b9371024e3d95ece74ccb2c37d9">tempest-ServerRescueNegativeTestJSON-496474583-project-member</nova:user>
Aug 14 13:45:26 user nova-compute[73484]:         <nova:project uuid="0f4df46bcfb843b7ac6c17d106703950">tempest-ServerRescueNegativeTestJSON-496474583</nova:project>
Aug 14 13:45:26 user nova-compute[73484]:       </nova:owner>
Aug 14 13:45:26 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:45:26 user nova-compute[73484]:       <nova:ports>
Aug 14 13:45:26 user nova-compute[73484]:         <nova:port uuid="2246e004-4f6b-449d-91b2-8e67b4f51006">
Aug 14 13:45:26 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 13:45:26 user nova-compute[73484]:         </nova:port>
Aug 14 13:45:26 user nova-compute[73484]:       </nova:ports>
Aug 14 13:45:26 user nova-compute[73484]:     </nova:instance>
Aug 14 13:45:26 user nova-compute[73484]:   </metadata>
Aug 14 13:45:26 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:45:26 user nova-compute[73484]:     <system>
Aug 14 13:45:26 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:45:26 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:45:26 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:45:26 user nova-compute[73484]:       <entry name="serial">782c6142-757a-49ae-9292-787a7f1e8a23</entry>
Aug 14 13:45:26 user nova-compute[73484]:       <entry name="uuid">782c6142-757a-49ae-9292-787a7f1e8a23</entry>
Aug 14 13:45:26 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:45:26 user nova-compute[73484]:     </system>
Aug 14 13:45:26 user nova-compute[73484]:   </sysinfo>
Aug 14 13:45:26 user nova-compute[73484]:   <os>
Aug 14 13:45:26 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:45:26 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:45:26 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:45:26 user nova-compute[73484]:   </os>
Aug 14 13:45:26 user nova-compute[73484]:   <features>
Aug 14 13:45:26 user nova-compute[73484]:     <acpi/>
Aug 14 13:45:26 user nova-compute[73484]:     <apic/>
Aug 14 13:45:26 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:45:26 user nova-compute[73484]:   </features>
Aug 14 13:45:26 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:45:26 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:45:26 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:45:26 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:45:26 user nova-compute[73484]:   </clock>
Aug 14 13:45:26 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:45:26 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:45:26 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:45:26 user nova-compute[73484]:   </cpu>
Aug 14 13:45:26 user nova-compute[73484]:   <devices>
Aug 14 13:45:26 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:45:26 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:45:26 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk"/>
Aug 14 13:45:26 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:45:26 user nova-compute[73484]:     </disk>
Aug 14 13:45:26 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:45:26 user nova-compute[73484]:       <mac address="fa:16:3e:31:2a:06"/>
Aug 14 13:45:26 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:45:26 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:45:26 user nova-compute[73484]:       <target dev="tap2246e004-4f"/>
Aug 14 13:45:26 user nova-compute[73484]:     </interface>
Aug 14 13:45:26 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:45:26 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/console.log" append="off"/>
Aug 14 13:45:26 user nova-compute[73484]:     </serial>
Aug 14 13:45:26 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:45:26 user nova-compute[73484]:     <video>
Aug 14 13:45:26 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:45:26 user nova-compute[73484]:     </video>
Aug 14 13:45:26 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:45:26 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:45:26 user nova-compute[73484]:     </rng>
Aug 14 13:45:26 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:45:26 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:45:26 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:45:26 user nova-compute[73484]:     </memballoon>
Aug 14 13:45:26 user nova-compute[73484]:   </devices>
Aug 14 13:45:26 user nova-compute[73484]: </domain>
Aug 14 13:45:26 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:45:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-260357687',display_name='tempest-ServerRescueNegativeTestJSON-server-260357687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-260357687',id=24,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f4df46bcfb843b7ac6c17d106703950',ramdisk_id='',reservation_id='r-07yebak7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-496474583',owner_user_name='tempest-ServerRescueNegativeTestJSON-496474583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:45:24Z,user_data=None,user_id='45d86b9371024e3d95ece74ccb2c37d9',uuid=782c6142-757a-49ae-9292-787a7f1e8a23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2246e004-4f6b-449d-91b2-8e67b4f51006", "address": "fa:16:3e:31:2a:06", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2246e004-4f", "ovs_interfaceid": "2246e004-4f6b-449d-91b2-8e67b4f51006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Converting VIF {"id": "2246e004-4f6b-449d-91b2-8e67b4f51006", "address": "fa:16:3e:31:2a:06", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2246e004-4f", "ovs_interfaceid": "2246e004-4f6b-449d-91b2-8e67b4f51006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:2a:06,bridge_name='br-int',has_traffic_filtering=True,id=2246e004-4f6b-449d-91b2-8e67b4f51006,network=Network(cad53782-5ecf-4140-b113-62e807bf87df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2246e004-4f') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG os_vif [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:2a:06,bridge_name='br-int',has_traffic_filtering=True,id=2246e004-4f6b-449d-91b2-8e67b4f51006,network=Network(cad53782-5ecf-4140-b113-62e807bf87df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2246e004-4f') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2246e004-4f, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2246e004-4f, col_values=(('external_ids', {'iface-id': '2246e004-4f6b-449d-91b2-8e67b4f51006', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:2a:06', 'vm-uuid': '782c6142-757a-49ae-9292-787a7f1e8a23'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] No VIF found with MAC fa:16:3e:f8:d1:e3, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:26 user nova-compute[73484]: INFO os_vif [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:2a:06,bridge_name='br-int',has_traffic_filtering=True,id=2246e004-4f6b-449d-91b2-8e67b4f51006,network=Network(cad53782-5ecf-4140-b113-62e807bf87df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2246e004-4f')
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] No VIF found with MAC fa:16:3e:31:2a:06, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:45:26 user nova-compute[73484]: DEBUG nova.network.neutron [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Successfully created port: be08ca28-6a00-468c-9988-87185f498ca3 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:45:27 user nova-compute[73484]: DEBUG nova.network.neutron [req-96d431a7-7c99-420e-aa96-4d5441ee119b req-da548b43-659b-45c7-aae5-29abda912100 service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Updated VIF entry in instance network info cache for port 2246e004-4f6b-449d-91b2-8e67b4f51006. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:45:27 user nova-compute[73484]: DEBUG nova.network.neutron [req-96d431a7-7c99-420e-aa96-4d5441ee119b req-da548b43-659b-45c7-aae5-29abda912100 service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Updating instance_info_cache with network_info: [{"id": "2246e004-4f6b-449d-91b2-8e67b4f51006", "address": "fa:16:3e:31:2a:06", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2246e004-4f", "ovs_interfaceid": "2246e004-4f6b-449d-91b2-8e67b4f51006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:45:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-96d431a7-7c99-420e-aa96-4d5441ee119b req-da548b43-659b-45c7-aae5-29abda912100 service nova] Releasing lock "refresh_cache-782c6142-757a-49ae-9292-787a7f1e8a23" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:45:27 user nova-compute[73484]: DEBUG nova.network.neutron [req-a5c06310-f468-438c-b47b-9f722b380748 req-ecd1f590-0ca5-476e-acc6-e48e47578489 service nova] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Updated VIF entry in instance network info cache for port 67b5678c-ab81-4b84-86cc-c882ff19b949. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:45:27 user nova-compute[73484]: DEBUG nova.network.neutron [req-a5c06310-f468-438c-b47b-9f722b380748 req-ecd1f590-0ca5-476e-acc6-e48e47578489 service nova] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Updating instance_info_cache with network_info: [{"id": "67b5678c-ab81-4b84-86cc-c882ff19b949", "address": "fa:16:3e:f8:d1:e3", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b5678c-ab", "ovs_interfaceid": "67b5678c-ab81-4b84-86cc-c882ff19b949", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:45:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a5c06310-f468-438c-b47b-9f722b380748 req-ecd1f590-0ca5-476e-acc6-e48e47578489 service nova] Releasing lock "refresh_cache-c0994bac-3b43-414e-aa81-a9d7198775a6" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:45:27 user nova-compute[73484]: DEBUG nova.network.neutron [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Successfully updated port: be08ca28-6a00-468c-9988-87185f498ca3 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:45:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "refresh_cache-03255d24-b6fd-459c-8ac6-f9c4063b54b2" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:45:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquired lock "refresh_cache-03255d24-b6fd-459c-8ac6-f9c4063b54b2" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:45:27 user nova-compute[73484]: DEBUG nova.network.neutron [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:45:27 user nova-compute[73484]: DEBUG nova.network.neutron [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:45:27 user nova-compute[73484]: DEBUG nova.compute.manager [req-4a857ccc-655c-4ec7-91f6-2a5c0452a6fd req-0c6f13c2-d5ed-4ae2-a635-7a528140d5ab service nova] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Received event network-changed-be08ca28-6a00-468c-9988-87185f498ca3 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:45:27 user nova-compute[73484]: DEBUG nova.compute.manager [req-4a857ccc-655c-4ec7-91f6-2a5c0452a6fd req-0c6f13c2-d5ed-4ae2-a635-7a528140d5ab service nova] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Refreshing instance network info cache due to event network-changed-be08ca28-6a00-468c-9988-87185f498ca3. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:45:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4a857ccc-655c-4ec7-91f6-2a5c0452a6fd req-0c6f13c2-d5ed-4ae2-a635-7a528140d5ab service nova] Acquiring lock "refresh_cache-03255d24-b6fd-459c-8ac6-f9c4063b54b2" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG nova.network.neutron [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Updating instance_info_cache with network_info: [{"id": "be08ca28-6a00-468c-9988-87185f498ca3", "address": "fa:16:3e:66:27:2e", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe08ca28-6a", "ovs_interfaceid": "be08ca28-6a00-468c-9988-87185f498ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Releasing lock "refresh_cache-03255d24-b6fd-459c-8ac6-f9c4063b54b2" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Instance network_info: |[{"id": "be08ca28-6a00-468c-9988-87185f498ca3", "address": "fa:16:3e:66:27:2e", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe08ca28-6a", "ovs_interfaceid": "be08ca28-6a00-468c-9988-87185f498ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4a857ccc-655c-4ec7-91f6-2a5c0452a6fd req-0c6f13c2-d5ed-4ae2-a635-7a528140d5ab service nova] Acquired lock "refresh_cache-03255d24-b6fd-459c-8ac6-f9c4063b54b2" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG nova.network.neutron [req-4a857ccc-655c-4ec7-91f6-2a5c0452a6fd req-0c6f13c2-d5ed-4ae2-a635-7a528140d5ab service nova] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Refreshing network info cache for port be08ca28-6a00-468c-9988-87185f498ca3 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Start _get_guest_xml network_info=[{"id": "be08ca28-6a00-468c-9988-87185f498ca3", "address": "fa:16:3e:66:27:2e", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe08ca28-6a", "ovs_interfaceid": "be08ca28-6a00-468c-9988-87185f498ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:45:28 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:45:28 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:45:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1759674947',display_name='tempest-ServerRescueNegativeTestJSON-server-1759674947',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1759674947',id=25,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f4df46bcfb843b7ac6c17d106703950',ramdisk_id='',reservation_id='r-yok2frut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-496474583',owner_user_name='tempest-ServerRescueNegativeTestJSON-496474583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:45:25Z,user_data=None,user_id='45d86b9371024e3d95ece74ccb2c37d9',uuid=03255d24-b6fd-459c-8ac6-f9c4063b54b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be08ca28-6a00-468c-9988-87185f498ca3", "address": "fa:16:3e:66:27:2e", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe08ca28-6a", "ovs_interfaceid": "be08ca28-6a00-468c-9988-87185f498ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Converting VIF {"id": "be08ca28-6a00-468c-9988-87185f498ca3", "address": "fa:16:3e:66:27:2e", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe08ca28-6a", "ovs_interfaceid": "be08ca28-6a00-468c-9988-87185f498ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:27:2e,bridge_name='br-int',has_traffic_filtering=True,id=be08ca28-6a00-468c-9988-87185f498ca3,network=Network(cad53782-5ecf-4140-b113-62e807bf87df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe08ca28-6a') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG nova.objects.instance [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'pci_devices' on Instance uuid 03255d24-b6fd-459c-8ac6-f9c4063b54b2 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:45:28 user nova-compute[73484]:   <uuid>03255d24-b6fd-459c-8ac6-f9c4063b54b2</uuid>
Aug 14 13:45:28 user nova-compute[73484]:   <name>instance-00000019</name>
Aug 14 13:45:28 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:45:28 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:45:28 user nova-compute[73484]:   <metadata>
Aug 14 13:45:28 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:45:28 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:45:28 user nova-compute[73484]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1759674947</nova:name>
Aug 14 13:45:28 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:45:28</nova:creationTime>
Aug 14 13:45:28 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:45:28 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:45:28 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:45:28 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:45:28 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:45:28 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:45:28 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:45:28 user nova-compute[73484]:       <nova:owner>
Aug 14 13:45:28 user nova-compute[73484]:         <nova:user uuid="45d86b9371024e3d95ece74ccb2c37d9">tempest-ServerRescueNegativeTestJSON-496474583-project-member</nova:user>
Aug 14 13:45:28 user nova-compute[73484]:         <nova:project uuid="0f4df46bcfb843b7ac6c17d106703950">tempest-ServerRescueNegativeTestJSON-496474583</nova:project>
Aug 14 13:45:28 user nova-compute[73484]:       </nova:owner>
Aug 14 13:45:28 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:45:28 user nova-compute[73484]:       <nova:ports>
Aug 14 13:45:28 user nova-compute[73484]:         <nova:port uuid="be08ca28-6a00-468c-9988-87185f498ca3">
Aug 14 13:45:28 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 13:45:28 user nova-compute[73484]:         </nova:port>
Aug 14 13:45:28 user nova-compute[73484]:       </nova:ports>
Aug 14 13:45:28 user nova-compute[73484]:     </nova:instance>
Aug 14 13:45:28 user nova-compute[73484]:   </metadata>
Aug 14 13:45:28 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:45:28 user nova-compute[73484]:     <system>
Aug 14 13:45:28 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:45:28 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:45:28 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:45:28 user nova-compute[73484]:       <entry name="serial">03255d24-b6fd-459c-8ac6-f9c4063b54b2</entry>
Aug 14 13:45:28 user nova-compute[73484]:       <entry name="uuid">03255d24-b6fd-459c-8ac6-f9c4063b54b2</entry>
Aug 14 13:45:28 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:45:28 user nova-compute[73484]:     </system>
Aug 14 13:45:28 user nova-compute[73484]:   </sysinfo>
Aug 14 13:45:28 user nova-compute[73484]:   <os>
Aug 14 13:45:28 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:45:28 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:45:28 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:45:28 user nova-compute[73484]:   </os>
Aug 14 13:45:28 user nova-compute[73484]:   <features>
Aug 14 13:45:28 user nova-compute[73484]:     <acpi/>
Aug 14 13:45:28 user nova-compute[73484]:     <apic/>
Aug 14 13:45:28 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:45:28 user nova-compute[73484]:   </features>
Aug 14 13:45:28 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:45:28 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:45:28 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:45:28 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:45:28 user nova-compute[73484]:   </clock>
Aug 14 13:45:28 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:45:28 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:45:28 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:45:28 user nova-compute[73484]:   </cpu>
Aug 14 13:45:28 user nova-compute[73484]:   <devices>
Aug 14 13:45:28 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:45:28 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:45:28 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk"/>
Aug 14 13:45:28 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:45:28 user nova-compute[73484]:     </disk>
Aug 14 13:45:28 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:45:28 user nova-compute[73484]:       <mac address="fa:16:3e:66:27:2e"/>
Aug 14 13:45:28 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:45:28 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:45:28 user nova-compute[73484]:       <target dev="tapbe08ca28-6a"/>
Aug 14 13:45:28 user nova-compute[73484]:     </interface>
Aug 14 13:45:28 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:45:28 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/console.log" append="off"/>
Aug 14 13:45:28 user nova-compute[73484]:     </serial>
Aug 14 13:45:28 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:45:28 user nova-compute[73484]:     <video>
Aug 14 13:45:28 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:45:28 user nova-compute[73484]:     </video>
Aug 14 13:45:28 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:45:28 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:45:28 user nova-compute[73484]:     </rng>
Aug 14 13:45:28 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:45:28 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:45:28 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:45:28 user nova-compute[73484]:     </memballoon>
Aug 14 13:45:28 user nova-compute[73484]:   </devices>
Aug 14 13:45:28 user nova-compute[73484]: </domain>
Aug 14 13:45:28 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1759674947',display_name='tempest-ServerRescueNegativeTestJSON-server-1759674947',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1759674947',id=25,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f4df46bcfb843b7ac6c17d106703950',ramdisk_id='',reservation_id='r-yok2frut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-496474583',owner_user_name='tempest-ServerRescueNegativeTestJSON-496474583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:45:25Z,user_data=None,user_id='45d86b9371024e3d95ece74ccb2c37d9',uuid=03255d24-b6fd-459c-8ac6-f9c4063b54b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be08ca28-6a00-468c-9988-87185f498ca3", "address": "fa:16:3e:66:27:2e", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe08ca28-6a", "ovs_interfaceid": "be08ca28-6a00-468c-9988-87185f498ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Converting VIF {"id": "be08ca28-6a00-468c-9988-87185f498ca3", "address": "fa:16:3e:66:27:2e", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe08ca28-6a", "ovs_interfaceid": "be08ca28-6a00-468c-9988-87185f498ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:27:2e,bridge_name='br-int',has_traffic_filtering=True,id=be08ca28-6a00-468c-9988-87185f498ca3,network=Network(cad53782-5ecf-4140-b113-62e807bf87df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe08ca28-6a') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG os_vif [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:27:2e,bridge_name='br-int',has_traffic_filtering=True,id=be08ca28-6a00-468c-9988-87185f498ca3,network=Network(cad53782-5ecf-4140-b113-62e807bf87df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe08ca28-6a') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe08ca28-6a, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbe08ca28-6a, col_values=(('external_ids', {'iface-id': 'be08ca28-6a00-468c-9988-87185f498ca3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:27:2e', 'vm-uuid': '03255d24-b6fd-459c-8ac6-f9c4063b54b2'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:28 user nova-compute[73484]: INFO os_vif [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:27:2e,bridge_name='br-int',has_traffic_filtering=True,id=be08ca28-6a00-468c-9988-87185f498ca3,network=Network(cad53782-5ecf-4140-b113-62e807bf87df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe08ca28-6a')
Aug 14 13:45:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:45:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] No VIF found with MAC fa:16:3e:66:27:2e, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:45:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:29 user nova-compute[73484]: DEBUG nova.network.neutron [req-4a857ccc-655c-4ec7-91f6-2a5c0452a6fd req-0c6f13c2-d5ed-4ae2-a635-7a528140d5ab service nova] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Updated VIF entry in instance network info cache for port be08ca28-6a00-468c-9988-87185f498ca3. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:45:29 user nova-compute[73484]: DEBUG nova.network.neutron [req-4a857ccc-655c-4ec7-91f6-2a5c0452a6fd req-0c6f13c2-d5ed-4ae2-a635-7a528140d5ab service nova] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Updating instance_info_cache with network_info: [{"id": "be08ca28-6a00-468c-9988-87185f498ca3", "address": "fa:16:3e:66:27:2e", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe08ca28-6a", "ovs_interfaceid": "be08ca28-6a00-468c-9988-87185f498ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:45:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4a857ccc-655c-4ec7-91f6-2a5c0452a6fd req-0c6f13c2-d5ed-4ae2-a635-7a528140d5ab service nova] Releasing lock "refresh_cache-03255d24-b6fd-459c-8ac6-f9c4063b54b2" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:45:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:29 user nova-compute[73484]: DEBUG nova.compute.manager [req-6ad16e02-9d02-496a-88e9-71516a7af79d req-28cee526-1bae-4da0-a317-cfa5027075b0 service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Received event network-vif-plugged-2246e004-4f6b-449d-91b2-8e67b4f51006 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:45:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6ad16e02-9d02-496a-88e9-71516a7af79d req-28cee526-1bae-4da0-a317-cfa5027075b0 service nova] Acquiring lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6ad16e02-9d02-496a-88e9-71516a7af79d req-28cee526-1bae-4da0-a317-cfa5027075b0 service nova] Lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6ad16e02-9d02-496a-88e9-71516a7af79d req-28cee526-1bae-4da0-a317-cfa5027075b0 service nova] Lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:29 user nova-compute[73484]: DEBUG nova.compute.manager [req-6ad16e02-9d02-496a-88e9-71516a7af79d req-28cee526-1bae-4da0-a317-cfa5027075b0 service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] No waiting events found dispatching network-vif-plugged-2246e004-4f6b-449d-91b2-8e67b4f51006 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:45:29 user nova-compute[73484]: WARNING nova.compute.manager [req-6ad16e02-9d02-496a-88e9-71516a7af79d req-28cee526-1bae-4da0-a317-cfa5027075b0 service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Received unexpected event network-vif-plugged-2246e004-4f6b-449d-91b2-8e67b4f51006 for instance with vm_state building and task_state spawning.
Aug 14 13:45:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:31 user nova-compute[73484]: DEBUG nova.compute.manager [req-f785978a-4100-4ad9-9f73-fd0cbbf0d269 req-9261ce59-dbe9-4ee3-af71-5b3a22890704 service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Received event network-vif-plugged-2246e004-4f6b-449d-91b2-8e67b4f51006 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:45:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f785978a-4100-4ad9-9f73-fd0cbbf0d269 req-9261ce59-dbe9-4ee3-af71-5b3a22890704 service nova] Acquiring lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f785978a-4100-4ad9-9f73-fd0cbbf0d269 req-9261ce59-dbe9-4ee3-af71-5b3a22890704 service nova] Lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f785978a-4100-4ad9-9f73-fd0cbbf0d269 req-9261ce59-dbe9-4ee3-af71-5b3a22890704 service nova] Lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:31 user nova-compute[73484]: DEBUG nova.compute.manager [req-f785978a-4100-4ad9-9f73-fd0cbbf0d269 req-9261ce59-dbe9-4ee3-af71-5b3a22890704 service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] No waiting events found dispatching network-vif-plugged-2246e004-4f6b-449d-91b2-8e67b4f51006 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:45:31 user nova-compute[73484]: WARNING nova.compute.manager [req-f785978a-4100-4ad9-9f73-fd0cbbf0d269 req-9261ce59-dbe9-4ee3-af71-5b3a22890704 service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Received unexpected event network-vif-plugged-2246e004-4f6b-449d-91b2-8e67b4f51006 for instance with vm_state building and task_state spawning.
Aug 14 13:45:31 user nova-compute[73484]: DEBUG nova.compute.manager [req-f785978a-4100-4ad9-9f73-fd0cbbf0d269 req-9261ce59-dbe9-4ee3-af71-5b3a22890704 service nova] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Received event network-vif-plugged-67b5678c-ab81-4b84-86cc-c882ff19b949 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:45:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f785978a-4100-4ad9-9f73-fd0cbbf0d269 req-9261ce59-dbe9-4ee3-af71-5b3a22890704 service nova] Acquiring lock "c0994bac-3b43-414e-aa81-a9d7198775a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f785978a-4100-4ad9-9f73-fd0cbbf0d269 req-9261ce59-dbe9-4ee3-af71-5b3a22890704 service nova] Lock "c0994bac-3b43-414e-aa81-a9d7198775a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f785978a-4100-4ad9-9f73-fd0cbbf0d269 req-9261ce59-dbe9-4ee3-af71-5b3a22890704 service nova] Lock "c0994bac-3b43-414e-aa81-a9d7198775a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:31 user nova-compute[73484]: DEBUG nova.compute.manager [req-f785978a-4100-4ad9-9f73-fd0cbbf0d269 req-9261ce59-dbe9-4ee3-af71-5b3a22890704 service nova] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] No waiting events found dispatching network-vif-plugged-67b5678c-ab81-4b84-86cc-c882ff19b949 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:45:31 user nova-compute[73484]: WARNING nova.compute.manager [req-f785978a-4100-4ad9-9f73-fd0cbbf0d269 req-9261ce59-dbe9-4ee3-af71-5b3a22890704 service nova] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Received unexpected event network-vif-plugged-67b5678c-ab81-4b84-86cc-c882ff19b949 for instance with vm_state building and task_state spawning.
Aug 14 13:45:31 user nova-compute[73484]: DEBUG nova.compute.manager [req-f785978a-4100-4ad9-9f73-fd0cbbf0d269 req-9261ce59-dbe9-4ee3-af71-5b3a22890704 service nova] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Received event network-vif-plugged-67b5678c-ab81-4b84-86cc-c882ff19b949 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:45:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f785978a-4100-4ad9-9f73-fd0cbbf0d269 req-9261ce59-dbe9-4ee3-af71-5b3a22890704 service nova] Acquiring lock "c0994bac-3b43-414e-aa81-a9d7198775a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f785978a-4100-4ad9-9f73-fd0cbbf0d269 req-9261ce59-dbe9-4ee3-af71-5b3a22890704 service nova] Lock "c0994bac-3b43-414e-aa81-a9d7198775a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f785978a-4100-4ad9-9f73-fd0cbbf0d269 req-9261ce59-dbe9-4ee3-af71-5b3a22890704 service nova] Lock "c0994bac-3b43-414e-aa81-a9d7198775a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:32 user nova-compute[73484]: DEBUG nova.compute.manager [req-f785978a-4100-4ad9-9f73-fd0cbbf0d269 req-9261ce59-dbe9-4ee3-af71-5b3a22890704 service nova] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] No waiting events found dispatching network-vif-plugged-67b5678c-ab81-4b84-86cc-c882ff19b949 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:45:32 user nova-compute[73484]: WARNING nova.compute.manager [req-f785978a-4100-4ad9-9f73-fd0cbbf0d269 req-9261ce59-dbe9-4ee3-af71-5b3a22890704 service nova] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Received unexpected event network-vif-plugged-67b5678c-ab81-4b84-86cc-c882ff19b949 for instance with vm_state building and task_state spawning.
Aug 14 13:45:32 user nova-compute[73484]: DEBUG nova.compute.manager [req-f785978a-4100-4ad9-9f73-fd0cbbf0d269 req-9261ce59-dbe9-4ee3-af71-5b3a22890704 service nova] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Received event network-vif-plugged-be08ca28-6a00-468c-9988-87185f498ca3 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:45:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f785978a-4100-4ad9-9f73-fd0cbbf0d269 req-9261ce59-dbe9-4ee3-af71-5b3a22890704 service nova] Acquiring lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f785978a-4100-4ad9-9f73-fd0cbbf0d269 req-9261ce59-dbe9-4ee3-af71-5b3a22890704 service nova] Lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f785978a-4100-4ad9-9f73-fd0cbbf0d269 req-9261ce59-dbe9-4ee3-af71-5b3a22890704 service nova] Lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:32 user nova-compute[73484]: DEBUG nova.compute.manager [req-f785978a-4100-4ad9-9f73-fd0cbbf0d269 req-9261ce59-dbe9-4ee3-af71-5b3a22890704 service nova] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] No waiting events found dispatching network-vif-plugged-be08ca28-6a00-468c-9988-87185f498ca3 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:45:32 user nova-compute[73484]: WARNING nova.compute.manager [req-f785978a-4100-4ad9-9f73-fd0cbbf0d269 req-9261ce59-dbe9-4ee3-af71-5b3a22890704 service nova] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Received unexpected event network-vif-plugged-be08ca28-6a00-468c-9988-87185f498ca3 for instance with vm_state building and task_state spawning.
Aug 14 13:45:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020733.4248064, 782c6142-757a-49ae-9292-787a7f1e8a23 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:45:33 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] VM Resumed (Lifecycle Event)
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:45:33 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Instance spawned successfully.
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:45:33 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020733.4265141, 782c6142-757a-49ae-9292-787a7f1e8a23 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:45:33 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] VM Started (Lifecycle Event)
Aug 14 13:45:33 user nova-compute[73484]: INFO nova.compute.manager [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Took 9.18 seconds to spawn the instance on the hypervisor.
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:45:33 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:45:33 user nova-compute[73484]: INFO nova.compute.manager [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Took 10.45 seconds to build instance.
Aug 14 13:45:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0dce5fcc-fec9-4a86-b933-7ae962b78fa7 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "782c6142-757a-49ae-9292-787a7f1e8a23" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.619s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020733.8143766, c0994bac-3b43-414e-aa81-a9d7198775a6 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:45:33 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] VM Resumed (Lifecycle Event)
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.compute.manager [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:45:33 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Instance spawned successfully.
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:45:33 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020733.8206105, c0994bac-3b43-414e-aa81-a9d7198775a6 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:45:33 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] VM Started (Lifecycle Event)
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.compute.manager [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:45:33 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Instance spawned successfully.
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:45:33 user nova-compute[73484]: INFO nova.compute.manager [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Took 10.40 seconds to spawn the instance on the hypervisor.
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.compute.manager [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:45:33 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:45:33 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020733.9437642, 03255d24-b6fd-459c-8ac6-f9c4063b54b2 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:45:33 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] VM Resumed (Lifecycle Event)
Aug 14 13:45:34 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:45:34 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:45:34 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:45:34 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:45:34 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:45:34 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:45:34 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:45:34 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:45:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:34 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:45:34 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020733.944706, 03255d24-b6fd-459c-8ac6-f9c4063b54b2 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:45:34 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] VM Started (Lifecycle Event)
Aug 14 13:45:34 user nova-compute[73484]: INFO nova.compute.manager [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Took 11.51 seconds to build instance.
Aug 14 13:45:34 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:45:34 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:45:34 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:45:34 user nova-compute[73484]: DEBUG nova.compute.manager [req-bf88d99b-20f2-4fdf-b3ec-e7fd1b4e2411 req-bbdca45a-899f-4274-9a71-6ed506d09ad9 service nova] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Received event network-vif-plugged-be08ca28-6a00-468c-9988-87185f498ca3 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:45:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-bf88d99b-20f2-4fdf-b3ec-e7fd1b4e2411 req-bbdca45a-899f-4274-9a71-6ed506d09ad9 service nova] Acquiring lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-bf88d99b-20f2-4fdf-b3ec-e7fd1b4e2411 req-bbdca45a-899f-4274-9a71-6ed506d09ad9 service nova] Lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-bf88d99b-20f2-4fdf-b3ec-e7fd1b4e2411 req-bbdca45a-899f-4274-9a71-6ed506d09ad9 service nova] Lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:34 user nova-compute[73484]: DEBUG nova.compute.manager [req-bf88d99b-20f2-4fdf-b3ec-e7fd1b4e2411 req-bbdca45a-899f-4274-9a71-6ed506d09ad9 service nova] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] No waiting events found dispatching network-vif-plugged-be08ca28-6a00-468c-9988-87185f498ca3 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:45:34 user nova-compute[73484]: WARNING nova.compute.manager [req-bf88d99b-20f2-4fdf-b3ec-e7fd1b4e2411 req-bbdca45a-899f-4274-9a71-6ed506d09ad9 service nova] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Received unexpected event network-vif-plugged-be08ca28-6a00-468c-9988-87185f498ca3 for instance with vm_state building and task_state spawning.
Aug 14 13:45:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-641974fd-9803-4666-9da5-96f8e2bc5dcf tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "c0994bac-3b43-414e-aa81-a9d7198775a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.663s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:34 user nova-compute[73484]: INFO nova.compute.manager [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Took 8.81 seconds to spawn the instance on the hypervisor.
Aug 14 13:45:34 user nova-compute[73484]: DEBUG nova.compute.manager [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:45:34 user nova-compute[73484]: INFO nova.compute.manager [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Took 10.20 seconds to build instance.
Aug 14 13:45:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-757e871e-c794-4549-b2db-dbbc58f60048 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.356s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dVvQMnZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:45:35 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:45:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:45:35 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:45:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:45:35 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:45:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[136ad345-64cb-45a5-9994-aa51c42f86c6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:45:35 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8410d2ad-2e28-4a4f-b520-ac86c691256c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d] added
Aug 14 13:45:35 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce81da5-52af-4941-beb3-af08a24d5bb9]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1253a11e-19a5-4c06-b8f2-298ce3f274ce]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dVvQMnZJ {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dVvQMnZJ" returned: 0 in 0.041s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[616073d6-6df8-4824-be49-0ae90c309ba4]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dVvQMnZJ'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05e16d0-ef89-4411-aa78-df86f9ff49cb]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[05eeaab1-9d53-45df-a046-97ae34194115]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:45:35 user nova-compute[73484]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:45:35 user nova-compute[73484]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb (non-flash)
Aug 14 13:45:35 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:45:35 user nova-compute[73484]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:45:35 user nova-compute[73484]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb (non-flash)
Aug 14 13:45:35 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0ada10-4388-4ee8-a110-879022a2a353]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d, portal: 172.16.0.220,3260]
Aug 14 13:45:35 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d, portal: 172.16.0.220,3260] successful.
Aug 14 13:45:35 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c73b97e-a96b-497d-b764-8d8b3ddc3090]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:45:35 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce46aec-50fe-4553-afc1-0c00cf2771a7]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:45:36 user nova-compute[73484]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:45:36 user nova-compute[73484]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb (non-flash)
Aug 14 13:45:36 user nova-compute[73484]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d (non-flash)
Aug 14 13:45:36 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:45:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:45:36 user nova-compute[73484]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:45:36 user nova-compute[73484]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb (non-flash)
Aug 14 13:45:36 user nova-compute[73484]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d (non-flash)
Aug 14 13:45:36 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:45:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.407s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:45:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:45:36 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:45:36 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:45:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.031s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b135e13-0389-4b0a-9a6c-4273d1472756]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:36 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:45:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dVvQMnZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:45:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.499s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:45:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] <== connect_volume: return (1501ms) {'type': 'block', 'scsi_wwn': '26465646534326132', 'path': '/dev/sdd'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:45:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465646534326132', 'path': '/dev/sdd'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:45:37 user nova-compute[73484]: DEBUG nova.objects.instance [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lazy-loading 'flavor' on Instance uuid 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:45:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 13:45:37 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:45:37 user nova-compute[73484]:   <source dev="/dev/sdd"/>
Aug 14 13:45:37 user nova-compute[73484]:   <target dev="vdc" bus="virtio"/>
Aug 14 13:45:37 user nova-compute[73484]:   <serial>916bbf66-dbba-4a8c-9d8f-0b2e7448339d</serial>
Aug 14 13:45:37 user nova-compute[73484]: </disk>
Aug 14 13:45:37 user nova-compute[73484]:  {{(pid=73484) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 13:45:37 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:45:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:45:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:45:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:45:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] No VIF found with MAC fa:16:3e:69:48:02, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:45:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-812d8344-62ca-4a2c-b979-8bd84652a862 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.318s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Acquiring lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:38 user nova-compute[73484]: INFO nova.compute.manager [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Detaching volume 916bbf66-dbba-4a8c-9d8f-0b2e7448339d
Aug 14 13:45:38 user nova-compute[73484]: INFO nova.virt.block_device [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Attempting to driver detach volume 916bbf66-dbba-4a8c-9d8f-0b2e7448339d from mountpoint /dev/vdc
Aug 14 13:45:38 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Attempting to detach device vdc from instance 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f from the persistent domain config. {{(pid=73484) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 13:45:38 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:45:38 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:45:38 user nova-compute[73484]:   <source dev="/dev/sdd"/>
Aug 14 13:45:38 user nova-compute[73484]:   <target dev="vdc" bus="virtio"/>
Aug 14 13:45:38 user nova-compute[73484]:   <serial>916bbf66-dbba-4a8c-9d8f-0b2e7448339d</serial>
Aug 14 13:45:38 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 13:45:38 user nova-compute[73484]: </disk>
Aug 14 13:45:38 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:45:38 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Successfully detached device vdc from instance 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f from the persistent domain config.
Aug 14 13:45:38 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f from the live domain config. {{(pid=73484) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 13:45:38 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:45:38 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:45:38 user nova-compute[73484]:   <source dev="/dev/sdd"/>
Aug 14 13:45:38 user nova-compute[73484]:   <target dev="vdc" bus="virtio"/>
Aug 14 13:45:38 user nova-compute[73484]:   <serial>916bbf66-dbba-4a8c-9d8f-0b2e7448339d</serial>
Aug 14 13:45:38 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 13:45:38 user nova-compute[73484]: </disk>
Aug 14 13:45:38 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:45:38 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:45:38 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:45:38 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-eaaccbea-d453-4943-9663-949c66029d87" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-eaaccbea-d453-4943-9663-949c66029d87" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: eaaccbea-d453-4943-9663-949c66029d87] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Received event <DeviceRemovedEvent: 1692020739.2644022, 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73484) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f {{(pid=73484) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 13:45:39 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Successfully detached device vdc from instance 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f from the live domain config.
Aug 14 13:45:39 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dVvQMnZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:45:39 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:45:39 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[675e19d1-235e-4b42-a5d3-77f7f8cb155e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5b410d-b175-4d43-80d3-a750f3e6da6e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:45:39 user nova-compute[73484]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:45:39 user nova-compute[73484]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb (non-flash)
Aug 14 13:45:39 user nova-compute[73484]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d (non-flash)
Aug 14 13:45:39 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:45:39 user nova-compute[73484]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:45:39 user nova-compute[73484]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb (non-flash)
Aug 14 13:45:39 user nova-compute[73484]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d (non-flash)
Aug 14 13:45:39 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4586ce290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d'): ({'sdd'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Removing single pathed devices sdd {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f48ac6-a2cf-48d3-81e5-8dddcafd9e15]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.030s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c60870-d573-49ec-8ebf-c4ae4a2f876a]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Flushing IO for device /dev/sdd {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b05a87-7846-42e9-8b96-bd6e52c9ca05]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca1b7e7-45f2-4c2a-96fb-e1f49ee8dcc5]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] SCSI volumes sdd have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[56721ccf-3691-4442-b7fc-c48a8622404a]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2402b32-83d0-4695-8458-48198e04bb23]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d, portal: 172.16.0.220,3260]
Aug 14 13:45:39 user nova-compute[73484]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d, portal: 172.16.0.220,3260] successful.
Aug 14 13:45:39 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916bbf66-dbba-4a8c-9d8f-0b2e7448339d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fce60ff-5241-4dd8-828c-f79336cb1f17]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] <== disconnect_volume: return (373ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: eaaccbea-d453-4943-9663-949c66029d87] Updating instance_info_cache with network_info: [{"id": "244b7f94-a32e-4724-858e-ae9be93a8003", "address": "fa:16:3e:4e:e1:a7", "network": {"id": "6480ad45-783a-4c79-adac-e661111d3cc8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1304007088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01c04593677842fc9bed43bb42776176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244b7f94-a3", "ovs_interfaceid": "244b7f94-a32e-4724-858e-ae9be93a8003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-eaaccbea-d453-4943-9663-949c66029d87" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: eaaccbea-d453-4943-9663-949c66029d87] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:39 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 13:45:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:45:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:45:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eed5f58-f09b-419a-ba10-7b1dd6f27f7f/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eed5f58-f09b-419a-ba10-7b1dd6f27f7f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eed5f58-f09b-419a-ba10-7b1dd6f27f7f/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "ed239af5-980e-42d3-8ebd-ca100ccb2708" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "ed239af5-980e-42d3-8ebd-ca100ccb2708" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:44 user nova-compute[73484]: INFO nova.compute.manager [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Detaching volume ed64de01-c957-421a-9664-569069202f9b
Aug 14 13:45:44 user nova-compute[73484]: INFO nova.virt.block_device [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Attempting to driver detach volume ed64de01-c957-421a-9664-569069202f9b from mountpoint /dev/vdb
Aug 14 13:45:44 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Attempting to detach device vdb from instance ed239af5-980e-42d3-8ebd-ca100ccb2708 from the persistent domain config. {{(pid=73484) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 13:45:44 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:45:44 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:45:44 user nova-compute[73484]:   <source dev="/dev/sdg"/>
Aug 14 13:45:44 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:45:44 user nova-compute[73484]:   <serial>ed64de01-c957-421a-9664-569069202f9b</serial>
Aug 14 13:45:44 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 13:45:44 user nova-compute[73484]: </disk>
Aug 14 13:45:44 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:45:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eed5f58-f09b-419a-ba10-7b1dd6f27f7f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:44 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:45:44 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Successfully detached device vdb from instance ed239af5-980e-42d3-8ebd-ca100ccb2708 from the persistent domain config.
Aug 14 13:45:44 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ed239af5-980e-42d3-8ebd-ca100ccb2708 from the live domain config. {{(pid=73484) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 13:45:44 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:45:44 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:45:44 user nova-compute[73484]:   <source dev="/dev/sdg"/>
Aug 14 13:45:44 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:45:44 user nova-compute[73484]:   <serial>ed64de01-c957-421a-9664-569069202f9b</serial>
Aug 14 13:45:44 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 13:45:44 user nova-compute[73484]: </disk>
Aug 14 13:45:44 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:45:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:44 user nova-compute[73484]: DEBUG nova.objects.instance [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lazy-loading 'pci_requests' on Instance uuid 8220a084-e402-435a-b6a7-ffd94f91a211 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:45:44 user nova-compute[73484]: DEBUG nova.objects.instance [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lazy-loading 'numa_topology' on Instance uuid 8220a084-e402-435a-b6a7-ffd94f91a211 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:45:44 user nova-compute[73484]: DEBUG nova.objects.instance [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lazy-loading 'flavor' on Instance uuid 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:45:44 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:45:44 user nova-compute[73484]: INFO nova.compute.claims [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Claim successful on node user
Aug 14 13:45:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7dff72c1-2037-48d8-aea7-b79b5368cd15 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.794s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Received event <DeviceRemovedEvent: 1692020744.7833662, ed239af5-980e-42d3-8ebd-ca100ccb2708 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73484) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ed239af5-980e-42d3-8ebd-ca100ccb2708 {{(pid=73484) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 13:45:45 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Successfully detached device vdb from instance ed239af5-980e-42d3-8ebd-ca100ccb2708 from the live domain config.
Aug 14 13:45:45 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNEtDAag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:45:45 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:45:45 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:45:45 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:45:45 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:45:45 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=7458MB free_disk=25.442638397216797GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b262363e-d749-43e8-a2db-5ab540148910]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[400995da-4302-47ca-83c9-d84f2b4a5463]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:45:45 user nova-compute[73484]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:45:45 user nova-compute[73484]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb (non-flash)
Aug 14 13:45:45 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:45:45 user nova-compute[73484]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b (non-flash)
Aug 14 13:45:45 user nova-compute[73484]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb (non-flash)
Aug 14 13:45:45 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc458499240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b'): ({'sdg'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Removing single pathed devices sdg {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe711503-8561-4aaf-b7b6-8059e982a4f7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6e3bf1-f4fc-4c73-89fe-79a105cd42f2]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Flushing IO for device /dev/sdg {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56c74e4-9018-4da1-8fc3-bc6cdc74ee3a]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[200f3d78-96e1-4074-9901-e144e2ea837e]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] SCSI volumes sdg have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[126339a2-6400-43e4-8a6f-5d06ec8fcf47]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc77d56-586b-47a6-9a5e-c9c7521e980d]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b, portal: 172.16.0.220,3260]
Aug 14 13:45:45 user nova-compute[73484]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b, portal: 172.16.0.220,3260] successful.
Aug 14 13:45:45 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.348s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed64de01-c957-421a-9664-569069202f9b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b42df7-0f36-4b00-b53e-4e363b99e41f]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.330s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] <== disconnect_volume: return (340ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:45:45 user nova-compute[73484]: INFO nova.network.neutron [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Updating port 3ef63421-a4aa-4126-b8ee-c141b2ef10cb with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance f4f7788c-fcca-47c1-b5b8-72892253982d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 07bac569-8b2c-4555-b4d5-a74f7384630b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance eaaccbea-d453-4943-9663-949c66029d87 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance a9d4ec42-3db9-439b-87a7-02bcaab514a4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance ed239af5-980e-42d3-8ebd-ca100ccb2708 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance bd43e3a9-0413-4e55-b6a1-7f3f792ba872 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 09ba29fd-8161-485c-ba6d-71d24ab086bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance c0994bac-3b43-414e-aa81-a9d7198775a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (165d4635-93b4-49a6-879a-21c1324822ab): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 782c6142-757a-49ae-9292-787a7f1e8a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 03255d24-b6fd-459c-8ac6-f9c4063b54b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 13:45:45 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 13:45:46 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:45:46 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:45:46 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 13:45:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.758s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:46 user nova-compute[73484]: DEBUG nova.objects.instance [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lazy-loading 'flavor' on Instance uuid ed239af5-980e-42d3-8ebd-ca100ccb2708 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:45:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e2911689-0459-4ef1-aa84-67e18865ace6 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "ed239af5-980e-42d3-8ebd-ca100ccb2708" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.590s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "refresh_cache-8220a084-e402-435a-b6a7-ffd94f91a211" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:45:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquired lock "refresh_cache-8220a084-e402-435a-b6a7-ffd94f91a211" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:45:46 user nova-compute[73484]: DEBUG nova.network.neutron [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:45:46 user nova-compute[73484]: DEBUG nova.compute.manager [req-e2cfd4f0-0d5f-4dcb-af20-6345f8edfefe req-d8552066-5832-4c75-858f-81ac4a796c93 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Received event network-changed-3ef63421-a4aa-4126-b8ee-c141b2ef10cb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:45:46 user nova-compute[73484]: DEBUG nova.compute.manager [req-e2cfd4f0-0d5f-4dcb-af20-6345f8edfefe req-d8552066-5832-4c75-858f-81ac4a796c93 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Refreshing instance network info cache due to event network-changed-3ef63421-a4aa-4126-b8ee-c141b2ef10cb. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:45:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e2cfd4f0-0d5f-4dcb-af20-6345f8edfefe req-d8552066-5832-4c75-858f-81ac4a796c93 service nova] Acquiring lock "refresh_cache-8220a084-e402-435a-b6a7-ffd94f91a211" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:45:48 user nova-compute[73484]: DEBUG nova.network.neutron [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Updating instance_info_cache with network_info: [{"id": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "address": "fa:16:3e:ca:70:43", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef63421-a4", "ovs_interfaceid": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:45:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Releasing lock "refresh_cache-8220a084-e402-435a-b6a7-ffd94f91a211" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:45:48 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:45:48 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Creating image(s)
Aug 14 13:45:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "/opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "/opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "/opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:48 user nova-compute[73484]: DEBUG nova.objects.instance [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8220a084-e402-435a-b6a7-ffd94f91a211 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:45:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e2cfd4f0-0d5f-4dcb-af20-6345f8edfefe req-d8552066-5832-4c75-858f-81ac4a796c93 service nova] Acquired lock "refresh_cache-8220a084-e402-435a-b6a7-ffd94f91a211" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:45:48 user nova-compute[73484]: DEBUG nova.network.neutron [req-e2cfd4f0-0d5f-4dcb-af20-6345f8edfefe req-d8552066-5832-4c75-858f-81ac4a796c93 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Refreshing network info cache for port 3ef63421-a4aa-4126-b8ee-c141b2ef10cb {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:45:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "17afa22e85a871169821695134408dbb30165d14" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "17afa22e85a871169821695134408dbb30165d14" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:48 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:45:48 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:45:48 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:45:48 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:45:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17afa22e85a871169821695134408dbb30165d14.part --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17afa22e85a871169821695134408dbb30165d14.part --force-share --output=json" returned: 0 in 0.208s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:49 user nova-compute[73484]: DEBUG nova.virt.images [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] 8d2c5d93-4597-4780-a862-ce810eb495fd was qcow2, converting to raw {{(pid=73484) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 13:45:49 user nova-compute[73484]: DEBUG nova.privsep.utils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73484) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 13:45:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/17afa22e85a871169821695134408dbb30165d14.part /opt/stack/data/nova/instances/_base/17afa22e85a871169821695134408dbb30165d14.converted {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:49 user nova-compute[73484]: DEBUG nova.network.neutron [req-e2cfd4f0-0d5f-4dcb-af20-6345f8edfefe req-d8552066-5832-4c75-858f-81ac4a796c93 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Updated VIF entry in instance network info cache for port 3ef63421-a4aa-4126-b8ee-c141b2ef10cb. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:45:49 user nova-compute[73484]: DEBUG nova.network.neutron [req-e2cfd4f0-0d5f-4dcb-af20-6345f8edfefe req-d8552066-5832-4c75-858f-81ac4a796c93 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Updating instance_info_cache with network_info: [{"id": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "address": "fa:16:3e:ca:70:43", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef63421-a4", "ovs_interfaceid": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:45:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e2cfd4f0-0d5f-4dcb-af20-6345f8edfefe req-d8552066-5832-4c75-858f-81ac4a796c93 service nova] Releasing lock "refresh_cache-8220a084-e402-435a-b6a7-ffd94f91a211" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:45:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/17afa22e85a871169821695134408dbb30165d14.part /opt/stack/data/nova/instances/_base/17afa22e85a871169821695134408dbb30165d14.converted" returned: 0 in 0.762s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17afa22e85a871169821695134408dbb30165d14.converted --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17afa22e85a871169821695134408dbb30165d14.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "17afa22e85a871169821695134408dbb30165d14" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.338s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17afa22e85a871169821695134408dbb30165d14 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17afa22e85a871169821695134408dbb30165d14 --force-share --output=json" returned: 0 in 0.180s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "17afa22e85a871169821695134408dbb30165d14" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "17afa22e85a871169821695134408dbb30165d14" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17afa22e85a871169821695134408dbb30165d14 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17afa22e85a871169821695134408dbb30165d14 --force-share --output=json" returned: 0 in 0.191s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/17afa22e85a871169821695134408dbb30165d14,backing_fmt=raw /opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/17afa22e85a871169821695134408dbb30165d14,backing_fmt=raw /opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk 1073741824" returned: 0 in 0.054s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "17afa22e85a871169821695134408dbb30165d14" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17afa22e85a871169821695134408dbb30165d14 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/17afa22e85a871169821695134408dbb30165d14 --force-share --output=json" returned: 0 in 0.193s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:51 user nova-compute[73484]: DEBUG nova.objects.instance [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lazy-loading 'migration_context' on Instance uuid 8220a084-e402-435a-b6a7-ffd94f91a211 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:45:51 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Rebasing disk image.
Aug 14 13:45:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.189s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 -F raw /opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 -F raw /opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk" returned: 0 in 2.441s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:53 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:45:53 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Ensure instance console log exists: /opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:45:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:53 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Start _get_guest_xml network_info=[{"id": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "address": "fa:16:3e:ca:70:43", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef63421-a4", "ovs_interfaceid": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='037cdbea5addb040ac3acb10da39b3ca',container_format='bare',created_at=2023-08-14T13:43:29Z,direct_url=<?>,disk_format='qcow2',id=8d2c5d93-4597-4780-a862-ce810eb495fd,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1500691485-shelved',owner='0c1ccc7c1aaf497da5f1d325d79e9301',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T13:43:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3043d6a8-3ff8-489d-9827-71fa6ceffde9', 'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XUJiMsDI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '8220a084-e402-435a-b6a7-ffd94f91a211', 'attached_at': '', 'detached_at': '', 'volume_id': 'e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c', 'serial': 'e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:45:54 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:45:54 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:45:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='037cdbea5addb040ac3acb10da39b3ca',container_format='bare',created_at=2023-08-14T13:43:29Z,direct_url=<?>,disk_format='qcow2',id=8d2c5d93-4597-4780-a862-ce810eb495fd,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1500691485-shelved',owner='0c1ccc7c1aaf497da5f1d325d79e9301',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T13:43:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG nova.objects.instance [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8220a084-e402-435a-b6a7-ffd94f91a211 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XUJiMsDI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:45:54 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:45:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:45:54 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:45:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:45:54 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:45:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c -p 172.16.0.220:3260" returned: 21 in 0.042s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f8a686-c84d-4258-a68e-9b3cb17d13ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:45:54 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f90abed-6f11-4f3f-97b0-2b0fe5592874]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c] added
Aug 14 13:45:54 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba467dd6-fb13-4640-8f0c-626ca99c4043]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9519c8-b670-4979-a858-a271adbed6a3]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XUJiMsDI {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XUJiMsDI" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95e30c4-593d-432f-a4de-bc75d8368c69]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XUJiMsDI'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6406eed-ffaa-4a9f-a266-e2833b6af0df]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc771deb-35b4-48e5-bcc0-5e594bed3a10]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:45:54 user nova-compute[73484]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb (non-flash)
Aug 14 13:45:54 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:45:54 user nova-compute[73484]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb (non-flash)
Aug 14 13:45:54 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc24d7e1-39eb-4c6a-9c57-bc5f456f7ea4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c, portal: 172.16.0.220,3260]
Aug 14 13:45:54 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c, portal: 172.16.0.220,3260] successful.
Aug 14 13:45:54 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c0f899-ac18-4806-a48d-890c0ba3f7ef]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa39c1c-7994-4cfe-9834-5aa19d94b40f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:45:54 user nova-compute[73484]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb (non-flash)
Aug 14 13:45:54 user nova-compute[73484]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c (non-flash)
Aug 14 13:45:54 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:45:54 user nova-compute[73484]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb (non-flash)
Aug 14 13:45:54 user nova-compute[73484]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c (non-flash)
Aug 14 13:45:54 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13e2574-5407-4da6-8959-13f10f740af9]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:45:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XUJiMsDI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:45:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:45:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23565646462326361', 'path': '/dev/sdd'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:45:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565646462326361', 'path': '/dev/sdd'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:45:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T13:41:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1500691485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1500691485',id=17,image_ref='8d2c5d93-4597-4780-a862-ce810eb495fd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1575579439',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:41:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0c1ccc7c1aaf497da5f1d325d79e9301',ramdisk_id='',reservation_id='r-j80xfzw1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1730232968',owner_user_name='tempest-AttachVolumeShelveTestJSON-1730232968-project-member',shelved_at='2023-08-14T13:43:34.697198',shelved_host='user',shelved_image_id='8d2c5d93-4597-4780-a862-ce810eb495fd'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:45:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bda36df8b1f64c7894bfee5da258c1e6',uuid=8220a084-e402-435a-b6a7-ffd94f91a211,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "address": "fa:16:3e:ca:70:43", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef63421-a4", "ovs_interfaceid": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:45:55 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Converting VIF {"id": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "address": "fa:16:3e:ca:70:43", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef63421-a4", "ovs_interfaceid": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:45:55 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:70:43,bridge_name='br-int',has_traffic_filtering=True,id=3ef63421-a4aa-4126-b8ee-c141b2ef10cb,network=Network(cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ef63421-a4') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:45:55 user nova-compute[73484]: DEBUG nova.objects.instance [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lazy-loading 'pci_devices' on Instance uuid 8220a084-e402-435a-b6a7-ffd94f91a211 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:45:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:45:55 user nova-compute[73484]:   <uuid>8220a084-e402-435a-b6a7-ffd94f91a211</uuid>
Aug 14 13:45:55 user nova-compute[73484]:   <name>instance-00000011</name>
Aug 14 13:45:55 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:45:55 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:45:55 user nova-compute[73484]:   <metadata>
Aug 14 13:45:55 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:45:55 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:45:55 user nova-compute[73484]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1500691485</nova:name>
Aug 14 13:45:55 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:45:54</nova:creationTime>
Aug 14 13:45:55 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:45:55 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:45:55 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:45:55 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:45:55 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:45:55 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:45:55 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:45:55 user nova-compute[73484]:       <nova:owner>
Aug 14 13:45:55 user nova-compute[73484]:         <nova:user uuid="bda36df8b1f64c7894bfee5da258c1e6">tempest-AttachVolumeShelveTestJSON-1730232968-project-member</nova:user>
Aug 14 13:45:55 user nova-compute[73484]:         <nova:project uuid="0c1ccc7c1aaf497da5f1d325d79e9301">tempest-AttachVolumeShelveTestJSON-1730232968</nova:project>
Aug 14 13:45:55 user nova-compute[73484]:       </nova:owner>
Aug 14 13:45:55 user nova-compute[73484]:       <nova:root type="image" uuid="8d2c5d93-4597-4780-a862-ce810eb495fd"/>
Aug 14 13:45:55 user nova-compute[73484]:       <nova:ports>
Aug 14 13:45:55 user nova-compute[73484]:         <nova:port uuid="3ef63421-a4aa-4126-b8ee-c141b2ef10cb">
Aug 14 13:45:55 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 13:45:55 user nova-compute[73484]:         </nova:port>
Aug 14 13:45:55 user nova-compute[73484]:       </nova:ports>
Aug 14 13:45:55 user nova-compute[73484]:     </nova:instance>
Aug 14 13:45:55 user nova-compute[73484]:   </metadata>
Aug 14 13:45:55 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:45:55 user nova-compute[73484]:     <system>
Aug 14 13:45:55 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:45:55 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:45:55 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:45:55 user nova-compute[73484]:       <entry name="serial">8220a084-e402-435a-b6a7-ffd94f91a211</entry>
Aug 14 13:45:55 user nova-compute[73484]:       <entry name="uuid">8220a084-e402-435a-b6a7-ffd94f91a211</entry>
Aug 14 13:45:55 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:45:55 user nova-compute[73484]:     </system>
Aug 14 13:45:55 user nova-compute[73484]:   </sysinfo>
Aug 14 13:45:55 user nova-compute[73484]:   <os>
Aug 14 13:45:55 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:45:55 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:45:55 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:45:55 user nova-compute[73484]:   </os>
Aug 14 13:45:55 user nova-compute[73484]:   <features>
Aug 14 13:45:55 user nova-compute[73484]:     <acpi/>
Aug 14 13:45:55 user nova-compute[73484]:     <apic/>
Aug 14 13:45:55 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:45:55 user nova-compute[73484]:   </features>
Aug 14 13:45:55 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:45:55 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:45:55 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:45:55 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:45:55 user nova-compute[73484]:   </clock>
Aug 14 13:45:55 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:45:55 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:45:55 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:45:55 user nova-compute[73484]:   </cpu>
Aug 14 13:45:55 user nova-compute[73484]:   <devices>
Aug 14 13:45:55 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:45:55 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:45:55 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk"/>
Aug 14 13:45:55 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:45:55 user nova-compute[73484]:     </disk>
Aug 14 13:45:55 user nova-compute[73484]:     <disk type="block" device="disk">
Aug 14 13:45:55 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:45:55 user nova-compute[73484]:       <source dev="/dev/sdd"/>
Aug 14 13:45:55 user nova-compute[73484]:       <target dev="vdc" bus="virtio"/>
Aug 14 13:45:55 user nova-compute[73484]:       <serial>e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c</serial>
Aug 14 13:45:55 user nova-compute[73484]:     </disk>
Aug 14 13:45:55 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:45:55 user nova-compute[73484]:       <mac address="fa:16:3e:ca:70:43"/>
Aug 14 13:45:55 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:45:55 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:45:55 user nova-compute[73484]:       <target dev="tap3ef63421-a4"/>
Aug 14 13:45:55 user nova-compute[73484]:     </interface>
Aug 14 13:45:55 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:45:55 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/console.log" append="off"/>
Aug 14 13:45:55 user nova-compute[73484]:     </serial>
Aug 14 13:45:55 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:45:55 user nova-compute[73484]:     <video>
Aug 14 13:45:55 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:45:55 user nova-compute[73484]:     </video>
Aug 14 13:45:55 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:45:55 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:45:55 user nova-compute[73484]:     </rng>
Aug 14 13:45:55 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:45:55 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:45:55 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:45:55 user nova-compute[73484]:     </memballoon>
Aug 14 13:45:55 user nova-compute[73484]:   </devices>
Aug 14 13:45:55 user nova-compute[73484]: </domain>
Aug 14 13:45:55 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:45:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T13:41:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1500691485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1500691485',id=17,image_ref='8d2c5d93-4597-4780-a862-ce810eb495fd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1575579439',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:41:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0c1ccc7c1aaf497da5f1d325d79e9301',ramdisk_id='',reservation_id='r-j80xfzw1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1730232968',owner_user_name='tempest-AttachVolumeShelveTestJSON-1730232968-project-member',shelved_at='2023-08-14T13:43:34.697198',shelved_host='user',shelved_image_id='8d2c5d93-4597-4780-a862-ce810eb495fd'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:45:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bda36df8b1f64c7894bfee5da258c1e6',uuid=8220a084-e402-435a-b6a7-ffd94f91a211,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "address": "fa:16:3e:ca:70:43", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef63421-a4", "ovs_interfaceid": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:45:55 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Converting VIF {"id": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "address": "fa:16:3e:ca:70:43", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef63421-a4", "ovs_interfaceid": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:45:55 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:70:43,bridge_name='br-int',has_traffic_filtering=True,id=3ef63421-a4aa-4126-b8ee-c141b2ef10cb,network=Network(cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ef63421-a4') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:45:55 user nova-compute[73484]: DEBUG os_vif [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:70:43,bridge_name='br-int',has_traffic_filtering=True,id=3ef63421-a4aa-4126-b8ee-c141b2ef10cb,network=Network(cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ef63421-a4') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:45:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:45:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:45:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ef63421-a4, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:45:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3ef63421-a4, col_values=(('external_ids', {'iface-id': '3ef63421-a4aa-4126-b8ee-c141b2ef10cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:70:43', 'vm-uuid': '8220a084-e402-435a-b6a7-ffd94f91a211'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:45:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:45:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:55 user nova-compute[73484]: INFO os_vif [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:70:43,bridge_name='br-int',has_traffic_filtering=True,id=3ef63421-a4aa-4126-b8ee-c141b2ef10cb,network=Network(cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ef63421-a4')
Aug 14 13:45:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:45:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:45:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] No VIF found with MAC fa:16:3e:ca:70:43, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:45:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:57 user nova-compute[73484]: DEBUG nova.compute.manager [req-4b53cb30-8a37-4651-94e4-911140104c18 req-2e1d8c21-03b3-48b1-a7fb-7b96bf2f0dfe service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Received event network-vif-plugged-3ef63421-a4aa-4126-b8ee-c141b2ef10cb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:45:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4b53cb30-8a37-4651-94e4-911140104c18 req-2e1d8c21-03b3-48b1-a7fb-7b96bf2f0dfe service nova] Acquiring lock "8220a084-e402-435a-b6a7-ffd94f91a211-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4b53cb30-8a37-4651-94e4-911140104c18 req-2e1d8c21-03b3-48b1-a7fb-7b96bf2f0dfe service nova] Lock "8220a084-e402-435a-b6a7-ffd94f91a211-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4b53cb30-8a37-4651-94e4-911140104c18 req-2e1d8c21-03b3-48b1-a7fb-7b96bf2f0dfe service nova] Lock "8220a084-e402-435a-b6a7-ffd94f91a211-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:57 user nova-compute[73484]: DEBUG nova.compute.manager [req-4b53cb30-8a37-4651-94e4-911140104c18 req-2e1d8c21-03b3-48b1-a7fb-7b96bf2f0dfe service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] No waiting events found dispatching network-vif-plugged-3ef63421-a4aa-4126-b8ee-c141b2ef10cb {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:45:57 user nova-compute[73484]: WARNING nova.compute.manager [req-4b53cb30-8a37-4651-94e4-911140104c18 req-2e1d8c21-03b3-48b1-a7fb-7b96bf2f0dfe service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Received unexpected event network-vif-plugged-3ef63421-a4aa-4126-b8ee-c141b2ef10cb for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 13:45:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:45:59 user nova-compute[73484]: DEBUG nova.compute.manager [req-2121dd5d-aed3-4c07-b530-e3c464ba3596 req-e3d71721-d40a-475d-be64-60e0673686f4 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Received event network-vif-plugged-3ef63421-a4aa-4126-b8ee-c141b2ef10cb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:45:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2121dd5d-aed3-4c07-b530-e3c464ba3596 req-e3d71721-d40a-475d-be64-60e0673686f4 service nova] Acquiring lock "8220a084-e402-435a-b6a7-ffd94f91a211-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:45:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2121dd5d-aed3-4c07-b530-e3c464ba3596 req-e3d71721-d40a-475d-be64-60e0673686f4 service nova] Lock "8220a084-e402-435a-b6a7-ffd94f91a211-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:45:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2121dd5d-aed3-4c07-b530-e3c464ba3596 req-e3d71721-d40a-475d-be64-60e0673686f4 service nova] Lock "8220a084-e402-435a-b6a7-ffd94f91a211-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:45:59 user nova-compute[73484]: DEBUG nova.compute.manager [req-2121dd5d-aed3-4c07-b530-e3c464ba3596 req-e3d71721-d40a-475d-be64-60e0673686f4 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] No waiting events found dispatching network-vif-plugged-3ef63421-a4aa-4126-b8ee-c141b2ef10cb {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:45:59 user nova-compute[73484]: WARNING nova.compute.manager [req-2121dd5d-aed3-4c07-b530-e3c464ba3596 req-e3d71721-d40a-475d-be64-60e0673686f4 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Received unexpected event network-vif-plugged-3ef63421-a4aa-4126-b8ee-c141b2ef10cb for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 13:45:59 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020759.6140552, 8220a084-e402-435a-b6a7-ffd94f91a211 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:45:59 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] VM Resumed (Lifecycle Event)
Aug 14 13:45:59 user nova-compute[73484]: DEBUG nova.compute.manager [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:45:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:45:59 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Instance spawned successfully.
Aug 14 13:45:59 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:45:59 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:45:59 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:45:59 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020759.6177835, 8220a084-e402-435a-b6a7-ffd94f91a211 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:45:59 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] VM Started (Lifecycle Event)
Aug 14 13:45:59 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:45:59 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:45:59 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:45:59 user nova-compute[73484]: DEBUG nova.compute.manager [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:46:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5d553237-585b-4129-b282-be2b86e36155 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "8220a084-e402-435a-b6a7-ffd94f91a211" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 37.464s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:46:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquiring lock "09ba29fd-8161-485c-ba6d-71d24ab086bc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:46:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:46:15 user nova-compute[73484]: DEBUG nova.objects.instance [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lazy-loading 'flavor' on Instance uuid 09ba29fd-8161-485c-ba6d-71d24ab086bc {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:46:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:46:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquiring lock "09ba29fd-8161-485c-ba6d-71d24ab086bc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:46:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:46:15 user nova-compute[73484]: INFO nova.compute.manager [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Attaching volume b76da63f-391a-4087-8ffd-19c9648cd781 to /dev/vdb
Aug 14 13:46:15 user nova-compute[73484]: DEBUG os_brick.utils [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:46:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:15 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31c5c3b-a610-44e9-a5e4-c5baaa064d93]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:15 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52cc652-8aa3-439d-aa78-11acf4e8c780]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:15 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[720e614b-c8e6-4644-a2e6-c578171b1ac0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:15 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eda6516-2bb9-4c17-9325-874da570731e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:46:15 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:46:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:46:15 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:46:15 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c596ab7e-862a-4d6a-8c59-08f571ab8f06]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:15 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:46:15 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:46:15 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:46:15 user nova-compute[73484]: DEBUG os_brick.utils [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:46:15 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Updating existing volume attachment record: 31badf12-5573-4730-be14-6570d4b29788 {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:46:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:24 user nova-compute[73484]: INFO nova.compute.manager [None req-d24bb9fb-8413-430a-a274-b4f9a81491fd tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Get console output
Aug 14 13:46:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Acquiring lock "eaaccbea-d453-4943-9663-949c66029d87" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lock "eaaccbea-d453-4943-9663-949c66029d87" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Acquiring lock "eaaccbea-d453-4943-9663-949c66029d87-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lock "eaaccbea-d453-4943-9663-949c66029d87-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lock "eaaccbea-d453-4943-9663-949c66029d87-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG nova.compute.manager [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Events pending at deletion: volume-reimaged-abbda33a-ae60-404c-85b3-9df266cc1567 {{(pid=73484) _delete_instance /opt/stack/nova/nova/compute/manager.py:3241}}
Aug 14 13:46:24 user nova-compute[73484]: INFO nova.compute.manager [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Terminating instance
Aug 14 13:46:24 user nova-compute[73484]: DEBUG nova.compute.manager [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [-] [instance: eaaccbea-d453-4943-9663-949c66029d87] During wait destroy, instance disappeared. {{(pid=73484) _wait_for_destroy /opt/stack/nova/nova/virt/libvirt/driver.py:1517}}
Aug 14 13:46:24 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: eaaccbea-d453-4943-9663-949c66029d87] Instance destroyed successfully.
Aug 14 13:46:24 user nova-compute[73484]: DEBUG nova.objects.instance [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lazy-loading 'resources' on Instance uuid eaaccbea-d453-4943-9663-949c66029d87 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T13:37:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-234172834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-412988099',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFj55/WSoxVS+Xy6UzME66O9FkMNrLin49xsiiA9z2iZT/1AKyfBBvPmClJSW2lvgg3Efp7L3zaMlvT135pSEqSZY+yrqXu3bGJndgNG3BKvJ92BRB7yHbpzJf2DGwaP3Q==',key_name='tempest-keypair-1536016686',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:37:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=0,progress=0,project_id='01c04593677842fc9bed43bb42776176',ramdisk_id='',reservation_id='r-cew2mp2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-38074168',owner_user_name='tempest-ServerActionsV293TestJSON-38074168-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:43:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f609a87c04f40b68af1b78f8503c45c',uuid=eaaccbea-d453-4943-9663-949c66029d87,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "244b7f94-a32e-4724-858e-ae9be93a8003", "address": "fa:16:3e:4e:e1:a7", "network": {"id": "6480ad45-783a-4c79-adac-e661111d3cc8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1304007088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01c04593677842fc9bed43bb42776176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244b7f94-a3", "ovs_interfaceid": "244b7f94-a32e-4724-858e-ae9be93a8003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Converting VIF {"id": "244b7f94-a32e-4724-858e-ae9be93a8003", "address": "fa:16:3e:4e:e1:a7", "network": {"id": "6480ad45-783a-4c79-adac-e661111d3cc8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1304007088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01c04593677842fc9bed43bb42776176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap244b7f94-a3", "ovs_interfaceid": "244b7f94-a32e-4724-858e-ae9be93a8003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:e1:a7,bridge_name='br-int',has_traffic_filtering=True,id=244b7f94-a32e-4724-858e-ae9be93a8003,network=Network(6480ad45-783a-4c79-adac-e661111d3cc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244b7f94-a3') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG os_vif [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:e1:a7,bridge_name='br-int',has_traffic_filtering=True,id=244b7f94-a32e-4724-858e-ae9be93a8003,network=Network(6480ad45-783a-4c79-adac-e661111d3cc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244b7f94-a3') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap244b7f94-a3, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:46:24 user nova-compute[73484]: INFO os_vif [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:e1:a7,bridge_name='br-int',has_traffic_filtering=True,id=244b7f94-a32e-4724-858e-ae9be93a8003,network=Network(6480ad45-783a-4c79-adac-e661111d3cc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap244b7f94-a3')
Aug 14 13:46:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NlzXhUZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:46:24 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:46:24 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abbda33a-ae60-404c-85b3-9df266cc1567', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b9b8c5-11cb-4c03-a95b-6c5c1a320fd6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a729a0b-6e44-4899-8c3b-3aa9f5f769d8]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:46:24 user nova-compute[73484]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb (non-flash)
Aug 14 13:46:24 user nova-compute[73484]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c (non-flash)
Aug 14 13:46:24 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:46:24 user nova-compute[73484]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb (non-flash)
Aug 14 13:46:24 user nova-compute[73484]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c (non-flash)
Aug 14 13:46:24 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc458650160>, {}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Disconnecting from: [] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.062s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] <== disconnect_volume: return (63ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:46:24 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Deletion of /opt/stack/data/nova/instances/eaaccbea-d453-4943-9663-949c66029d87_del complete
Aug 14 13:46:24 user nova-compute[73484]: INFO nova.compute.manager [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Took 0.17 seconds to destroy the instance on the hypervisor.
Aug 14 13:46:24 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: eaaccbea-d453-4943-9663-949c66029d87] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:46:24 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: eaaccbea-d453-4943-9663-949c66029d87] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:46:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:25 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: eaaccbea-d453-4943-9663-949c66029d87] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:46:25 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: eaaccbea-d453-4943-9663-949c66029d87] Took 1.12 seconds to deallocate network for instance.
Aug 14 13:46:25 user nova-compute[73484]: DEBUG nova.compute.manager [req-7a0894d8-c6c7-4798-aaeb-a5ff16349a19 req-44754b59-a0da-4dfd-a2cf-3086f541f464 service nova] [instance: eaaccbea-d453-4943-9663-949c66029d87] Received event network-vif-deleted-244b7f94-a32e-4724-858e-ae9be93a8003 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:46:26 user nova-compute[73484]: INFO nova.compute.manager [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Took 0.08 seconds to detach 1 volumes for instance.
Aug 14 13:46:26 user nova-compute[73484]: DEBUG nova.compute.manager [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] [instance: eaaccbea-d453-4943-9663-949c66029d87] Deleting volume: abbda33a-ae60-404c-85b3-9df266cc1567 {{(pid=73484) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 13:46:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:46:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:46:26 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:46:26 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:46:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:46:26 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Deleted allocations for instance eaaccbea-d453-4943-9663-949c66029d87
Aug 14 13:46:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-680d9956-d3c9-433b-a220-12fc597c9d7f tempest-ServerActionsV293TestJSON-38074168 tempest-ServerActionsV293TestJSON-38074168-project-member] Lock "eaaccbea-d453-4943-9663-949c66029d87" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.174s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:46:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Acquiring lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:46:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:46:29 user nova-compute[73484]: INFO nova.compute.manager [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Detaching volume 9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb
Aug 14 13:46:29 user nova-compute[73484]: INFO nova.virt.block_device [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Attempting to driver detach volume 9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb from mountpoint /dev/vdb
Aug 14 13:46:29 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Attempting to detach device vdb from instance 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f from the persistent domain config. {{(pid=73484) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 13:46:29 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:46:29 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:46:29 user nova-compute[73484]:   <source dev="/dev/sdc"/>
Aug 14 13:46:29 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:46:29 user nova-compute[73484]:   <serial>9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb</serial>
Aug 14 13:46:29 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 13:46:29 user nova-compute[73484]: </disk>
Aug 14 13:46:29 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:46:29 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Successfully detached device vdb from instance 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f from the persistent domain config.
Aug 14 13:46:29 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f from the live domain config. {{(pid=73484) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 13:46:29 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:46:29 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:46:29 user nova-compute[73484]:   <source dev="/dev/sdc"/>
Aug 14 13:46:29 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:46:29 user nova-compute[73484]:   <serial>9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb</serial>
Aug 14 13:46:29 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 13:46:29 user nova-compute[73484]: </disk>
Aug 14 13:46:29 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:46:29 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Received event <DeviceRemovedEvent: 1692020789.9334078, 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73484) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 13:46:29 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f {{(pid=73484) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 13:46:29 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Successfully detached device vdb from instance 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f from the live domain config.
Aug 14 13:46:29 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:46:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvLlRiWd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:46:29 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:46:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:46:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:46:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:46:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:29 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[5022296c-4f54-4aa7-804c-ac47a1d30da6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db2b3b5-c0db-46d7-8052-c0b64e78e138]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:46:30 user nova-compute[73484]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb (non-flash)
Aug 14 13:46:30 user nova-compute[73484]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c (non-flash)
Aug 14 13:46:30 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:46:30 user nova-compute[73484]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb (non-flash)
Aug 14 13:46:30 user nova-compute[73484]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c (non-flash)
Aug 14 13:46:30 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc458334dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb'): ({'sdc'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Removing single pathed devices sdc {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.052s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d4932c-fb0e-45a1-806f-8617cde2726e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9318ee2e-1277-49ea-8003-85be90fc2d5b]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Flushing IO for device /dev/sdc {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e824b5b1-8f87-4136-8343-6cff1d9ca63a]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[06bda95b-7fab-4b7c-bfbe-4be31d968f8e]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf354d0-03e4-45b3-8539-8fb8082ac158]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1953f979-15de-428f-8d53-23fb81a9ee1d]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb, portal: 172.16.0.220,3260]
Aug 14 13:46:30 user nova-compute[73484]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb, portal: 172.16.0.220,3260] successful.
Aug 14 13:46:30 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9eeaa9bd-9423-40b2-a0bd-b62c0337ddeb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a286bee4-6534-4cf4-8bde-379e3fe9357e]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] <== disconnect_volume: return (327ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:46:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:31 user nova-compute[73484]: DEBUG nova.objects.instance [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lazy-loading 'flavor' on Instance uuid 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:46:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-eb874d4a-cd49-4d94-9468-fa3608cbbaec tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.909s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:46:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:46:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vMjRCghr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:46:33 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:46:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:46:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:46:33 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:46:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:46:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:46:33 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:46:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4f7528-24c5-470c-a004-4a1895c6a70d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:46:34 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ef36ed-7d0b-4abc-9e19-c3ee764663bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781] added
Aug 14 13:46:34 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadbfb75-1de4-4fdf-9efb-b66195763458]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26e11f2-032b-4c23-a8d3-4df18e505843]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vMjRCghr {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vMjRCghr" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4985aaa-2408-47ea-abd5-b867e5e96aca]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vMjRCghr'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[860e5c6b-83fb-4896-a192-8a3d5eca29d1]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b408834a-65ed-430a-b8b9-470cf0e65d85]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:46:34 user nova-compute[73484]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c (non-flash)
Aug 14 13:46:34 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:46:34 user nova-compute[73484]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c (non-flash)
Aug 14 13:46:34 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[71eee30c-8352-41d2-bbeb-2c2aad539e42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781, portal: 172.16.0.220,3260]
Aug 14 13:46:34 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781, portal: 172.16.0.220,3260] successful.
Aug 14 13:46:34 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b3069927-733a-4e0f-9a22-8e2bb0eabb40 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b3069927-733a-4e0f-9a22-8e2bb0eabb40 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b3069927-733a-4e0f-9a22-8e2bb0eabb40 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b3069927-733a-4e0f-9a22-8e2bb0eabb40 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b3069927-733a-4e0f-9a22-8e2bb0eabb40 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:46:34 user nova-compute[73484]: INFO nova.compute.manager [None req-b3069927-733a-4e0f-9a22-8e2bb0eabb40 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Terminating instance
Aug 14 13:46:34 user nova-compute[73484]: DEBUG nova.compute.manager [None req-b3069927-733a-4e0f-9a22-8e2bb0eabb40 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ab7d2e-595a-448b-ae23-3b2fb98cf4e6]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7e97ce-cdf1-4629-8f8d-b2b8732f96fd]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:46:34 user nova-compute[73484]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c (non-flash)
Aug 14 13:46:34 user nova-compute[73484]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:46:34 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:46:34 user nova-compute[73484]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c (non-flash)
Aug 14 13:46:34 user nova-compute[73484]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:46:34 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fa7f7d-f704-4060-9536-e86ad797500a]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vMjRCghr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d9c1d971-18ce-4795-bb6c-ee957136e7f1 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "ed239af5-980e-42d3-8ebd-ca100ccb2708" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d9c1d971-18ce-4795-bb6c-ee957136e7f1 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "ed239af5-980e-42d3-8ebd-ca100ccb2708" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d9c1d971-18ce-4795-bb6c-ee957136e7f1 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "ed239af5-980e-42d3-8ebd-ca100ccb2708-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d9c1d971-18ce-4795-bb6c-ee957136e7f1 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "ed239af5-980e-42d3-8ebd-ca100ccb2708-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d9c1d971-18ce-4795-bb6c-ee957136e7f1 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "ed239af5-980e-42d3-8ebd-ca100ccb2708-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:46:34 user nova-compute[73484]: INFO nova.compute.manager [None req-d9c1d971-18ce-4795-bb6c-ee957136e7f1 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Terminating instance
Aug 14 13:46:34 user nova-compute[73484]: DEBUG nova.compute.manager [None req-d9c1d971-18ce-4795-bb6c-ee957136e7f1 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG nova.compute.manager [req-98a96144-79a8-4cdd-b181-78817eeb4dca req-f0363a08-9013-4ef2-b52a-36812fa915d0 service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Received event network-vif-unplugged-cfbf4211-f3cb-49ad-98dd-68029d497e5f {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-98a96144-79a8-4cdd-b181-78817eeb4dca req-f0363a08-9013-4ef2-b52a-36812fa915d0 service nova] Acquiring lock "ed239af5-980e-42d3-8ebd-ca100ccb2708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-98a96144-79a8-4cdd-b181-78817eeb4dca req-f0363a08-9013-4ef2-b52a-36812fa915d0 service nova] Lock "ed239af5-980e-42d3-8ebd-ca100ccb2708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-98a96144-79a8-4cdd-b181-78817eeb4dca req-f0363a08-9013-4ef2-b52a-36812fa915d0 service nova] Lock "ed239af5-980e-42d3-8ebd-ca100ccb2708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG nova.compute.manager [req-98a96144-79a8-4cdd-b181-78817eeb4dca req-f0363a08-9013-4ef2-b52a-36812fa915d0 service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] No waiting events found dispatching network-vif-unplugged-cfbf4211-f3cb-49ad-98dd-68029d497e5f {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG nova.compute.manager [req-98a96144-79a8-4cdd-b181-78817eeb4dca req-f0363a08-9013-4ef2-b52a-36812fa915d0 service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Received event network-vif-unplugged-cfbf4211-f3cb-49ad-98dd-68029d497e5f for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG nova.compute.manager [req-dde449f0-064b-499a-8638-ec6eb2ab5b5d req-24d7ec9e-1b90-4982-b3d3-7df47b6dc88c service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received event network-vif-unplugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-dde449f0-064b-499a-8638-ec6eb2ab5b5d req-24d7ec9e-1b90-4982-b3d3-7df47b6dc88c service nova] Acquiring lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-dde449f0-064b-499a-8638-ec6eb2ab5b5d req-24d7ec9e-1b90-4982-b3d3-7df47b6dc88c service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-dde449f0-064b-499a-8638-ec6eb2ab5b5d req-24d7ec9e-1b90-4982-b3d3-7df47b6dc88c service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG nova.compute.manager [req-dde449f0-064b-499a-8638-ec6eb2ab5b5d req-24d7ec9e-1b90-4982-b3d3-7df47b6dc88c service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] No waiting events found dispatching network-vif-unplugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG nova.compute.manager [req-dde449f0-064b-499a-8638-ec6eb2ab5b5d req-24d7ec9e-1b90-4982-b3d3-7df47b6dc88c service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received event network-vif-unplugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:46:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '26661303130656435', 'path': '/dev/sdc'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661303130656435', 'path': '/dev/sdc'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG nova.objects.instance [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lazy-loading 'flavor' on Instance uuid 09ba29fd-8161-485c-ba6d-71d24ab086bc {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 13:46:35 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:46:35 user nova-compute[73484]:   <source dev="/dev/sdc"/>
Aug 14 13:46:35 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:46:35 user nova-compute[73484]:   <serial>b76da63f-391a-4087-8ffd-19c9648cd781</serial>
Aug 14 13:46:35 user nova-compute[73484]: </disk>
Aug 14 13:46:35 user nova-compute[73484]:  {{(pid=73484) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 13:46:35 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Instance destroyed successfully.
Aug 14 13:46:35 user nova-compute[73484]: DEBUG nova.objects.instance [None req-b3069927-733a-4e0f-9a22-8e2bb0eabb40 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'resources' on Instance uuid 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-b3069927-733a-4e0f-9a22-8e2bb0eabb40 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:36:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1545874430',display_name='tempest-AttachVolumeTestJSON-server-1545874430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1545874430',id=2,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALz2dA1fCV3zsqvRCM3si65BX/s2RWbHAvxkMavxCm+Cz33FBQTUMagzswhJU7/mAqiPPhCjI04IhkLCYoINFrAPHP37QxwSFtMKgaz77wIK1BXGoScfZ85G5EKo7vD3A==',key_name='tempest-keypair-1440897791',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:37:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d2114819cda450ca1827ddd5557da23',ramdisk_id='',reservation_id='r-ifpiz561',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-852428779',owner_user_name='tempest-AttachVolumeTestJSON-852428779-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:44:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fac94bacad00447d9743d8a44118ea47',uuid=0a3a174b-d870-4164-891e-a2fa8cc8c8b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "address": "fa:16:3e:b8:35:a4", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511cc5ad-6f", "ovs_interfaceid": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-b3069927-733a-4e0f-9a22-8e2bb0eabb40 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Converting VIF {"id": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "address": "fa:16:3e:b8:35:a4", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap511cc5ad-6f", "ovs_interfaceid": "511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-b3069927-733a-4e0f-9a22-8e2bb0eabb40 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:35:a4,bridge_name='br-int',has_traffic_filtering=True,id=511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a,network=Network(cddd6eb8-767a-42c5-8cca-a1fe1d2eb604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511cc5ad-6f') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG os_vif [None req-b3069927-733a-4e0f-9a22-8e2bb0eabb40 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:35:a4,bridge_name='br-int',has_traffic_filtering=True,id=511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a,network=Network(cddd6eb8-767a-42c5-8cca-a1fe1d2eb604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511cc5ad-6f') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap511cc5ad-6f, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:35 user nova-compute[73484]: INFO os_vif [None req-b3069927-733a-4e0f-9a22-8e2bb0eabb40 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:35:a4,bridge_name='br-int',has_traffic_filtering=True,id=511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a,network=Network(cddd6eb8-767a-42c5-8cca-a1fe1d2eb604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap511cc5ad-6f')
Aug 14 13:46:35 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-b3069927-733a-4e0f-9a22-8e2bb0eabb40 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Deleting instance files /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8_del
Aug 14 13:46:35 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-b3069927-733a-4e0f-9a22-8e2bb0eabb40 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Deletion of /opt/stack/data/nova/instances/0a3a174b-d870-4164-891e-a2fa8cc8c8b8_del complete
Aug 14 13:46:35 user nova-compute[73484]: INFO nova.compute.manager [None req-b3069927-733a-4e0f-9a22-8e2bb0eabb40 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Took 1.40 seconds to destroy the instance on the hypervisor.
Aug 14 13:46:35 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-b3069927-733a-4e0f-9a22-8e2bb0eabb40 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:35 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Instance destroyed successfully.
Aug 14 13:46:35 user nova-compute[73484]: DEBUG nova.objects.instance [None req-d9c1d971-18ce-4795-bb6c-ee957136e7f1 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lazy-loading 'resources' on Instance uuid ed239af5-980e-42d3-8ebd-ca100ccb2708 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-d9c1d971-18ce-4795-bb6c-ee957136e7f1 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T13:40:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-808860414',display_name='tempest-ServerActionsTestOtherA-server-319727995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-808860414',id=15,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeXNpb9XHaUrVlh12GX9afYS4uhArSHw3Bmb57wtkUnIoEAuE3Mh/kr8GY8u6/64wrETW58CSBoYMy9LyrbLjI8XQndUnGuUz3mUsWp7LyaF/HaeOtI27YfARpw+mLtGw==',key_name='tempest-keypair-1210865444',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:43:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff9e3bd3df8a408e96e9054775c3cb83',ramdisk_id='',reservation_id='r-vq274olh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2033458528',owner_user_name='tempest-ServerActionsTestOtherA-2033458528-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:43:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b22dfe5647e149a5b3a19d843f0efd66',uuid=ed239af5-980e-42d3-8ebd-ca100ccb2708,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "address": "fa:16:3e:c9:13:42", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbf4211-f3", "ovs_interfaceid": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-d9c1d971-18ce-4795-bb6c-ee957136e7f1 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Converting VIF {"id": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "address": "fa:16:3e:c9:13:42", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbf4211-f3", "ovs_interfaceid": "cfbf4211-f3cb-49ad-98dd-68029d497e5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-d9c1d971-18ce-4795-bb6c-ee957136e7f1 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:13:42,bridge_name='br-int',has_traffic_filtering=True,id=cfbf4211-f3cb-49ad-98dd-68029d497e5f,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbf4211-f3') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG os_vif [None req-d9c1d971-18ce-4795-bb6c-ee957136e7f1 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:13:42,bridge_name='br-int',has_traffic_filtering=True,id=cfbf4211-f3cb-49ad-98dd-68029d497e5f,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbf4211-f3') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcfbf4211-f3, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:35 user nova-compute[73484]: INFO os_vif [None req-d9c1d971-18ce-4795-bb6c-ee957136e7f1 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:13:42,bridge_name='br-int',has_traffic_filtering=True,id=cfbf4211-f3cb-49ad-98dd-68029d497e5f,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbf4211-f3')
Aug 14 13:46:35 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-d9c1d971-18ce-4795-bb6c-ee957136e7f1 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Deleting instance files /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708_del
Aug 14 13:46:35 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-d9c1d971-18ce-4795-bb6c-ee957136e7f1 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Deletion of /opt/stack/data/nova/instances/ed239af5-980e-42d3-8ebd-ca100ccb2708_del complete
Aug 14 13:46:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] No VIF found with MAC fa:16:3e:30:6a:b2, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:46:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:36 user nova-compute[73484]: INFO nova.compute.manager [None req-d9c1d971-18ce-4795-bb6c-ee957136e7f1 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Took 1.61 seconds to destroy the instance on the hypervisor.
Aug 14 13:46:36 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-d9c1d971-18ce-4795-bb6c-ee957136e7f1 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:46:36 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:46:36 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:46:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c395d3ff-b86f-4308-a3ce-89816c4392cd tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.775s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:46:36 user nova-compute[73484]: DEBUG nova.compute.manager [req-d03ee903-2b6b-4921-9f4c-1faaff5476ae req-6f2051ca-c2a1-4bd2-9595-cdd70b593e6a service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Received event network-vif-plugged-cfbf4211-f3cb-49ad-98dd-68029d497e5f {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:46:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d03ee903-2b6b-4921-9f4c-1faaff5476ae req-6f2051ca-c2a1-4bd2-9595-cdd70b593e6a service nova] Acquiring lock "ed239af5-980e-42d3-8ebd-ca100ccb2708-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:46:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d03ee903-2b6b-4921-9f4c-1faaff5476ae req-6f2051ca-c2a1-4bd2-9595-cdd70b593e6a service nova] Lock "ed239af5-980e-42d3-8ebd-ca100ccb2708-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:46:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d03ee903-2b6b-4921-9f4c-1faaff5476ae req-6f2051ca-c2a1-4bd2-9595-cdd70b593e6a service nova] Lock "ed239af5-980e-42d3-8ebd-ca100ccb2708-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:46:36 user nova-compute[73484]: DEBUG nova.compute.manager [req-d03ee903-2b6b-4921-9f4c-1faaff5476ae req-6f2051ca-c2a1-4bd2-9595-cdd70b593e6a service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] No waiting events found dispatching network-vif-plugged-cfbf4211-f3cb-49ad-98dd-68029d497e5f {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:46:36 user nova-compute[73484]: WARNING nova.compute.manager [req-d03ee903-2b6b-4921-9f4c-1faaff5476ae req-6f2051ca-c2a1-4bd2-9595-cdd70b593e6a service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Received unexpected event network-vif-plugged-cfbf4211-f3cb-49ad-98dd-68029d497e5f for instance with vm_state active and task_state deleting.
Aug 14 13:46:37 user nova-compute[73484]: DEBUG nova.compute.manager [req-d979b5be-4842-494d-9664-96d4519708ad req-092fe523-e6f6-468a-b6d3-ee110572491f service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received event network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:46:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d979b5be-4842-494d-9664-96d4519708ad req-092fe523-e6f6-468a-b6d3-ee110572491f service nova] Acquiring lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:46:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d979b5be-4842-494d-9664-96d4519708ad req-092fe523-e6f6-468a-b6d3-ee110572491f service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:46:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d979b5be-4842-494d-9664-96d4519708ad req-092fe523-e6f6-468a-b6d3-ee110572491f service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:46:37 user nova-compute[73484]: DEBUG nova.compute.manager [req-d979b5be-4842-494d-9664-96d4519708ad req-092fe523-e6f6-468a-b6d3-ee110572491f service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] No waiting events found dispatching network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:46:37 user nova-compute[73484]: WARNING nova.compute.manager [req-d979b5be-4842-494d-9664-96d4519708ad req-092fe523-e6f6-468a-b6d3-ee110572491f service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received unexpected event network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a for instance with vm_state active and task_state deleting.
Aug 14 13:46:37 user nova-compute[73484]: DEBUG nova.compute.manager [req-d979b5be-4842-494d-9664-96d4519708ad req-092fe523-e6f6-468a-b6d3-ee110572491f service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received event network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:46:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d979b5be-4842-494d-9664-96d4519708ad req-092fe523-e6f6-468a-b6d3-ee110572491f service nova] Acquiring lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:46:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d979b5be-4842-494d-9664-96d4519708ad req-092fe523-e6f6-468a-b6d3-ee110572491f service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:46:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d979b5be-4842-494d-9664-96d4519708ad req-092fe523-e6f6-468a-b6d3-ee110572491f service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:46:37 user nova-compute[73484]: DEBUG nova.compute.manager [req-d979b5be-4842-494d-9664-96d4519708ad req-092fe523-e6f6-468a-b6d3-ee110572491f service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] No waiting events found dispatching network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:46:37 user nova-compute[73484]: WARNING nova.compute.manager [req-d979b5be-4842-494d-9664-96d4519708ad req-092fe523-e6f6-468a-b6d3-ee110572491f service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received unexpected event network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a for instance with vm_state active and task_state deleting.
Aug 14 13:46:37 user nova-compute[73484]: DEBUG nova.compute.manager [req-d979b5be-4842-494d-9664-96d4519708ad req-092fe523-e6f6-468a-b6d3-ee110572491f service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received event network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:46:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d979b5be-4842-494d-9664-96d4519708ad req-092fe523-e6f6-468a-b6d3-ee110572491f service nova] Acquiring lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:46:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d979b5be-4842-494d-9664-96d4519708ad req-092fe523-e6f6-468a-b6d3-ee110572491f service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:46:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d979b5be-4842-494d-9664-96d4519708ad req-092fe523-e6f6-468a-b6d3-ee110572491f service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:46:37 user nova-compute[73484]: DEBUG nova.compute.manager [req-d979b5be-4842-494d-9664-96d4519708ad req-092fe523-e6f6-468a-b6d3-ee110572491f service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] No waiting events found dispatching network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:46:37 user nova-compute[73484]: WARNING nova.compute.manager [req-d979b5be-4842-494d-9664-96d4519708ad req-092fe523-e6f6-468a-b6d3-ee110572491f service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received unexpected event network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a for instance with vm_state active and task_state deleting.
Aug 14 13:46:37 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:46:38 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:46:38 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Took 2.79 seconds to deallocate network for instance.
Aug 14 13:46:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b3069927-733a-4e0f-9a22-8e2bb0eabb40 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:46:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b3069927-733a-4e0f-9a22-8e2bb0eabb40 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:46:38 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:46:38 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 13:46:38 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:46:38 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Took 2.86 seconds to deallocate network for instance.
Aug 14 13:46:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-a9d4ec42-3db9-439b-87a7-02bcaab514a4" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:46:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-a9d4ec42-3db9-439b-87a7-02bcaab514a4" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:46:38 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 13:46:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d9c1d971-18ce-4795-bb6c-ee957136e7f1 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:46:39 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-b3069927-733a-4e0f-9a22-8e2bb0eabb40 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:46:39 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-b3069927-733a-4e0f-9a22-8e2bb0eabb40 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:46:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b3069927-733a-4e0f-9a22-8e2bb0eabb40 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.564s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:46:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d9c1d971-18ce-4795-bb6c-ee957136e7f1 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.117s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:46:39 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-b3069927-733a-4e0f-9a22-8e2bb0eabb40 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Deleted allocations for instance 0a3a174b-d870-4164-891e-a2fa8cc8c8b8
Aug 14 13:46:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-84797e01-fa97-46f7-8341-37934118c509 req-b1af4a11-2b2f-44fb-be29-c6e6735f6068 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received event network-vif-unplugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:46:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-84797e01-fa97-46f7-8341-37934118c509 req-b1af4a11-2b2f-44fb-be29-c6e6735f6068 service nova] Acquiring lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:46:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-84797e01-fa97-46f7-8341-37934118c509 req-b1af4a11-2b2f-44fb-be29-c6e6735f6068 service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:46:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-84797e01-fa97-46f7-8341-37934118c509 req-b1af4a11-2b2f-44fb-be29-c6e6735f6068 service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:46:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-84797e01-fa97-46f7-8341-37934118c509 req-b1af4a11-2b2f-44fb-be29-c6e6735f6068 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] No waiting events found dispatching network-vif-unplugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:46:39 user nova-compute[73484]: WARNING nova.compute.manager [req-84797e01-fa97-46f7-8341-37934118c509 req-b1af4a11-2b2f-44fb-be29-c6e6735f6068 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received unexpected event network-vif-unplugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a for instance with vm_state deleted and task_state None.
Aug 14 13:46:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-84797e01-fa97-46f7-8341-37934118c509 req-b1af4a11-2b2f-44fb-be29-c6e6735f6068 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received event network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:46:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-84797e01-fa97-46f7-8341-37934118c509 req-b1af4a11-2b2f-44fb-be29-c6e6735f6068 service nova] Acquiring lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:46:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-84797e01-fa97-46f7-8341-37934118c509 req-b1af4a11-2b2f-44fb-be29-c6e6735f6068 service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:46:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-84797e01-fa97-46f7-8341-37934118c509 req-b1af4a11-2b2f-44fb-be29-c6e6735f6068 service nova] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:46:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-84797e01-fa97-46f7-8341-37934118c509 req-b1af4a11-2b2f-44fb-be29-c6e6735f6068 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] No waiting events found dispatching network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:46:39 user nova-compute[73484]: WARNING nova.compute.manager [req-84797e01-fa97-46f7-8341-37934118c509 req-b1af4a11-2b2f-44fb-be29-c6e6735f6068 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received unexpected event network-vif-plugged-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a for instance with vm_state deleted and task_state None.
Aug 14 13:46:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-84797e01-fa97-46f7-8341-37934118c509 req-b1af4a11-2b2f-44fb-be29-c6e6735f6068 service nova] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Received event network-vif-deleted-511cc5ad-6f1f-4b9e-b7e0-5229b9e5c41a {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:46:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-84797e01-fa97-46f7-8341-37934118c509 req-b1af4a11-2b2f-44fb-be29-c6e6735f6068 service nova] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Received event network-vif-deleted-cfbf4211-f3cb-49ad-98dd-68029d497e5f {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:46:39 user nova-compute[73484]: DEBUG nova.compute.manager [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Stashing vm_state: active {{(pid=73484) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 14 13:46:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b3069927-733a-4e0f-9a22-8e2bb0eabb40 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "0a3a174b-d870-4164-891e-a2fa8cc8c8b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.044s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:46:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:46:39 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Updating instance_info_cache with network_info: [{"id": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "address": "fa:16:3e:a8:f5:8b", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa109f4ac-a7", "ovs_interfaceid": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:46:39 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-d9c1d971-18ce-4795-bb6c-ee957136e7f1 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:46:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-a9d4ec42-3db9-439b-87a7-02bcaab514a4" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:46:39 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 13:46:39 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-d9c1d971-18ce-4795-bb6c-ee957136e7f1 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:46:39 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:46:39 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 13:46:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d9c1d971-18ce-4795-bb6c-ee957136e7f1 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.503s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:46:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.169s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:46:39 user nova-compute[73484]: DEBUG nova.objects.instance [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lazy-loading 'pci_requests' on Instance uuid 09ba29fd-8161-485c-ba6d-71d24ab086bc {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:46:39 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-d9c1d971-18ce-4795-bb6c-ee957136e7f1 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Deleted allocations for instance ed239af5-980e-42d3-8ebd-ca100ccb2708
Aug 14 13:46:39 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:46:39 user nova-compute[73484]: INFO nova.compute.claims [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Claim successful on node user
Aug 14 13:46:39 user nova-compute[73484]: DEBUG nova.objects.instance [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lazy-loading 'resources' on Instance uuid 09ba29fd-8161-485c-ba6d-71d24ab086bc {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:46:39 user nova-compute[73484]: DEBUG nova.objects.instance [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lazy-loading 'pci_devices' on Instance uuid 09ba29fd-8161-485c-ba6d-71d24ab086bc {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:46:39 user nova-compute[73484]: INFO nova.compute.resource_tracker [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Updating resource usage from migration d3095941-fb94-498e-a661-cc4079498cc9
Aug 14 13:46:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d9c1d971-18ce-4795-bb6c-ee957136e7f1 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "ed239af5-980e-42d3-8ebd-ca100ccb2708" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.351s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:46:39 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:46:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:46:40 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:46:40 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:46:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.615s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:46:40 user nova-compute[73484]: INFO nova.compute.manager [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Migrating
Aug 14 13:46:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:46:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:46:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.420s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:46:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:46:40 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 13:46:40 user nova-compute[73484]: INFO nova.compute.rpcapi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 14 13:46:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:46:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquiring lock "refresh_cache-09ba29fd-8161-485c-ba6d-71d24ab086bc" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:46:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquired lock "refresh_cache-09ba29fd-8161-485c-ba6d-71d24ab086bc" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:46:40 user nova-compute[73484]: DEBUG nova.network.neutron [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:46:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:40 user nova-compute[73484]: DEBUG nova.network.neutron [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Updating instance_info_cache with network_info: [{"id": "0b54646a-71ed-4087-adf7-66645e7d2907", "address": "fa:16:3e:30:6a:b2", "network": {"id": "a417bb93-b1ed-47a4-be83-6679c2ea34b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872770450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07a8a61d3f14061b44b8f37968c54e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b54646a-71", "ovs_interfaceid": "0b54646a-71ed-4087-adf7-66645e7d2907", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:46:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Releasing lock "refresh_cache-09ba29fd-8161-485c-ba6d-71d24ab086bc" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:46:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:46:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:46:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Starting migrate_disk_and_power_off {{(pid=73484) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG nova.compute.manager [req-ba596904-b53a-4aa5-a9e3-ed6e52b1b777 req-0f17f7e1-e0a4-4eab-88a5-7ab65769d3b6 service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Received event network-vif-unplugged-0b54646a-71ed-4087-adf7-66645e7d2907 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ba596904-b53a-4aa5-a9e3-ed6e52b1b777 req-0f17f7e1-e0a4-4eab-88a5-7ab65769d3b6 service nova] Acquiring lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ba596904-b53a-4aa5-a9e3-ed6e52b1b777 req-0f17f7e1-e0a4-4eab-88a5-7ab65769d3b6 service nova] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ba596904-b53a-4aa5-a9e3-ed6e52b1b777 req-0f17f7e1-e0a4-4eab-88a5-7ab65769d3b6 service nova] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG nova.compute.manager [req-ba596904-b53a-4aa5-a9e3-ed6e52b1b777 req-0f17f7e1-e0a4-4eab-88a5-7ab65769d3b6 service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] No waiting events found dispatching network-vif-unplugged-0b54646a-71ed-4087-adf7-66645e7d2907 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:46:41 user nova-compute[73484]: WARNING nova.compute.manager [req-ba596904-b53a-4aa5-a9e3-ed6e52b1b777 req-0f17f7e1-e0a4-4eab-88a5-7ab65769d3b6 service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Received unexpected event network-vif-unplugged-0b54646a-71ed-4087-adf7-66645e7d2907 for instance with vm_state active and task_state resize_migrating.
Aug 14 13:46:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:41 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Instance destroyed successfully.
Aug 14 13:46:41 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:42:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1361765687',display_name='tempest-ServerActionsTestOtherB-server-1361765687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1361765687',id=20,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF57s7WDcr5LrA3gfxfpgDNJt6UZ/rZhkiS+Nfi/DIO/C85ZFU7Y17ny/O/CEqdXEP2/mm1AA46PPquOjl5qC1/2wZc0eZa1Tjpvt/2IPyALMO4YPxf1Hkqx4YMdA9qx2g==',key_name='tempest-keypair-345523160',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:42:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a07a8a61d3f14061b44b8f37968c54e9',ramdisk_id='',reservation_id='r-b3zcr056',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1221611824',owner_user_name='tempest-ServerActionsTestOtherB-1221611824-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:46:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55e77cc182bc4ec79429025c6a9f14af',uuid=09ba29fd-8161-485c-ba6d-71d24ab086bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b54646a-71ed-4087-adf7-66645e7d2907", "address": "fa:16:3e:30:6a:b2", "network": {"id": "a417bb93-b1ed-47a4-be83-6679c2ea34b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872770450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-872770450-network", "vif_mac": "fa:16:3e:30:6a:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07a8a61d3f14061b44b8f37968c54e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b54646a-71", "ovs_interfaceid": "0b54646a-71ed-4087-adf7-66645e7d2907", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Converting VIF {"id": "0b54646a-71ed-4087-adf7-66645e7d2907", "address": "fa:16:3e:30:6a:b2", "network": {"id": "a417bb93-b1ed-47a4-be83-6679c2ea34b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872770450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-872770450-network", "vif_mac": "fa:16:3e:30:6a:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07a8a61d3f14061b44b8f37968c54e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b54646a-71", "ovs_interfaceid": "0b54646a-71ed-4087-adf7-66645e7d2907", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:6a:b2,bridge_name='br-int',has_traffic_filtering=True,id=0b54646a-71ed-4087-adf7-66645e7d2907,network=Network(a417bb93-b1ed-47a4-be83-6679c2ea34b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b54646a-71') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG os_vif [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:6a:b2,bridge_name='br-int',has_traffic_filtering=True,id=0b54646a-71ed-4087-adf7-66645e7d2907,network=Network(a417bb93-b1ed-47a4-be83-6679c2ea34b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b54646a-71') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b54646a-71, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:41 user nova-compute[73484]: INFO os_vif [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:6a:b2,bridge_name='br-int',has_traffic_filtering=True,id=0b54646a-71ed-4087-adf7-66645e7d2907,network=Network(a417bb93-b1ed-47a4-be83-6679c2ea34b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b54646a-71')
Aug 14 13:46:41 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vMjRCghr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:46:41 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:46:41 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa0f864-aa8c-4191-9b4b-3941b6f3ecad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99ba770-a188-40bf-ab16-7a158812e7a4]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:46:41 user nova-compute[73484]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c (non-flash)
Aug 14 13:46:41 user nova-compute[73484]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:46:41 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:46:41 user nova-compute[73484]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c (non-flash)
Aug 14 13:46:41 user nova-compute[73484]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:46:41 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4585b0940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781'): ({'sdc'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Removing single pathed devices sdc {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e60d6f-8b16-413a-ae6e-80305398204e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e35d8c9-85e7-401d-a2f8-ab6f63fa06c1]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Flushing IO for device /dev/sdc {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb08e16-d3b4-4b53-96ea-15beaee58d88]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed7ef60-348e-4914-805a-a1915f2fccc6]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[db35b889-3347-4aca-82df-eb9b5f85c978]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09866df-3a5c-4db5-9901-ca4780ab16cb]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781, portal: 172.16.0.220,3260]
Aug 14 13:46:42 user nova-compute[73484]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781, portal: 172.16.0.220,3260] successful.
Aug 14 13:46:42 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e698ec-9004-4f89-ac02-2ec95b04aa0b]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] <== disconnect_volume: return (354ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc_resize/disk /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] CMD "cp -r /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc_resize/disk /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk" returned: 0 in 0.429s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc_resize/disk.info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk.info {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] CMD "cp -r /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc_resize/disk.info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk.info" returned: 0 in 0.039s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:43 user nova-compute[73484]: DEBUG nova.compute.manager [req-26e957d2-50b8-4db3-a917-f183922fe5fd req-0eb2828f-8331-42dc-a129-8fa8bc242211 service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Received event network-vif-plugged-0b54646a-71ed-4087-adf7-66645e7d2907 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:46:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-26e957d2-50b8-4db3-a917-f183922fe5fd req-0eb2828f-8331-42dc-a129-8fa8bc242211 service nova] Acquiring lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:46:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-26e957d2-50b8-4db3-a917-f183922fe5fd req-0eb2828f-8331-42dc-a129-8fa8bc242211 service nova] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:46:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-26e957d2-50b8-4db3-a917-f183922fe5fd req-0eb2828f-8331-42dc-a129-8fa8bc242211 service nova] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:46:43 user nova-compute[73484]: DEBUG nova.compute.manager [req-26e957d2-50b8-4db3-a917-f183922fe5fd req-0eb2828f-8331-42dc-a129-8fa8bc242211 service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] No waiting events found dispatching network-vif-plugged-0b54646a-71ed-4087-adf7-66645e7d2907 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:46:43 user nova-compute[73484]: WARNING nova.compute.manager [req-26e957d2-50b8-4db3-a917-f183922fe5fd req-0eb2828f-8331-42dc-a129-8fa8bc242211 service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Received unexpected event network-vif-plugged-0b54646a-71ed-4087-adf7-66645e7d2907 for instance with vm_state active and task_state resize_migrating.
Aug 14 13:46:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:46:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eed5f58-f09b-419a-ba10-7b1dd6f27f7f/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eed5f58-f09b-419a-ba10-7b1dd6f27f7f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eed5f58-f09b-419a-ba10-7b1dd6f27f7f/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9eed5f58-f09b-419a-ba10-7b1dd6f27f7f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:44 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:46:44 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:46:44 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=7134MB free_disk=25.375099182128906GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 13:46:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:46:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:46:44 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Applying migration context for instance 09ba29fd-8161-485c-ba6d-71d24ab086bc as it has an incoming, in-progress migration d3095941-fb94-498e-a661-cc4079498cc9. Migration status is migrating {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 13:46:44 user nova-compute[73484]: INFO nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Updating resource usage from migration d3095941-fb94-498e-a661-cc4079498cc9
Aug 14 13:46:44 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance f4f7788c-fcca-47c1-b5b8-72892253982d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:46:44 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 07bac569-8b2c-4555-b4d5-a74f7384630b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:46:44 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance a9d4ec42-3db9-439b-87a7-02bcaab514a4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:46:44 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance bd43e3a9-0413-4e55-b6a1-7f3f792ba872 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:46:44 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:46:44 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance c0994bac-3b43-414e-aa81-a9d7198775a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:46:44 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 8220a084-e402-435a-b6a7-ffd94f91a211 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:46:44 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 782c6142-757a-49ae-9292-787a7f1e8a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:46:44 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 03255d24-b6fd-459c-8ac6-f9c4063b54b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:46:44 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Migration d3095941-fb94-498e-a661-cc4079498cc9 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 13:46:44 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 09ba29fd-8161-485c-ba6d-71d24ab086bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:46:44 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 13:46:44 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 13:46:45 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:46:45 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:46:45 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 13:46:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.549s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:46:45 user nova-compute[73484]: DEBUG nova.network.neutron [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Port 0b54646a-71ed-4087-adf7-66645e7d2907 binding to destination host user is already ACTIVE {{(pid=73484) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 14 13:46:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquiring lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:46:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:46:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:46:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquiring lock "refresh_cache-09ba29fd-8161-485c-ba6d-71d24ab086bc" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:46:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquired lock "refresh_cache-09ba29fd-8161-485c-ba6d-71d24ab086bc" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:46:45 user nova-compute[73484]: DEBUG nova.network.neutron [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:46:46 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:46:46 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:46:46 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:46:46 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:46:46 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:46:46 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:46:46 user nova-compute[73484]: DEBUG nova.network.neutron [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Updating instance_info_cache with network_info: [{"id": "0b54646a-71ed-4087-adf7-66645e7d2907", "address": "fa:16:3e:30:6a:b2", "network": {"id": "a417bb93-b1ed-47a4-be83-6679c2ea34b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872770450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07a8a61d3f14061b44b8f37968c54e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b54646a-71", "ovs_interfaceid": "0b54646a-71ed-4087-adf7-66645e7d2907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:46:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Releasing lock "refresh_cache-09ba29fd-8161-485c-ba6d-71d24ab086bc" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:46:46 user nova-compute[73484]: DEBUG os_brick.utils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:46:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec0e759-e176-462a-a47e-61767ab28b9c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a688534-96a8-4b28-a3ee-7c56bfb7290f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[685c0443-c738-472f-b034-97d9d44f295e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45c5cb2-2d3a-408b-8a80-8065a33d93e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:46:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:46:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:46:46 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:46:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a479c6b-6d4f-4706-8f43-733efebaccff]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:46:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:46:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:46:46 user nova-compute[73484]: DEBUG os_brick.utils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:46:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:50 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692020795.4877393, 0a3a174b-d870-4164-891e-a2fa8cc8c8b8 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:46:50 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] VM Stopped (Lifecycle Event)
Aug 14 13:46:50 user nova-compute[73484]: DEBUG nova.compute.manager [None req-51d3b8f2-758a-4dae-b6e8-096070ade6ca None None] [instance: 0a3a174b-d870-4164-891e-a2fa8cc8c8b8] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:46:50 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692020795.8873272, ed239af5-980e-42d3-8ebd-ca100ccb2708 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:46:50 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] VM Stopped (Lifecycle Event)
Aug 14 13:46:50 user nova-compute[73484]: DEBUG nova.compute.manager [None req-ceb613de-1372-4144-987e-e36fcdc57761 None None] [instance: ed239af5-980e-42d3-8ebd-ca100ccb2708] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:46:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:46:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Starting finish_migration {{(pid=73484) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 14 13:46:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Instance directory exists: not creating {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 13:46:55 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Creating image(s)
Aug 14 13:46:55 user nova-compute[73484]: DEBUG nova.objects.instance [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lazy-loading 'trusted_certs' on Instance uuid 09ba29fd-8161-485c-ba6d-71d24ab086bc {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:46:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.194s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:55 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Checking if we can resize image /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk. size=21474836480 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:46:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk 21474836480 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk 21474836480" returned: 0 in 0.056s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Did not create local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Ensure instance console log exists: /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Start _get_guest_xml network_info=[{"id": "0b54646a-71ed-4087-adf7-66645e7d2907", "address": "fa:16:3e:30:6a:b2", "network": {"id": "a417bb93-b1ed-47a4-be83-6679c2ea34b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872770450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-872770450-network", "vif_mac": "fa:16:3e:30:6a:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07a8a61d3f14061b44b8f37968c54e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b54646a-71", "ovs_interfaceid": "0b54646a-71ed-4087-adf7-66645e7d2907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b4916eae-749c-4133-b95b-540b500f0652', 'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vMjRCghr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '09ba29fd-8161-485c-ba6d-71d24ab086bc', 'attached_at': '2023-08-14T13:46:56.000000', 'detached_at': '', 'volume_id': 'b76da63f-391a-4087-8ffd-19c9648cd781', 'serial': 'b76da63f-391a-4087-8ffd-19c9648cd781'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:46:56 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:46:56 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:46:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG nova.objects.instance [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lazy-loading 'vcpu_model' on Instance uuid 09ba29fd-8161-485c-ba6d-71d24ab086bc {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vMjRCghr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:46:56 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:46:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:46:56 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:46:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:46:56 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[226b9d13-499d-4b1a-9717-087d67dfd059]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:46:56 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0a6fee-db0d-4d84-9d6f-9d3d59a3e742]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781] added
Aug 14 13:46:56 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc37364a-d21f-4ccd-81ef-9c4569e44902]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d7518e-10b6-469e-b387-f33f66d8e75d]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vMjRCghr {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vMjRCghr" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e34fb2-1783-474b-9b30-89e3554a83ba]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vMjRCghr'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55abc96-18e3-42a2-b0d8-aa36ccbcf78e]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[79eaf3a4-9049-457e-a36a-0ab23e9d5e05]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:46:56 user nova-compute[73484]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c (non-flash)
Aug 14 13:46:56 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:46:56 user nova-compute[73484]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c (non-flash)
Aug 14 13:46:56 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a2fd56-3b23-4f0e-b769-36390647f425]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781, portal: 172.16.0.220,3260]
Aug 14 13:46:56 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781, portal: 172.16.0.220,3260] successful.
Aug 14 13:46:56 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea8f226-b687-45b7-8f21-2028376a07ed]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[41763957-a9c8-4456-8eec-b1d859bde5db]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:46:56 user nova-compute[73484]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c (non-flash)
Aug 14 13:46:56 user nova-compute[73484]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:46:56 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:46:56 user nova-compute[73484]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c (non-flash)
Aug 14 13:46:56 user nova-compute[73484]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:46:56 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[5096f827-099a-47e2-893a-78dfb7c5869b]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vMjRCghr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692020801.786719, 09ba29fd-8161-485c-ba6d-71d24ab086bc => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:46:56 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] VM Stopped (Lifecycle Event)
Aug 14 13:46:56 user nova-compute[73484]: DEBUG nova.compute.manager [None req-202cccc2-6777-4eb7-88b7-dc2160bc7571 None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG nova.compute.manager [None req-202cccc2-6777-4eb7-88b7-dc2160bc7571 None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:46:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:56 user nova-compute[73484]: INFO nova.compute.manager [None req-202cccc2-6777-4eb7-88b7-dc2160bc7571 None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 13:46:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:46:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26661303130656435', 'path': '/dev/sdc'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:46:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661303130656435', 'path': '/dev/sdc'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:46:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:42:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1361765687',display_name='tempest-ServerActionsTestOtherB-server-1361765687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1361765687',id=20,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF57s7WDcr5LrA3gfxfpgDNJt6UZ/rZhkiS+Nfi/DIO/C85ZFU7Y17ny/O/CEqdXEP2/mm1AA46PPquOjl5qC1/2wZc0eZa1Tjpvt/2IPyALMO4YPxf1Hkqx4YMdA9qx2g==',key_name='tempest-keypair-345523160',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:42:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a07a8a61d3f14061b44b8f37968c54e9',ramdisk_id='',reservation_id='r-b3zcr056',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1221611824',owner_user_name='tempest-ServerActionsTestOtherB-1221611824-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:46:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55e77cc182bc4ec79429025c6a9f14af',uuid=09ba29fd-8161-485c-ba6d-71d24ab086bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b54646a-71ed-4087-adf7-66645e7d2907", "address": "fa:16:3e:30:6a:b2", "network": {"id": "a417bb93-b1ed-47a4-be83-6679c2ea34b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872770450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-872770450-network", "vif_mac": "fa:16:3e:30:6a:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07a8a61d3f14061b44b8f37968c54e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b54646a-71", "ovs_interfaceid": "0b54646a-71ed-4087-adf7-66645e7d2907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:46:57 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Converting VIF {"id": "0b54646a-71ed-4087-adf7-66645e7d2907", "address": "fa:16:3e:30:6a:b2", "network": {"id": "a417bb93-b1ed-47a4-be83-6679c2ea34b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872770450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-872770450-network", "vif_mac": "fa:16:3e:30:6a:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07a8a61d3f14061b44b8f37968c54e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b54646a-71", "ovs_interfaceid": "0b54646a-71ed-4087-adf7-66645e7d2907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:46:57 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:6a:b2,bridge_name='br-int',has_traffic_filtering=True,id=0b54646a-71ed-4087-adf7-66645e7d2907,network=Network(a417bb93-b1ed-47a4-be83-6679c2ea34b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b54646a-71') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:46:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:46:57 user nova-compute[73484]:   <uuid>09ba29fd-8161-485c-ba6d-71d24ab086bc</uuid>
Aug 14 13:46:57 user nova-compute[73484]:   <name>instance-00000014</name>
Aug 14 13:46:57 user nova-compute[73484]:   <memory>2097152</memory>
Aug 14 13:46:57 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:46:57 user nova-compute[73484]:   <metadata>
Aug 14 13:46:57 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:46:57 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:46:57 user nova-compute[73484]:       <nova:name>tempest-ServerActionsTestOtherB-server-1361765687</nova:name>
Aug 14 13:46:57 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:46:56</nova:creationTime>
Aug 14 13:46:57 user nova-compute[73484]:       <nova:flavor name="m1.small">
Aug 14 13:46:57 user nova-compute[73484]:         <nova:memory>2048</nova:memory>
Aug 14 13:46:57 user nova-compute[73484]:         <nova:disk>20</nova:disk>
Aug 14 13:46:57 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:46:57 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:46:57 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:46:57 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:46:57 user nova-compute[73484]:       <nova:owner>
Aug 14 13:46:57 user nova-compute[73484]:         <nova:user uuid="55e77cc182bc4ec79429025c6a9f14af">tempest-ServerActionsTestOtherB-1221611824-project-member</nova:user>
Aug 14 13:46:57 user nova-compute[73484]:         <nova:project uuid="a07a8a61d3f14061b44b8f37968c54e9">tempest-ServerActionsTestOtherB-1221611824</nova:project>
Aug 14 13:46:57 user nova-compute[73484]:       </nova:owner>
Aug 14 13:46:57 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:46:57 user nova-compute[73484]:       <nova:ports>
Aug 14 13:46:57 user nova-compute[73484]:         <nova:port uuid="0b54646a-71ed-4087-adf7-66645e7d2907">
Aug 14 13:46:57 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 13:46:57 user nova-compute[73484]:         </nova:port>
Aug 14 13:46:57 user nova-compute[73484]:       </nova:ports>
Aug 14 13:46:57 user nova-compute[73484]:     </nova:instance>
Aug 14 13:46:57 user nova-compute[73484]:   </metadata>
Aug 14 13:46:57 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:46:57 user nova-compute[73484]:     <system>
Aug 14 13:46:57 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:46:57 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:46:57 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:46:57 user nova-compute[73484]:       <entry name="serial">09ba29fd-8161-485c-ba6d-71d24ab086bc</entry>
Aug 14 13:46:57 user nova-compute[73484]:       <entry name="uuid">09ba29fd-8161-485c-ba6d-71d24ab086bc</entry>
Aug 14 13:46:57 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:46:57 user nova-compute[73484]:     </system>
Aug 14 13:46:57 user nova-compute[73484]:   </sysinfo>
Aug 14 13:46:57 user nova-compute[73484]:   <os>
Aug 14 13:46:57 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:46:57 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:46:57 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:46:57 user nova-compute[73484]:   </os>
Aug 14 13:46:57 user nova-compute[73484]:   <features>
Aug 14 13:46:57 user nova-compute[73484]:     <acpi/>
Aug 14 13:46:57 user nova-compute[73484]:     <apic/>
Aug 14 13:46:57 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:46:57 user nova-compute[73484]:   </features>
Aug 14 13:46:57 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:46:57 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:46:57 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:46:57 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:46:57 user nova-compute[73484]:   </clock>
Aug 14 13:46:57 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:46:57 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:46:57 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:46:57 user nova-compute[73484]:   </cpu>
Aug 14 13:46:57 user nova-compute[73484]:   <devices>
Aug 14 13:46:57 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:46:57 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:46:57 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk"/>
Aug 14 13:46:57 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:46:57 user nova-compute[73484]:     </disk>
Aug 14 13:46:57 user nova-compute[73484]:     <disk type="block" device="disk">
Aug 14 13:46:57 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:46:57 user nova-compute[73484]:       <source dev="/dev/sdc"/>
Aug 14 13:46:57 user nova-compute[73484]:       <target dev="vdb" bus="virtio"/>
Aug 14 13:46:57 user nova-compute[73484]:       <serial>b76da63f-391a-4087-8ffd-19c9648cd781</serial>
Aug 14 13:46:57 user nova-compute[73484]:     </disk>
Aug 14 13:46:57 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:46:57 user nova-compute[73484]:       <mac address="fa:16:3e:30:6a:b2"/>
Aug 14 13:46:57 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:46:57 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:46:57 user nova-compute[73484]:       <target dev="tap0b54646a-71"/>
Aug 14 13:46:57 user nova-compute[73484]:     </interface>
Aug 14 13:46:57 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:46:57 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/console.log" append="off"/>
Aug 14 13:46:57 user nova-compute[73484]:     </serial>
Aug 14 13:46:57 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:46:57 user nova-compute[73484]:     <video>
Aug 14 13:46:57 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:46:57 user nova-compute[73484]:     </video>
Aug 14 13:46:57 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:46:57 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:46:57 user nova-compute[73484]:     </rng>
Aug 14 13:46:57 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:46:57 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:46:57 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:46:57 user nova-compute[73484]:     </memballoon>
Aug 14 13:46:57 user nova-compute[73484]:   </devices>
Aug 14 13:46:57 user nova-compute[73484]: </domain>
Aug 14 13:46:57 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:46:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:42:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1361765687',display_name='tempest-ServerActionsTestOtherB-server-1361765687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1361765687',id=20,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF57s7WDcr5LrA3gfxfpgDNJt6UZ/rZhkiS+Nfi/DIO/C85ZFU7Y17ny/O/CEqdXEP2/mm1AA46PPquOjl5qC1/2wZc0eZa1Tjpvt/2IPyALMO4YPxf1Hkqx4YMdA9qx2g==',key_name='tempest-keypair-345523160',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:42:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a07a8a61d3f14061b44b8f37968c54e9',ramdisk_id='',reservation_id='r-b3zcr056',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1221611824',owner_user_name='tempest-ServerActionsTestOtherB-1221611824-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:46:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55e77cc182bc4ec79429025c6a9f14af',uuid=09ba29fd-8161-485c-ba6d-71d24ab086bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b54646a-71ed-4087-adf7-66645e7d2907", "address": "fa:16:3e:30:6a:b2", "network": {"id": "a417bb93-b1ed-47a4-be83-6679c2ea34b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872770450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-872770450-network", "vif_mac": "fa:16:3e:30:6a:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07a8a61d3f14061b44b8f37968c54e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b54646a-71", "ovs_interfaceid": "0b54646a-71ed-4087-adf7-66645e7d2907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:46:57 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Converting VIF {"id": "0b54646a-71ed-4087-adf7-66645e7d2907", "address": "fa:16:3e:30:6a:b2", "network": {"id": "a417bb93-b1ed-47a4-be83-6679c2ea34b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872770450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-872770450-network", "vif_mac": "fa:16:3e:30:6a:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07a8a61d3f14061b44b8f37968c54e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b54646a-71", "ovs_interfaceid": "0b54646a-71ed-4087-adf7-66645e7d2907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:46:57 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:6a:b2,bridge_name='br-int',has_traffic_filtering=True,id=0b54646a-71ed-4087-adf7-66645e7d2907,network=Network(a417bb93-b1ed-47a4-be83-6679c2ea34b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b54646a-71') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:46:57 user nova-compute[73484]: DEBUG os_vif [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:6a:b2,bridge_name='br-int',has_traffic_filtering=True,id=0b54646a-71ed-4087-adf7-66645e7d2907,network=Network(a417bb93-b1ed-47a4-be83-6679c2ea34b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b54646a-71') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:46:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:46:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:46:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b54646a-71, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:46:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0b54646a-71, col_values=(('external_ids', {'iface-id': '0b54646a-71ed-4087-adf7-66645e7d2907', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:6a:b2', 'vm-uuid': '09ba29fd-8161-485c-ba6d-71d24ab086bc'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:46:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:46:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:57 user nova-compute[73484]: INFO os_vif [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:6a:b2,bridge_name='br-int',has_traffic_filtering=True,id=0b54646a-71ed-4087-adf7-66645e7d2907,network=Network(a417bb93-b1ed-47a4-be83-6679c2ea34b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b54646a-71')
Aug 14 13:46:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:46:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:46:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] No VIF found with MAC fa:16:3e:30:6a:b2, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:46:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:46:59 user nova-compute[73484]: DEBUG nova.compute.manager [req-66ee06c1-6cf1-44fe-a051-a0c3221e0f9e req-9e1d7444-aa03-4630-9d6d-37aadf17455f service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Received event network-vif-plugged-0b54646a-71ed-4087-adf7-66645e7d2907 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:46:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-66ee06c1-6cf1-44fe-a051-a0c3221e0f9e req-9e1d7444-aa03-4630-9d6d-37aadf17455f service nova] Acquiring lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:46:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-66ee06c1-6cf1-44fe-a051-a0c3221e0f9e req-9e1d7444-aa03-4630-9d6d-37aadf17455f service nova] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:46:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-66ee06c1-6cf1-44fe-a051-a0c3221e0f9e req-9e1d7444-aa03-4630-9d6d-37aadf17455f service nova] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:46:59 user nova-compute[73484]: DEBUG nova.compute.manager [req-66ee06c1-6cf1-44fe-a051-a0c3221e0f9e req-9e1d7444-aa03-4630-9d6d-37aadf17455f service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] No waiting events found dispatching network-vif-plugged-0b54646a-71ed-4087-adf7-66645e7d2907 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:46:59 user nova-compute[73484]: WARNING nova.compute.manager [req-66ee06c1-6cf1-44fe-a051-a0c3221e0f9e req-9e1d7444-aa03-4630-9d6d-37aadf17455f service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Received unexpected event network-vif-plugged-0b54646a-71ed-4087-adf7-66645e7d2907 for instance with vm_state active and task_state resize_finish.
Aug 14 13:46:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:01 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020821.4155753, 09ba29fd-8161-485c-ba6d-71d24ab086bc => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:47:01 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] VM Resumed (Lifecycle Event)
Aug 14 13:47:01 user nova-compute[73484]: DEBUG nova.compute.manager [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:47:01 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Instance running successfully.
Aug 14 13:47:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Failed to set time: agent not configured {{(pid=73484) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 14 13:47:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cfbee1c4-06e4-4104-9230-5303fe3421fb tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] finish_migration finished successfully. {{(pid=73484) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 14 13:47:01 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:47:01 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:47:01 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 13:47:01 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020821.4168558, 09ba29fd-8161-485c-ba6d-71d24ab086bc => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:47:01 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] VM Started (Lifecycle Event)
Aug 14 13:47:01 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:47:01 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:47:01 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 13:47:01 user nova-compute[73484]: DEBUG nova.compute.manager [req-6c9ab252-680e-42f1-8eec-d8d63a4c698b req-a0f5d9b8-61a0-4689-9a97-bb35c2383a87 service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Received event network-vif-plugged-0b54646a-71ed-4087-adf7-66645e7d2907 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:47:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6c9ab252-680e-42f1-8eec-d8d63a4c698b req-a0f5d9b8-61a0-4689-9a97-bb35c2383a87 service nova] Acquiring lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6c9ab252-680e-42f1-8eec-d8d63a4c698b req-a0f5d9b8-61a0-4689-9a97-bb35c2383a87 service nova] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6c9ab252-680e-42f1-8eec-d8d63a4c698b req-a0f5d9b8-61a0-4689-9a97-bb35c2383a87 service nova] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:01 user nova-compute[73484]: DEBUG nova.compute.manager [req-6c9ab252-680e-42f1-8eec-d8d63a4c698b req-a0f5d9b8-61a0-4689-9a97-bb35c2383a87 service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] No waiting events found dispatching network-vif-plugged-0b54646a-71ed-4087-adf7-66645e7d2907 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:47:01 user nova-compute[73484]: WARNING nova.compute.manager [req-6c9ab252-680e-42f1-8eec-d8d63a4c698b req-a0f5d9b8-61a0-4689-9a97-bb35c2383a87 service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Received unexpected event network-vif-plugged-0b54646a-71ed-4087-adf7-66645e7d2907 for instance with vm_state resized and task_state None.
Aug 14 13:47:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:07 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:47:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "8220a084-e402-435a-b6a7-ffd94f91a211" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "8220a084-e402-435a-b6a7-ffd94f91a211" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.009s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:13 user nova-compute[73484]: INFO nova.compute.manager [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Detaching volume e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c
Aug 14 13:47:13 user nova-compute[73484]: INFO nova.virt.block_device [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Attempting to driver detach volume e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c from mountpoint /dev/vdc
Aug 14 13:47:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Attempting to detach device vdc from instance 8220a084-e402-435a-b6a7-ffd94f91a211 from the persistent domain config. {{(pid=73484) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:47:13 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:47:13 user nova-compute[73484]:   <source dev="/dev/sdd"/>
Aug 14 13:47:13 user nova-compute[73484]:   <target dev="vdc" bus="virtio"/>
Aug 14 13:47:13 user nova-compute[73484]:   <serial>e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c</serial>
Aug 14 13:47:13 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 13:47:13 user nova-compute[73484]: </disk>
Aug 14 13:47:13 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:47:13 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Successfully detached device vdc from instance 8220a084-e402-435a-b6a7-ffd94f91a211 from the persistent domain config.
Aug 14 13:47:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8220a084-e402-435a-b6a7-ffd94f91a211 from the live domain config. {{(pid=73484) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:47:13 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:47:13 user nova-compute[73484]:   <source dev="/dev/sdd"/>
Aug 14 13:47:13 user nova-compute[73484]:   <target dev="vdc" bus="virtio"/>
Aug 14 13:47:13 user nova-compute[73484]:   <serial>e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c</serial>
Aug 14 13:47:13 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 13:47:13 user nova-compute[73484]: </disk>
Aug 14 13:47:13 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG nova.compute.manager [None req-8da63fe9-64e1-4ab8-b205-cbc87675e2a4 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:47:13 user nova-compute[73484]: INFO nova.compute.manager [None req-8da63fe9-64e1-4ab8-b205-cbc87675e2a4 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] instance snapshotting
Aug 14 13:47:13 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-8da63fe9-64e1-4ab8-b205-cbc87675e2a4 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Beginning live snapshot process
Aug 14 13:47:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Received event <DeviceRemovedEvent: 1692020833.578058, 8220a084-e402-435a-b6a7-ffd94f91a211 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73484) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8220a084-e402-435a-b6a7-ffd94f91a211 {{(pid=73484) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 13:47:13 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Successfully detached device vdc from instance 8220a084-e402-435a-b6a7-ffd94f91a211 from the live domain config.
Aug 14 13:47:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XUJiMsDI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:47:13 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:47:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43e5ace-cdb6-40a4-b66e-f43937393543]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1d8ba2-98cf-4dfc-bb3f-3ba9bdc22914]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:47:13 user nova-compute[73484]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c (non-flash)
Aug 14 13:47:13 user nova-compute[73484]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:47:13 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:47:13 user nova-compute[73484]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c (non-flash)
Aug 14 13:47:13 user nova-compute[73484]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:47:13 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4951c8940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c'): ({'sdd'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Removing single pathed devices sdd {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ed93a8-13b2-4074-af25-99f22367b6a1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[442a96b1-e04b-4f89-b3c7-e1da5a7ebfa1]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Flushing IO for device /dev/sdd {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-8da63fe9-64e1-4ab8-b205-cbc87675e2a4 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json -f qcow2 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4546a3-a6b3-482a-9f29-e7b818844a1c]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45df312-fcda-4cc1-9aa8-3916fe89d3c1]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] SCSI volumes sdd have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e322714f-fd13-48f0-ad00-3f4bc0c9b04b]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[715d494e-d3bc-4fa9-9cc6-0c8369dd9f05]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c, portal: 172.16.0.220,3260]
Aug 14 13:47:13 user nova-compute[73484]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c, portal: 172.16.0.220,3260] successful.
Aug 14 13:47:13 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5fcbf55-5f5e-40c3-ac3c-c878f8a56e1c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2059bbcc-1eb0-4c5f-ad6e-a84751c1fcb9]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] <== disconnect_volume: return (317ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-8da63fe9-64e1-4ab8-b205-cbc87675e2a4 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json -f qcow2" returned: 0 in 0.219s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-8da63fe9-64e1-4ab8-b205-cbc87675e2a4 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json -f qcow2 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:14 user nova-compute[73484]: INFO nova.compute.manager [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Rescuing
Aug 14 13:47:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "refresh_cache-03255d24-b6fd-459c-8ac6-f9c4063b54b2" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:47:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquired lock "refresh_cache-03255d24-b6fd-459c-8ac6-f9c4063b54b2" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:47:14 user nova-compute[73484]: DEBUG nova.network.neutron [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:47:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-8da63fe9-64e1-4ab8-b205-cbc87675e2a4 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-8da63fe9-64e1-4ab8-b205-cbc87675e2a4 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-8da63fe9-64e1-4ab8-b205-cbc87675e2a4 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.170s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-8da63fe9-64e1-4ab8-b205-cbc87675e2a4 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_yy6yf85/80a4dcbd602b433c94dae9016c3858ea.delta 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-8da63fe9-64e1-4ab8-b205-cbc87675e2a4 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_yy6yf85/80a4dcbd602b433c94dae9016c3858ea.delta 1073741824" returned: 0 in 0.054s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:14 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-8da63fe9-64e1-4ab8-b205-cbc87675e2a4 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 13:47:14 user nova-compute[73484]: DEBUG nova.network.neutron [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Updating instance_info_cache with network_info: [{"id": "be08ca28-6a00-468c-9988-87185f498ca3", "address": "fa:16:3e:66:27:2e", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe08ca28-6a", "ovs_interfaceid": "be08ca28-6a00-468c-9988-87185f498ca3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:47:14 user nova-compute[73484]: DEBUG nova.objects.instance [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lazy-loading 'flavor' on Instance uuid 8220a084-e402-435a-b6a7-ffd94f91a211 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:47:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Releasing lock "refresh_cache-03255d24-b6fd-459c-8ac6-f9c4063b54b2" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:47:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6f6afa8d-eb84-4a03-afdc-515aa847e25f tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "8220a084-e402-435a-b6a7-ffd94f91a211" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.757s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG nova.compute.manager [req-bc437b7c-a1e9-4e28-81ec-32ed45161d21 req-0bac03b8-2b62-475d-9f0b-4c6ed71b0fc9 service nova] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Received event network-vif-unplugged-be08ca28-6a00-468c-9988-87185f498ca3 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-bc437b7c-a1e9-4e28-81ec-32ed45161d21 req-0bac03b8-2b62-475d-9f0b-4c6ed71b0fc9 service nova] Acquiring lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-bc437b7c-a1e9-4e28-81ec-32ed45161d21 req-0bac03b8-2b62-475d-9f0b-4c6ed71b0fc9 service nova] Lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-bc437b7c-a1e9-4e28-81ec-32ed45161d21 req-0bac03b8-2b62-475d-9f0b-4c6ed71b0fc9 service nova] Lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG nova.compute.manager [req-bc437b7c-a1e9-4e28-81ec-32ed45161d21 req-0bac03b8-2b62-475d-9f0b-4c6ed71b0fc9 service nova] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] No waiting events found dispatching network-vif-unplugged-be08ca28-6a00-468c-9988-87185f498ca3 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:47:15 user nova-compute[73484]: WARNING nova.compute.manager [req-bc437b7c-a1e9-4e28-81ec-32ed45161d21 req-0bac03b8-2b62-475d-9f0b-4c6ed71b0fc9 service nova] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Received unexpected event network-vif-unplugged-be08ca28-6a00-468c-9988-87185f498ca3 for instance with vm_state active and task_state rescuing.
Aug 14 13:47:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-8da63fe9-64e1-4ab8-b205-cbc87675e2a4 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73484) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:15 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Instance destroyed successfully.
Aug 14 13:47:15 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Attempting rescue
Aug 14 13:47:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73484) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Instance directory exists: not creating {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 13:47:15 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Creating image(s)
Aug 14 13:47:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "/opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "/opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "/opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG nova.objects.instance [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'trusted_certs' on Instance uuid 03255d24-b6fd-459c-8ac6-f9c4063b54b2 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-8da63fe9-64e1-4ab8-b205-cbc87675e2a4 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73484) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 13:47:15 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-8da63fe9-64e1-4ab8-b205-cbc87675e2a4 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 13:47:15 user nova-compute[73484]: DEBUG nova.privsep.utils [None req-8da63fe9-64e1-4ab8-b205-cbc87675e2a4 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73484) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-8da63fe9-64e1-4ab8-b205-cbc87675e2a4 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_yy6yf85/80a4dcbd602b433c94dae9016c3858ea.delta /opt/stack/data/nova/instances/snapshots/tmp_yy6yf85/80a4dcbd602b433c94dae9016c3858ea {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.203s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue" returned: 0 in 0.059s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG nova.objects.instance [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'migration_context' on Instance uuid 03255d24-b6fd-459c-8ac6-f9c4063b54b2 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Start _get_guest_xml network_info=[{"id": "be08ca28-6a00-468c-9988-87185f498ca3", "address": "fa:16:3e:66:27:2e", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "vif_mac": "fa:16:3e:66:27:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe08ca28-6a", "ovs_interfaceid": "be08ca28-6a00-468c-9988-87185f498ca3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '35547d66-318f-468f-9286-e10554f69bf8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG nova.objects.instance [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'resources' on Instance uuid 03255d24-b6fd-459c-8ac6-f9c4063b54b2 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG nova.objects.instance [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'numa_topology' on Instance uuid 03255d24-b6fd-459c-8ac6-f9c4063b54b2 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:47:15 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:47:15 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:47:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:47:15 user nova-compute[73484]: DEBUG nova.objects.instance [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'vcpu_model' on Instance uuid 03255d24-b6fd-459c-8ac6-f9c4063b54b2 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:47:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1759674947',display_name='tempest-ServerRescueNegativeTestJSON-server-1759674947',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1759674947',id=25,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:45:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f4df46bcfb843b7ac6c17d106703950',ramdisk_id='',reservation_id='r-yok2frut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-496474583',owner_user_name='tempest-ServerRescueNegativeTestJSON-496474583-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:45:34Z,user_data=None,user_id='45d86b9371024e3d95ece74ccb2c37d9',uuid=03255d24-b6fd-459c-8ac6-f9c4063b54b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be08ca28-6a00-468c-9988-87185f498ca3", "address": "fa:16:3e:66:27:2e", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "vif_mac": "fa:16:3e:66:27:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe08ca28-6a", "ovs_interfaceid": "be08ca28-6a00-468c-9988-87185f498ca3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:47:16 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Converting VIF {"id": "be08ca28-6a00-468c-9988-87185f498ca3", "address": "fa:16:3e:66:27:2e", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "vif_mac": "fa:16:3e:66:27:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe08ca28-6a", "ovs_interfaceid": "be08ca28-6a00-468c-9988-87185f498ca3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:47:16 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:27:2e,bridge_name='br-int',has_traffic_filtering=True,id=be08ca28-6a00-468c-9988-87185f498ca3,network=Network(cad53782-5ecf-4140-b113-62e807bf87df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe08ca28-6a') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:47:16 user nova-compute[73484]: DEBUG nova.objects.instance [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'pci_devices' on Instance uuid 03255d24-b6fd-459c-8ac6-f9c4063b54b2 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:47:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:47:16 user nova-compute[73484]:   <uuid>03255d24-b6fd-459c-8ac6-f9c4063b54b2</uuid>
Aug 14 13:47:16 user nova-compute[73484]:   <name>instance-00000019</name>
Aug 14 13:47:16 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:47:16 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:47:16 user nova-compute[73484]:   <metadata>
Aug 14 13:47:16 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:47:16 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:47:16 user nova-compute[73484]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1759674947</nova:name>
Aug 14 13:47:16 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:47:15</nova:creationTime>
Aug 14 13:47:16 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:47:16 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:47:16 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:47:16 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:47:16 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:47:16 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:47:16 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:47:16 user nova-compute[73484]:       <nova:owner>
Aug 14 13:47:16 user nova-compute[73484]:         <nova:user uuid="45d86b9371024e3d95ece74ccb2c37d9">tempest-ServerRescueNegativeTestJSON-496474583-project-member</nova:user>
Aug 14 13:47:16 user nova-compute[73484]:         <nova:project uuid="0f4df46bcfb843b7ac6c17d106703950">tempest-ServerRescueNegativeTestJSON-496474583</nova:project>
Aug 14 13:47:16 user nova-compute[73484]:       </nova:owner>
Aug 14 13:47:16 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:47:16 user nova-compute[73484]:       <nova:ports>
Aug 14 13:47:16 user nova-compute[73484]:         <nova:port uuid="be08ca28-6a00-468c-9988-87185f498ca3">
Aug 14 13:47:16 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 13:47:16 user nova-compute[73484]:         </nova:port>
Aug 14 13:47:16 user nova-compute[73484]:       </nova:ports>
Aug 14 13:47:16 user nova-compute[73484]:     </nova:instance>
Aug 14 13:47:16 user nova-compute[73484]:   </metadata>
Aug 14 13:47:16 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:47:16 user nova-compute[73484]:     <system>
Aug 14 13:47:16 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:47:16 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:47:16 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:47:16 user nova-compute[73484]:       <entry name="serial">03255d24-b6fd-459c-8ac6-f9c4063b54b2</entry>
Aug 14 13:47:16 user nova-compute[73484]:       <entry name="uuid">03255d24-b6fd-459c-8ac6-f9c4063b54b2</entry>
Aug 14 13:47:16 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:47:16 user nova-compute[73484]:     </system>
Aug 14 13:47:16 user nova-compute[73484]:   </sysinfo>
Aug 14 13:47:16 user nova-compute[73484]:   <os>
Aug 14 13:47:16 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:47:16 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:47:16 user nova-compute[73484]:   </os>
Aug 14 13:47:16 user nova-compute[73484]:   <features>
Aug 14 13:47:16 user nova-compute[73484]:     <acpi/>
Aug 14 13:47:16 user nova-compute[73484]:     <apic/>
Aug 14 13:47:16 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:47:16 user nova-compute[73484]:   </features>
Aug 14 13:47:16 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:47:16 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:47:16 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:47:16 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:47:16 user nova-compute[73484]:   </clock>
Aug 14 13:47:16 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:47:16 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:47:16 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:47:16 user nova-compute[73484]:   </cpu>
Aug 14 13:47:16 user nova-compute[73484]:   <devices>
Aug 14 13:47:16 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:47:16 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:47:16 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue"/>
Aug 14 13:47:16 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:47:16 user nova-compute[73484]:     </disk>
Aug 14 13:47:16 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:47:16 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:47:16 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk"/>
Aug 14 13:47:16 user nova-compute[73484]:       <target dev="vdb" bus="virtio"/>
Aug 14 13:47:16 user nova-compute[73484]:     </disk>
Aug 14 13:47:16 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:47:16 user nova-compute[73484]:       <mac address="fa:16:3e:66:27:2e"/>
Aug 14 13:47:16 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:47:16 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:47:16 user nova-compute[73484]:       <target dev="tapbe08ca28-6a"/>
Aug 14 13:47:16 user nova-compute[73484]:     </interface>
Aug 14 13:47:16 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:47:16 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/console.log" append="off"/>
Aug 14 13:47:16 user nova-compute[73484]:     </serial>
Aug 14 13:47:16 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:47:16 user nova-compute[73484]:     <video>
Aug 14 13:47:16 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:47:16 user nova-compute[73484]:     </video>
Aug 14 13:47:16 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:47:16 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:47:16 user nova-compute[73484]:     </rng>
Aug 14 13:47:16 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:47:16 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:47:16 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:47:16 user nova-compute[73484]:     </memballoon>
Aug 14 13:47:16 user nova-compute[73484]:   </devices>
Aug 14 13:47:16 user nova-compute[73484]: </domain>
Aug 14 13:47:16 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:47:16 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Instance destroyed successfully.
Aug 14 13:47:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:47:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:47:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] No VIF found with MAC fa:16:3e:66:27:2e, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:47:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-8da63fe9-64e1-4ab8-b205-cbc87675e2a4 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_yy6yf85/80a4dcbd602b433c94dae9016c3858ea.delta /opt/stack/data/nova/instances/snapshots/tmp_yy6yf85/80a4dcbd602b433c94dae9016c3858ea" returned: 0 in 0.524s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:16 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-8da63fe9-64e1-4ab8-b205-cbc87675e2a4 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Snapshot extracted, beginning image upload
Aug 14 13:47:17 user nova-compute[73484]: DEBUG nova.compute.manager [req-f1832300-8adc-4293-8103-7420d157f500 req-2d5d3295-415c-4e1c-a398-aa112a1326f5 service nova] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Received event network-vif-plugged-be08ca28-6a00-468c-9988-87185f498ca3 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:47:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f1832300-8adc-4293-8103-7420d157f500 req-2d5d3295-415c-4e1c-a398-aa112a1326f5 service nova] Acquiring lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f1832300-8adc-4293-8103-7420d157f500 req-2d5d3295-415c-4e1c-a398-aa112a1326f5 service nova] Lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f1832300-8adc-4293-8103-7420d157f500 req-2d5d3295-415c-4e1c-a398-aa112a1326f5 service nova] Lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:17 user nova-compute[73484]: DEBUG nova.compute.manager [req-f1832300-8adc-4293-8103-7420d157f500 req-2d5d3295-415c-4e1c-a398-aa112a1326f5 service nova] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] No waiting events found dispatching network-vif-plugged-be08ca28-6a00-468c-9988-87185f498ca3 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:47:17 user nova-compute[73484]: WARNING nova.compute.manager [req-f1832300-8adc-4293-8103-7420d157f500 req-2d5d3295-415c-4e1c-a398-aa112a1326f5 service nova] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Received unexpected event network-vif-plugged-be08ca28-6a00-468c-9988-87185f498ca3 for instance with vm_state active and task_state rescuing.
Aug 14 13:47:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:19 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-8da63fe9-64e1-4ab8-b205-cbc87675e2a4 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Snapshot image upload complete
Aug 14 13:47:19 user nova-compute[73484]: INFO nova.compute.manager [None req-8da63fe9-64e1-4ab8-b205-cbc87675e2a4 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Took 5.79 seconds to snapshot the instance on the hypervisor.
Aug 14 13:47:19 user nova-compute[73484]: DEBUG nova.compute.manager [req-52617e02-e2e0-45e5-94d5-defaf00370a8 req-e3234a65-2535-45ac-b556-9a4d86ba6fc0 service nova] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Received event network-vif-plugged-be08ca28-6a00-468c-9988-87185f498ca3 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:47:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-52617e02-e2e0-45e5-94d5-defaf00370a8 req-e3234a65-2535-45ac-b556-9a4d86ba6fc0 service nova] Acquiring lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-52617e02-e2e0-45e5-94d5-defaf00370a8 req-e3234a65-2535-45ac-b556-9a4d86ba6fc0 service nova] Lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-52617e02-e2e0-45e5-94d5-defaf00370a8 req-e3234a65-2535-45ac-b556-9a4d86ba6fc0 service nova] Lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:19 user nova-compute[73484]: DEBUG nova.compute.manager [req-52617e02-e2e0-45e5-94d5-defaf00370a8 req-e3234a65-2535-45ac-b556-9a4d86ba6fc0 service nova] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] No waiting events found dispatching network-vif-plugged-be08ca28-6a00-468c-9988-87185f498ca3 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:47:19 user nova-compute[73484]: WARNING nova.compute.manager [req-52617e02-e2e0-45e5-94d5-defaf00370a8 req-e3234a65-2535-45ac-b556-9a4d86ba6fc0 service nova] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Received unexpected event network-vif-plugged-be08ca28-6a00-468c-9988-87185f498ca3 for instance with vm_state active and task_state rescuing.
Aug 14 13:47:19 user nova-compute[73484]: DEBUG nova.compute.manager [req-52617e02-e2e0-45e5-94d5-defaf00370a8 req-e3234a65-2535-45ac-b556-9a4d86ba6fc0 service nova] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Received event network-vif-plugged-be08ca28-6a00-468c-9988-87185f498ca3 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:47:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-52617e02-e2e0-45e5-94d5-defaf00370a8 req-e3234a65-2535-45ac-b556-9a4d86ba6fc0 service nova] Acquiring lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-52617e02-e2e0-45e5-94d5-defaf00370a8 req-e3234a65-2535-45ac-b556-9a4d86ba6fc0 service nova] Lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-52617e02-e2e0-45e5-94d5-defaf00370a8 req-e3234a65-2535-45ac-b556-9a4d86ba6fc0 service nova] Lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:19 user nova-compute[73484]: DEBUG nova.compute.manager [req-52617e02-e2e0-45e5-94d5-defaf00370a8 req-e3234a65-2535-45ac-b556-9a4d86ba6fc0 service nova] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] No waiting events found dispatching network-vif-plugged-be08ca28-6a00-468c-9988-87185f498ca3 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:47:19 user nova-compute[73484]: WARNING nova.compute.manager [req-52617e02-e2e0-45e5-94d5-defaf00370a8 req-e3234a65-2535-45ac-b556-9a4d86ba6fc0 service nova] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Received unexpected event network-vif-plugged-be08ca28-6a00-468c-9988-87185f498ca3 for instance with vm_state active and task_state rescuing.
Aug 14 13:47:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-547d0610-6727-4292-89b6-145697ff91c1 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Acquiring lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-547d0610-6727-4292-89b6-145697ff91c1 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-547d0610-6727-4292-89b6-145697ff91c1 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Acquiring lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-547d0610-6727-4292-89b6-145697ff91c1 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-547d0610-6727-4292-89b6-145697ff91c1 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:19 user nova-compute[73484]: INFO nova.compute.manager [None req-547d0610-6727-4292-89b6-145697ff91c1 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Terminating instance
Aug 14 13:47:19 user nova-compute[73484]: DEBUG nova.compute.manager [None req-547d0610-6727-4292-89b6-145697ff91c1 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:47:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:20 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Removed pending event for 03255d24-b6fd-459c-8ac6-f9c4063b54b2 due to event {{(pid=73484) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 13:47:20 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020839.99991, 03255d24-b6fd-459c-8ac6-f9c4063b54b2 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:47:20 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] VM Resumed (Lifecycle Event)
Aug 14 13:47:20 user nova-compute[73484]: DEBUG nova.compute.manager [None req-b9bd67d7-60eb-4be6-b92e-049d1cdf8e54 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:47:20 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:47:20 user nova-compute[73484]: DEBUG nova.compute.manager [req-f9197d75-1f11-43ea-8387-46f3aad76fda req-65f4d392-9444-4830-a644-22c280a96874 service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Received event network-vif-unplugged-64496447-3d0b-4259-9c93-8ec02b4546fc {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:47:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f9197d75-1f11-43ea-8387-46f3aad76fda req-65f4d392-9444-4830-a644-22c280a96874 service nova] Acquiring lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f9197d75-1f11-43ea-8387-46f3aad76fda req-65f4d392-9444-4830-a644-22c280a96874 service nova] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f9197d75-1f11-43ea-8387-46f3aad76fda req-65f4d392-9444-4830-a644-22c280a96874 service nova] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:20 user nova-compute[73484]: DEBUG nova.compute.manager [req-f9197d75-1f11-43ea-8387-46f3aad76fda req-65f4d392-9444-4830-a644-22c280a96874 service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] No waiting events found dispatching network-vif-unplugged-64496447-3d0b-4259-9c93-8ec02b4546fc {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:47:20 user nova-compute[73484]: DEBUG nova.compute.manager [req-f9197d75-1f11-43ea-8387-46f3aad76fda req-65f4d392-9444-4830-a644-22c280a96874 service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Received event network-vif-unplugged-64496447-3d0b-4259-9c93-8ec02b4546fc for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:47:20 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:47:20 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020840.0016015, 03255d24-b6fd-459c-8ac6-f9c4063b54b2 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:47:20 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] VM Started (Lifecycle Event)
Aug 14 13:47:20 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:47:20 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:47:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:20 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Instance destroyed successfully.
Aug 14 13:47:20 user nova-compute[73484]: DEBUG nova.objects.instance [None req-547d0610-6727-4292-89b6-145697ff91c1 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lazy-loading 'resources' on Instance uuid 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:47:20 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-547d0610-6727-4292-89b6-145697ff91c1 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:43:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1201110003',display_name='tempest-TestServerVolumeAttachmentScenario-server-1201110003',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1201110003',id=22,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbJl0OsE95v2l+0E7uoqvsxmbv+fCBq04O9af6L0/mlkoLfZt2IOfPAv00RyP1IPcgIsQGEkY0DTj7yso5i/H8jKYHqzAtF2OVQK+/ri+v79OFi31EZVuGoGlvUG1xL6w==',key_name='tempest-keypair-1804530879',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:43:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a26adad8a3f8460c9e0bf53812d66c9c',ramdisk_id='',reservation_id='r-44la7o7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-529492929',owner_user_name='tempest-TestServerVolumeAttachmentScenario-529492929-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:43:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36d93382bc5744769f45a6255e7b4bd3',uuid=9eed5f58-f09b-419a-ba10-7b1dd6f27f7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64496447-3d0b-4259-9c93-8ec02b4546fc", "address": "fa:16:3e:69:48:02", "network": {"id": "dcba25a0-5382-48d6-a1b3-7115a3eab557", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1037577426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26adad8a3f8460c9e0bf53812d66c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64496447-3d", "ovs_interfaceid": "64496447-3d0b-4259-9c93-8ec02b4546fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:47:20 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-547d0610-6727-4292-89b6-145697ff91c1 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Converting VIF {"id": "64496447-3d0b-4259-9c93-8ec02b4546fc", "address": "fa:16:3e:69:48:02", "network": {"id": "dcba25a0-5382-48d6-a1b3-7115a3eab557", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1037577426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26adad8a3f8460c9e0bf53812d66c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64496447-3d", "ovs_interfaceid": "64496447-3d0b-4259-9c93-8ec02b4546fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:47:20 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-547d0610-6727-4292-89b6-145697ff91c1 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:48:02,bridge_name='br-int',has_traffic_filtering=True,id=64496447-3d0b-4259-9c93-8ec02b4546fc,network=Network(dcba25a0-5382-48d6-a1b3-7115a3eab557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64496447-3d') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:47:20 user nova-compute[73484]: DEBUG os_vif [None req-547d0610-6727-4292-89b6-145697ff91c1 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:48:02,bridge_name='br-int',has_traffic_filtering=True,id=64496447-3d0b-4259-9c93-8ec02b4546fc,network=Network(dcba25a0-5382-48d6-a1b3-7115a3eab557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64496447-3d') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:47:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64496447-3d, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:47:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:47:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:20 user nova-compute[73484]: INFO os_vif [None req-547d0610-6727-4292-89b6-145697ff91c1 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:48:02,bridge_name='br-int',has_traffic_filtering=True,id=64496447-3d0b-4259-9c93-8ec02b4546fc,network=Network(dcba25a0-5382-48d6-a1b3-7115a3eab557),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64496447-3d')
Aug 14 13:47:20 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-547d0610-6727-4292-89b6-145697ff91c1 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Deleting instance files /opt/stack/data/nova/instances/9eed5f58-f09b-419a-ba10-7b1dd6f27f7f_del
Aug 14 13:47:20 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-547d0610-6727-4292-89b6-145697ff91c1 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Deletion of /opt/stack/data/nova/instances/9eed5f58-f09b-419a-ba10-7b1dd6f27f7f_del complete
Aug 14 13:47:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:20 user nova-compute[73484]: INFO nova.compute.manager [None req-547d0610-6727-4292-89b6-145697ff91c1 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 14 13:47:20 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-547d0610-6727-4292-89b6-145697ff91c1 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:47:20 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:47:20 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:47:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:21 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:47:21 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Took 1.01 seconds to deallocate network for instance.
Aug 14 13:47:21 user nova-compute[73484]: DEBUG nova.compute.manager [req-42ecbd4d-941f-4aee-969d-dc5d5c36fee0 req-0cdfb864-b93c-4913-b0d3-7c3194376041 service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Received event network-vif-deleted-64496447-3d0b-4259-9c93-8ec02b4546fc {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:47:21 user nova-compute[73484]: INFO nova.compute.manager [req-42ecbd4d-941f-4aee-969d-dc5d5c36fee0 req-0cdfb864-b93c-4913-b0d3-7c3194376041 service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Neutron deleted interface 64496447-3d0b-4259-9c93-8ec02b4546fc; detaching it from the instance and deleting it from the info cache
Aug 14 13:47:21 user nova-compute[73484]: DEBUG nova.network.neutron [req-42ecbd4d-941f-4aee-969d-dc5d5c36fee0 req-0cdfb864-b93c-4913-b0d3-7c3194376041 service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:47:21 user nova-compute[73484]: DEBUG nova.compute.manager [req-42ecbd4d-941f-4aee-969d-dc5d5c36fee0 req-0cdfb864-b93c-4913-b0d3-7c3194376041 service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Detach interface failed, port_id=64496447-3d0b-4259-9c93-8ec02b4546fc, reason: Instance 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f could not be found. {{(pid=73484) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 13:47:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-547d0610-6727-4292-89b6-145697ff91c1 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-547d0610-6727-4292-89b6-145697ff91c1 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:22 user nova-compute[73484]: DEBUG nova.compute.manager [req-1a24e683-6e19-433d-a6b9-9aee943a27ca req-63ec8678-d56d-4ea8-980d-250779a53789 service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Received event network-vif-plugged-64496447-3d0b-4259-9c93-8ec02b4546fc {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:47:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1a24e683-6e19-433d-a6b9-9aee943a27ca req-63ec8678-d56d-4ea8-980d-250779a53789 service nova] Acquiring lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1a24e683-6e19-433d-a6b9-9aee943a27ca req-63ec8678-d56d-4ea8-980d-250779a53789 service nova] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1a24e683-6e19-433d-a6b9-9aee943a27ca req-63ec8678-d56d-4ea8-980d-250779a53789 service nova] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:22 user nova-compute[73484]: DEBUG nova.compute.manager [req-1a24e683-6e19-433d-a6b9-9aee943a27ca req-63ec8678-d56d-4ea8-980d-250779a53789 service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] No waiting events found dispatching network-vif-plugged-64496447-3d0b-4259-9c93-8ec02b4546fc {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:47:22 user nova-compute[73484]: WARNING nova.compute.manager [req-1a24e683-6e19-433d-a6b9-9aee943a27ca req-63ec8678-d56d-4ea8-980d-250779a53789 service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Received unexpected event network-vif-plugged-64496447-3d0b-4259-9c93-8ec02b4546fc for instance with vm_state deleted and task_state None.
Aug 14 13:47:22 user nova-compute[73484]: DEBUG nova.compute.manager [req-1a24e683-6e19-433d-a6b9-9aee943a27ca req-63ec8678-d56d-4ea8-980d-250779a53789 service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Received event network-vif-plugged-64496447-3d0b-4259-9c93-8ec02b4546fc {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:47:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1a24e683-6e19-433d-a6b9-9aee943a27ca req-63ec8678-d56d-4ea8-980d-250779a53789 service nova] Acquiring lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1a24e683-6e19-433d-a6b9-9aee943a27ca req-63ec8678-d56d-4ea8-980d-250779a53789 service nova] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1a24e683-6e19-433d-a6b9-9aee943a27ca req-63ec8678-d56d-4ea8-980d-250779a53789 service nova] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:22 user nova-compute[73484]: DEBUG nova.compute.manager [req-1a24e683-6e19-433d-a6b9-9aee943a27ca req-63ec8678-d56d-4ea8-980d-250779a53789 service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] No waiting events found dispatching network-vif-plugged-64496447-3d0b-4259-9c93-8ec02b4546fc {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:47:22 user nova-compute[73484]: WARNING nova.compute.manager [req-1a24e683-6e19-433d-a6b9-9aee943a27ca req-63ec8678-d56d-4ea8-980d-250779a53789 service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Received unexpected event network-vif-plugged-64496447-3d0b-4259-9c93-8ec02b4546fc for instance with vm_state deleted and task_state None.
Aug 14 13:47:22 user nova-compute[73484]: DEBUG nova.compute.manager [req-1a24e683-6e19-433d-a6b9-9aee943a27ca req-63ec8678-d56d-4ea8-980d-250779a53789 service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Received event network-vif-plugged-64496447-3d0b-4259-9c93-8ec02b4546fc {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:47:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1a24e683-6e19-433d-a6b9-9aee943a27ca req-63ec8678-d56d-4ea8-980d-250779a53789 service nova] Acquiring lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1a24e683-6e19-433d-a6b9-9aee943a27ca req-63ec8678-d56d-4ea8-980d-250779a53789 service nova] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1a24e683-6e19-433d-a6b9-9aee943a27ca req-63ec8678-d56d-4ea8-980d-250779a53789 service nova] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:22 user nova-compute[73484]: DEBUG nova.compute.manager [req-1a24e683-6e19-433d-a6b9-9aee943a27ca req-63ec8678-d56d-4ea8-980d-250779a53789 service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] No waiting events found dispatching network-vif-plugged-64496447-3d0b-4259-9c93-8ec02b4546fc {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:47:22 user nova-compute[73484]: WARNING nova.compute.manager [req-1a24e683-6e19-433d-a6b9-9aee943a27ca req-63ec8678-d56d-4ea8-980d-250779a53789 service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Received unexpected event network-vif-plugged-64496447-3d0b-4259-9c93-8ec02b4546fc for instance with vm_state deleted and task_state None.
Aug 14 13:47:22 user nova-compute[73484]: DEBUG nova.compute.manager [req-1a24e683-6e19-433d-a6b9-9aee943a27ca req-63ec8678-d56d-4ea8-980d-250779a53789 service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Received event network-vif-unplugged-64496447-3d0b-4259-9c93-8ec02b4546fc {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:47:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1a24e683-6e19-433d-a6b9-9aee943a27ca req-63ec8678-d56d-4ea8-980d-250779a53789 service nova] Acquiring lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1a24e683-6e19-433d-a6b9-9aee943a27ca req-63ec8678-d56d-4ea8-980d-250779a53789 service nova] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1a24e683-6e19-433d-a6b9-9aee943a27ca req-63ec8678-d56d-4ea8-980d-250779a53789 service nova] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:22 user nova-compute[73484]: DEBUG nova.compute.manager [req-1a24e683-6e19-433d-a6b9-9aee943a27ca req-63ec8678-d56d-4ea8-980d-250779a53789 service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] No waiting events found dispatching network-vif-unplugged-64496447-3d0b-4259-9c93-8ec02b4546fc {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:47:22 user nova-compute[73484]: WARNING nova.compute.manager [req-1a24e683-6e19-433d-a6b9-9aee943a27ca req-63ec8678-d56d-4ea8-980d-250779a53789 service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Received unexpected event network-vif-unplugged-64496447-3d0b-4259-9c93-8ec02b4546fc for instance with vm_state deleted and task_state None.
Aug 14 13:47:22 user nova-compute[73484]: DEBUG nova.compute.manager [req-1a24e683-6e19-433d-a6b9-9aee943a27ca req-63ec8678-d56d-4ea8-980d-250779a53789 service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Received event network-vif-plugged-64496447-3d0b-4259-9c93-8ec02b4546fc {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:47:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1a24e683-6e19-433d-a6b9-9aee943a27ca req-63ec8678-d56d-4ea8-980d-250779a53789 service nova] Acquiring lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1a24e683-6e19-433d-a6b9-9aee943a27ca req-63ec8678-d56d-4ea8-980d-250779a53789 service nova] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1a24e683-6e19-433d-a6b9-9aee943a27ca req-63ec8678-d56d-4ea8-980d-250779a53789 service nova] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:22 user nova-compute[73484]: DEBUG nova.compute.manager [req-1a24e683-6e19-433d-a6b9-9aee943a27ca req-63ec8678-d56d-4ea8-980d-250779a53789 service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] No waiting events found dispatching network-vif-plugged-64496447-3d0b-4259-9c93-8ec02b4546fc {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:47:22 user nova-compute[73484]: WARNING nova.compute.manager [req-1a24e683-6e19-433d-a6b9-9aee943a27ca req-63ec8678-d56d-4ea8-980d-250779a53789 service nova] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Received unexpected event network-vif-plugged-64496447-3d0b-4259-9c93-8ec02b4546fc for instance with vm_state deleted and task_state None.
Aug 14 13:47:22 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-547d0610-6727-4292-89b6-145697ff91c1 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:47:22 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-547d0610-6727-4292-89b6-145697ff91c1 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:47:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-547d0610-6727-4292-89b6-145697ff91c1 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:22 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-547d0610-6727-4292-89b6-145697ff91c1 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Deleted allocations for instance 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f
Aug 14 13:47:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-547d0610-6727-4292-89b6-145697ff91c1 tempest-TestServerVolumeAttachmentScenario-529492929 tempest-TestServerVolumeAttachmentScenario-529492929-project-member] Lock "9eed5f58-f09b-419a-ba10-7b1dd6f27f7f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.702s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:30 user nova-compute[73484]: DEBUG nova.compute.manager [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:47:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:30 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:47:30 user nova-compute[73484]: INFO nova.compute.claims [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Claim successful on node user
Aug 14 13:47:31 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:47:31 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:47:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:31 user nova-compute[73484]: DEBUG nova.compute.manager [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:47:31 user nova-compute[73484]: DEBUG nova.compute.manager [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:47:31 user nova-compute[73484]: DEBUG nova.network.neutron [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:47:31 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:47:31 user nova-compute[73484]: DEBUG nova.compute.manager [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:47:31 user nova-compute[73484]: DEBUG nova.policy [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fac94bacad00447d9743d8a44118ea47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2114819cda450ca1827ddd5557da23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:47:31 user nova-compute[73484]: DEBUG nova.compute.manager [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:47:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:47:31 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Creating image(s)
Aug 14 13:47:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "/opt/stack/data/nova/instances/2545f107-974a-4ee8-ba9b-7d7f7bb1ae91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "/opt/stack/data/nova/instances/2545f107-974a-4ee8-ba9b-7d7f7bb1ae91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "/opt/stack/data/nova/instances/2545f107-974a-4ee8-ba9b-7d7f7bb1ae91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.187s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:31 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:47:31 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73484) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 13:47:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.219s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/2545f107-974a-4ee8-ba9b-7d7f7bb1ae91/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/2545f107-974a-4ee8-ba9b-7d7f7bb1ae91/disk 1073741824" returned: 0 in 0.072s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:32 user nova-compute[73484]: DEBUG nova.network.neutron [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Successfully created port: 3a7e7a5d-c80e-427f-96fe-92670978d8ee {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:47:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.176s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:32 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2545f107-974a-4ee8-ba9b-7d7f7bb1ae91/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:47:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2545f107-974a-4ee8-ba9b-7d7f7bb1ae91/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2545f107-974a-4ee8-ba9b-7d7f7bb1ae91/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:32 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Cannot resize image /opt/stack/data/nova/instances/2545f107-974a-4ee8-ba9b-7d7f7bb1ae91/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:47:32 user nova-compute[73484]: DEBUG nova.objects.instance [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'migration_context' on Instance uuid 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:47:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:47:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Ensure instance console log exists: /opt/stack/data/nova/instances/2545f107-974a-4ee8-ba9b-7d7f7bb1ae91/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:47:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "700e95c1-08b0-4613-992b-4314b127e14a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "700e95c1-08b0-4613-992b-4314b127e14a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:32 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:47:33 user nova-compute[73484]: INFO nova.compute.claims [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Claim successful on node user
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.network.neutron [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Successfully updated port: 3a7e7a5d-c80e-427f-96fe-92670978d8ee {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "refresh_cache-2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquired lock "refresh_cache-2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.network.neutron [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.compute.manager [req-88c6e411-ff4d-4cd1-a5bc-ccbc007ab5ef req-e5d8a1dc-165d-42c4-8d07-3ffc349d0622 service nova] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Received event network-changed-3a7e7a5d-c80e-427f-96fe-92670978d8ee {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.compute.manager [req-88c6e411-ff4d-4cd1-a5bc-ccbc007ab5ef req-e5d8a1dc-165d-42c4-8d07-3ffc349d0622 service nova] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Refreshing instance network info cache due to event network-changed-3a7e7a5d-c80e-427f-96fe-92670978d8ee. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-88c6e411-ff4d-4cd1-a5bc-ccbc007ab5ef req-e5d8a1dc-165d-42c4-8d07-3ffc349d0622 service nova] Acquiring lock "refresh_cache-2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.network.neutron [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.network.neutron [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Updating instance_info_cache with network_info: [{"id": "3a7e7a5d-c80e-427f-96fe-92670978d8ee", "address": "fa:16:3e:cb:14:c8", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7e7a5d-c8", "ovs_interfaceid": "3a7e7a5d-c80e-427f-96fe-92670978d8ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.network.neutron [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Releasing lock "refresh_cache-2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.compute.manager [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Instance network_info: |[{"id": "3a7e7a5d-c80e-427f-96fe-92670978d8ee", "address": "fa:16:3e:cb:14:c8", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7e7a5d-c8", "ovs_interfaceid": "3a7e7a5d-c80e-427f-96fe-92670978d8ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-88c6e411-ff4d-4cd1-a5bc-ccbc007ab5ef req-e5d8a1dc-165d-42c4-8d07-3ffc349d0622 service nova] Acquired lock "refresh_cache-2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.network.neutron [req-88c6e411-ff4d-4cd1-a5bc-ccbc007ab5ef req-e5d8a1dc-165d-42c4-8d07-3ffc349d0622 service nova] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Refreshing network info cache for port 3a7e7a5d-c80e-427f-96fe-92670978d8ee {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Start _get_guest_xml network_info=[{"id": "3a7e7a5d-c80e-427f-96fe-92670978d8ee", "address": "fa:16:3e:cb:14:c8", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7e7a5d-c8", "ovs_interfaceid": "3a7e7a5d-c80e-427f-96fe-92670978d8ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:47:33 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:47:33 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:47:33 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:47:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1772398713',display_name='tempest-AttachVolumeTestJSON-server-1772398713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1772398713',id=26,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOh5tNnx2XPgpyPTTp9lhvfxf1zbtbSH0K+AJZ4Jo5NVKR/B/nAsUXzNN172vn+IbjlFPU6NNji8kFh0RSfxWrXJGee4MrKBfgE1SnM6Pl8g9OPTHjP5TPB9wTM6WiGv+w==',key_name='tempest-keypair-1322296621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d2114819cda450ca1827ddd5557da23',ramdisk_id='',reservation_id='r-niqthdq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-852428779',owner_user_name='tempest-AttachVolumeTestJSON-852428779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:47:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fac94bacad00447d9743d8a44118ea47',uuid=2545f107-974a-4ee8-ba9b-7d7f7bb1ae91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a7e7a5d-c80e-427f-96fe-92670978d8ee", "address": "fa:16:3e:cb:14:c8", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7e7a5d-c8", "ovs_interfaceid": "3a7e7a5d-c80e-427f-96fe-92670978d8ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Converting VIF {"id": "3a7e7a5d-c80e-427f-96fe-92670978d8ee", "address": "fa:16:3e:cb:14:c8", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7e7a5d-c8", "ovs_interfaceid": "3a7e7a5d-c80e-427f-96fe-92670978d8ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:14:c8,bridge_name='br-int',has_traffic_filtering=True,id=3a7e7a5d-c80e-427f-96fe-92670978d8ee,network=Network(cddd6eb8-767a-42c5-8cca-a1fe1d2eb604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a7e7a5d-c8') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.objects.instance [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'pci_devices' on Instance uuid 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.policy [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3ccc9cc867644d9bc040e9dfd4eb231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404795fcace4922a10abdb33740e87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:47:33 user nova-compute[73484]:   <uuid>2545f107-974a-4ee8-ba9b-7d7f7bb1ae91</uuid>
Aug 14 13:47:33 user nova-compute[73484]:   <name>instance-0000001a</name>
Aug 14 13:47:33 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:47:33 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:47:33 user nova-compute[73484]:   <metadata>
Aug 14 13:47:33 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:47:33 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:47:33 user nova-compute[73484]:       <nova:name>tempest-AttachVolumeTestJSON-server-1772398713</nova:name>
Aug 14 13:47:33 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:47:33</nova:creationTime>
Aug 14 13:47:33 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:47:33 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:47:33 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:47:33 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:47:33 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:47:33 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:47:33 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:47:33 user nova-compute[73484]:       <nova:owner>
Aug 14 13:47:33 user nova-compute[73484]:         <nova:user uuid="fac94bacad00447d9743d8a44118ea47">tempest-AttachVolumeTestJSON-852428779-project-member</nova:user>
Aug 14 13:47:33 user nova-compute[73484]:         <nova:project uuid="3d2114819cda450ca1827ddd5557da23">tempest-AttachVolumeTestJSON-852428779</nova:project>
Aug 14 13:47:33 user nova-compute[73484]:       </nova:owner>
Aug 14 13:47:33 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:47:33 user nova-compute[73484]:       <nova:ports>
Aug 14 13:47:33 user nova-compute[73484]:         <nova:port uuid="3a7e7a5d-c80e-427f-96fe-92670978d8ee">
Aug 14 13:47:33 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 13:47:33 user nova-compute[73484]:         </nova:port>
Aug 14 13:47:33 user nova-compute[73484]:       </nova:ports>
Aug 14 13:47:33 user nova-compute[73484]:     </nova:instance>
Aug 14 13:47:33 user nova-compute[73484]:   </metadata>
Aug 14 13:47:33 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:47:33 user nova-compute[73484]:     <system>
Aug 14 13:47:33 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:47:33 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:47:33 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:47:33 user nova-compute[73484]:       <entry name="serial">2545f107-974a-4ee8-ba9b-7d7f7bb1ae91</entry>
Aug 14 13:47:33 user nova-compute[73484]:       <entry name="uuid">2545f107-974a-4ee8-ba9b-7d7f7bb1ae91</entry>
Aug 14 13:47:33 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:47:33 user nova-compute[73484]:     </system>
Aug 14 13:47:33 user nova-compute[73484]:   </sysinfo>
Aug 14 13:47:33 user nova-compute[73484]:   <os>
Aug 14 13:47:33 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:47:33 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:47:33 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:47:33 user nova-compute[73484]:   </os>
Aug 14 13:47:33 user nova-compute[73484]:   <features>
Aug 14 13:47:33 user nova-compute[73484]:     <acpi/>
Aug 14 13:47:33 user nova-compute[73484]:     <apic/>
Aug 14 13:47:33 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:47:33 user nova-compute[73484]:   </features>
Aug 14 13:47:33 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:47:33 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:47:33 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:47:33 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:47:33 user nova-compute[73484]:   </clock>
Aug 14 13:47:33 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:47:33 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:47:33 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:47:33 user nova-compute[73484]:   </cpu>
Aug 14 13:47:33 user nova-compute[73484]:   <devices>
Aug 14 13:47:33 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:47:33 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:47:33 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/2545f107-974a-4ee8-ba9b-7d7f7bb1ae91/disk"/>
Aug 14 13:47:33 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:47:33 user nova-compute[73484]:     </disk>
Aug 14 13:47:33 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:47:33 user nova-compute[73484]:       <mac address="fa:16:3e:cb:14:c8"/>
Aug 14 13:47:33 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:47:33 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:47:33 user nova-compute[73484]:       <target dev="tap3a7e7a5d-c8"/>
Aug 14 13:47:33 user nova-compute[73484]:     </interface>
Aug 14 13:47:33 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:47:33 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/2545f107-974a-4ee8-ba9b-7d7f7bb1ae91/console.log" append="off"/>
Aug 14 13:47:33 user nova-compute[73484]:     </serial>
Aug 14 13:47:33 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:47:33 user nova-compute[73484]:     <video>
Aug 14 13:47:33 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:47:33 user nova-compute[73484]:     </video>
Aug 14 13:47:33 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:47:33 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:47:33 user nova-compute[73484]:     </rng>
Aug 14 13:47:33 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:47:33 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:47:33 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:47:33 user nova-compute[73484]:     </memballoon>
Aug 14 13:47:33 user nova-compute[73484]:   </devices>
Aug 14 13:47:33 user nova-compute[73484]: </domain>
Aug 14 13:47:33 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:47:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1772398713',display_name='tempest-AttachVolumeTestJSON-server-1772398713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1772398713',id=26,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOh5tNnx2XPgpyPTTp9lhvfxf1zbtbSH0K+AJZ4Jo5NVKR/B/nAsUXzNN172vn+IbjlFPU6NNji8kFh0RSfxWrXJGee4MrKBfgE1SnM6Pl8g9OPTHjP5TPB9wTM6WiGv+w==',key_name='tempest-keypair-1322296621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d2114819cda450ca1827ddd5557da23',ramdisk_id='',reservation_id='r-niqthdq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-852428779',owner_user_name='tempest-AttachVolumeTestJSON-852428779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:47:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fac94bacad00447d9743d8a44118ea47',uuid=2545f107-974a-4ee8-ba9b-7d7f7bb1ae91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a7e7a5d-c80e-427f-96fe-92670978d8ee", "address": "fa:16:3e:cb:14:c8", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7e7a5d-c8", "ovs_interfaceid": "3a7e7a5d-c80e-427f-96fe-92670978d8ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Converting VIF {"id": "3a7e7a5d-c80e-427f-96fe-92670978d8ee", "address": "fa:16:3e:cb:14:c8", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7e7a5d-c8", "ovs_interfaceid": "3a7e7a5d-c80e-427f-96fe-92670978d8ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:14:c8,bridge_name='br-int',has_traffic_filtering=True,id=3a7e7a5d-c80e-427f-96fe-92670978d8ee,network=Network(cddd6eb8-767a-42c5-8cca-a1fe1d2eb604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a7e7a5d-c8') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG os_vif [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:14:c8,bridge_name='br-int',has_traffic_filtering=True,id=3a7e7a5d-c80e-427f-96fe-92670978d8ee,network=Network(cddd6eb8-767a-42c5-8cca-a1fe1d2eb604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a7e7a5d-c8') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a7e7a5d-c8, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3a7e7a5d-c8, col_values=(('external_ids', {'iface-id': '3a7e7a5d-c80e-427f-96fe-92670978d8ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:14:c8', 'vm-uuid': '2545f107-974a-4ee8-ba9b-7d7f7bb1ae91'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:33 user nova-compute[73484]: INFO os_vif [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:14:c8,bridge_name='br-int',has_traffic_filtering=True,id=3a7e7a5d-c80e-427f-96fe-92670978d8ee,network=Network(cddd6eb8-767a-42c5-8cca-a1fe1d2eb604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a7e7a5d-c8')
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:47:33 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Creating image(s)
Aug 14 13:47:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "/opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "/opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "/opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:47:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] No VIF found with MAC fa:16:3e:cb:14:c8, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:47:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.198s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.210s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk 1073741824" returned: 0 in 0.051s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:34 user nova-compute[73484]: DEBUG nova.network.neutron [req-88c6e411-ff4d-4cd1-a5bc-ccbc007ab5ef req-e5d8a1dc-165d-42c4-8d07-3ffc349d0622 service nova] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Updated VIF entry in instance network info cache for port 3a7e7a5d-c80e-427f-96fe-92670978d8ee. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:47:34 user nova-compute[73484]: DEBUG nova.network.neutron [req-88c6e411-ff4d-4cd1-a5bc-ccbc007ab5ef req-e5d8a1dc-165d-42c4-8d07-3ffc349d0622 service nova] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Updating instance_info_cache with network_info: [{"id": "3a7e7a5d-c80e-427f-96fe-92670978d8ee", "address": "fa:16:3e:cb:14:c8", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7e7a5d-c8", "ovs_interfaceid": "3a7e7a5d-c80e-427f-96fe-92670978d8ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:47:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-88c6e411-ff4d-4cd1-a5bc-ccbc007ab5ef req-e5d8a1dc-165d-42c4-8d07-3ffc349d0622 service nova] Releasing lock "refresh_cache-2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:47:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.202s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:34 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Checking if we can resize image /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:47:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:34 user nova-compute[73484]: DEBUG nova.network.neutron [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Successfully created port: 28b48249-b438-4d6d-9432-5c94ed450cb8 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:47:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:34 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Cannot resize image /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:47:34 user nova-compute[73484]: DEBUG nova.objects.instance [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lazy-loading 'migration_context' on Instance uuid 700e95c1-08b0-4613-992b-4314b127e14a {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:47:34 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:47:34 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Ensure instance console log exists: /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:47:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:35 user nova-compute[73484]: DEBUG nova.network.neutron [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Successfully updated port: 28b48249-b438-4d6d-9432-5c94ed450cb8 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:47:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "refresh_cache-700e95c1-08b0-4613-992b-4314b127e14a" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:47:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquired lock "refresh_cache-700e95c1-08b0-4613-992b-4314b127e14a" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:47:35 user nova-compute[73484]: DEBUG nova.network.neutron [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:47:35 user nova-compute[73484]: DEBUG nova.compute.manager [req-7c55be52-7d61-41d7-85cb-a0d8b4b3de5f req-f577ddbd-a67e-4688-a3fe-835742386316 service nova] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Received event network-changed-28b48249-b438-4d6d-9432-5c94ed450cb8 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:47:35 user nova-compute[73484]: DEBUG nova.compute.manager [req-7c55be52-7d61-41d7-85cb-a0d8b4b3de5f req-f577ddbd-a67e-4688-a3fe-835742386316 service nova] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Refreshing instance network info cache due to event network-changed-28b48249-b438-4d6d-9432-5c94ed450cb8. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:47:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-7c55be52-7d61-41d7-85cb-a0d8b4b3de5f req-f577ddbd-a67e-4688-a3fe-835742386316 service nova] Acquiring lock "refresh_cache-700e95c1-08b0-4613-992b-4314b127e14a" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:47:35 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692020840.5016723, 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:47:35 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] VM Stopped (Lifecycle Event)
Aug 14 13:47:35 user nova-compute[73484]: DEBUG nova.compute.manager [None req-d9d07c7b-64ed-4d6d-8a49-80e090991b43 None None] [instance: 9eed5f58-f09b-419a-ba10-7b1dd6f27f7f] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:47:35 user nova-compute[73484]: DEBUG nova.network.neutron [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:47:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.network.neutron [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Updating instance_info_cache with network_info: [{"id": "28b48249-b438-4d6d-9432-5c94ed450cb8", "address": "fa:16:3e:bb:3e:ce", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b48249-b4", "ovs_interfaceid": "28b48249-b438-4d6d-9432-5c94ed450cb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Releasing lock "refresh_cache-700e95c1-08b0-4613-992b-4314b127e14a" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Instance network_info: |[{"id": "28b48249-b438-4d6d-9432-5c94ed450cb8", "address": "fa:16:3e:bb:3e:ce", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b48249-b4", "ovs_interfaceid": "28b48249-b438-4d6d-9432-5c94ed450cb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-7c55be52-7d61-41d7-85cb-a0d8b4b3de5f req-f577ddbd-a67e-4688-a3fe-835742386316 service nova] Acquired lock "refresh_cache-700e95c1-08b0-4613-992b-4314b127e14a" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.network.neutron [req-7c55be52-7d61-41d7-85cb-a0d8b4b3de5f req-f577ddbd-a67e-4688-a3fe-835742386316 service nova] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Refreshing network info cache for port 28b48249-b438-4d6d-9432-5c94ed450cb8 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Start _get_guest_xml network_info=[{"id": "28b48249-b438-4d6d-9432-5c94ed450cb8", "address": "fa:16:3e:bb:3e:ce", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b48249-b4", "ovs_interfaceid": "28b48249-b438-4d6d-9432-5c94ed450cb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:47:36 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:47:36 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-194305929',display_name='tempest-AttachVolumeNegativeTest-server-194305929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-194305929',id=27,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVbeOMkzNy4KywIABE4JYqFIsKwL5gTYLpbYaCSwgSKGhAo4pPw9TNkh9zlQWNjXPpRLd1xhqQ2SFWL/sowgtIZeGLRZfjVsOHBgRJtGuYihTUoU25sAs4K4TpK2Nyukw==',key_name='tempest-keypair-511691696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f404795fcace4922a10abdb33740e87d',ramdisk_id='',reservation_id='r-fl0nb06j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1043074889',owner_user_name='tempest-AttachVolumeNegativeTest-1043074889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:47:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3ccc9cc867644d9bc040e9dfd4eb231',uuid=700e95c1-08b0-4613-992b-4314b127e14a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28b48249-b438-4d6d-9432-5c94ed450cb8", "address": "fa:16:3e:bb:3e:ce", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b48249-b4", "ovs_interfaceid": "28b48249-b438-4d6d-9432-5c94ed450cb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Converting VIF {"id": "28b48249-b438-4d6d-9432-5c94ed450cb8", "address": "fa:16:3e:bb:3e:ce", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b48249-b4", "ovs_interfaceid": "28b48249-b438-4d6d-9432-5c94ed450cb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:3e:ce,bridge_name='br-int',has_traffic_filtering=True,id=28b48249-b438-4d6d-9432-5c94ed450cb8,network=Network(10d4738f-25c6-4995-a4b7-6fbee86f070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b48249-b4') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.objects.instance [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lazy-loading 'pci_devices' on Instance uuid 700e95c1-08b0-4613-992b-4314b127e14a {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:47:36 user nova-compute[73484]:   <uuid>700e95c1-08b0-4613-992b-4314b127e14a</uuid>
Aug 14 13:47:36 user nova-compute[73484]:   <name>instance-0000001b</name>
Aug 14 13:47:36 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:47:36 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:47:36 user nova-compute[73484]:   <metadata>
Aug 14 13:47:36 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:47:36 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:47:36 user nova-compute[73484]:       <nova:name>tempest-AttachVolumeNegativeTest-server-194305929</nova:name>
Aug 14 13:47:36 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:47:36</nova:creationTime>
Aug 14 13:47:36 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:47:36 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:47:36 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:47:36 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:47:36 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:47:36 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:47:36 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:47:36 user nova-compute[73484]:       <nova:owner>
Aug 14 13:47:36 user nova-compute[73484]:         <nova:user uuid="b3ccc9cc867644d9bc040e9dfd4eb231">tempest-AttachVolumeNegativeTest-1043074889-project-member</nova:user>
Aug 14 13:47:36 user nova-compute[73484]:         <nova:project uuid="f404795fcace4922a10abdb33740e87d">tempest-AttachVolumeNegativeTest-1043074889</nova:project>
Aug 14 13:47:36 user nova-compute[73484]:       </nova:owner>
Aug 14 13:47:36 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:47:36 user nova-compute[73484]:       <nova:ports>
Aug 14 13:47:36 user nova-compute[73484]:         <nova:port uuid="28b48249-b438-4d6d-9432-5c94ed450cb8">
Aug 14 13:47:36 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 13:47:36 user nova-compute[73484]:         </nova:port>
Aug 14 13:47:36 user nova-compute[73484]:       </nova:ports>
Aug 14 13:47:36 user nova-compute[73484]:     </nova:instance>
Aug 14 13:47:36 user nova-compute[73484]:   </metadata>
Aug 14 13:47:36 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:47:36 user nova-compute[73484]:     <system>
Aug 14 13:47:36 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:47:36 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:47:36 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:47:36 user nova-compute[73484]:       <entry name="serial">700e95c1-08b0-4613-992b-4314b127e14a</entry>
Aug 14 13:47:36 user nova-compute[73484]:       <entry name="uuid">700e95c1-08b0-4613-992b-4314b127e14a</entry>
Aug 14 13:47:36 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:47:36 user nova-compute[73484]:     </system>
Aug 14 13:47:36 user nova-compute[73484]:   </sysinfo>
Aug 14 13:47:36 user nova-compute[73484]:   <os>
Aug 14 13:47:36 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:47:36 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:47:36 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:47:36 user nova-compute[73484]:   </os>
Aug 14 13:47:36 user nova-compute[73484]:   <features>
Aug 14 13:47:36 user nova-compute[73484]:     <acpi/>
Aug 14 13:47:36 user nova-compute[73484]:     <apic/>
Aug 14 13:47:36 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:47:36 user nova-compute[73484]:   </features>
Aug 14 13:47:36 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:47:36 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:47:36 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:47:36 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:47:36 user nova-compute[73484]:   </clock>
Aug 14 13:47:36 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:47:36 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:47:36 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:47:36 user nova-compute[73484]:   </cpu>
Aug 14 13:47:36 user nova-compute[73484]:   <devices>
Aug 14 13:47:36 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:47:36 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:47:36 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk"/>
Aug 14 13:47:36 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:47:36 user nova-compute[73484]:     </disk>
Aug 14 13:47:36 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:47:36 user nova-compute[73484]:       <mac address="fa:16:3e:bb:3e:ce"/>
Aug 14 13:47:36 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:47:36 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:47:36 user nova-compute[73484]:       <target dev="tap28b48249-b4"/>
Aug 14 13:47:36 user nova-compute[73484]:     </interface>
Aug 14 13:47:36 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:47:36 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/console.log" append="off"/>
Aug 14 13:47:36 user nova-compute[73484]:     </serial>
Aug 14 13:47:36 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:47:36 user nova-compute[73484]:     <video>
Aug 14 13:47:36 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:47:36 user nova-compute[73484]:     </video>
Aug 14 13:47:36 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:47:36 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:47:36 user nova-compute[73484]:     </rng>
Aug 14 13:47:36 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:47:36 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:47:36 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:47:36 user nova-compute[73484]:     </memballoon>
Aug 14 13:47:36 user nova-compute[73484]:   </devices>
Aug 14 13:47:36 user nova-compute[73484]: </domain>
Aug 14 13:47:36 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-194305929',display_name='tempest-AttachVolumeNegativeTest-server-194305929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-194305929',id=27,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVbeOMkzNy4KywIABE4JYqFIsKwL5gTYLpbYaCSwgSKGhAo4pPw9TNkh9zlQWNjXPpRLd1xhqQ2SFWL/sowgtIZeGLRZfjVsOHBgRJtGuYihTUoU25sAs4K4TpK2Nyukw==',key_name='tempest-keypair-511691696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f404795fcace4922a10abdb33740e87d',ramdisk_id='',reservation_id='r-fl0nb06j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1043074889',owner_user_name='tempest-AttachVolumeNegativeTest-1043074889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:47:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3ccc9cc867644d9bc040e9dfd4eb231',uuid=700e95c1-08b0-4613-992b-4314b127e14a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28b48249-b438-4d6d-9432-5c94ed450cb8", "address": "fa:16:3e:bb:3e:ce", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b48249-b4", "ovs_interfaceid": "28b48249-b438-4d6d-9432-5c94ed450cb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Converting VIF {"id": "28b48249-b438-4d6d-9432-5c94ed450cb8", "address": "fa:16:3e:bb:3e:ce", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b48249-b4", "ovs_interfaceid": "28b48249-b438-4d6d-9432-5c94ed450cb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:3e:ce,bridge_name='br-int',has_traffic_filtering=True,id=28b48249-b438-4d6d-9432-5c94ed450cb8,network=Network(10d4738f-25c6-4995-a4b7-6fbee86f070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b48249-b4') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG os_vif [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:3e:ce,bridge_name='br-int',has_traffic_filtering=True,id=28b48249-b438-4d6d-9432-5c94ed450cb8,network=Network(10d4738f-25c6-4995-a4b7-6fbee86f070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b48249-b4') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28b48249-b4, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap28b48249-b4, col_values=(('external_ids', {'iface-id': '28b48249-b438-4d6d-9432-5c94ed450cb8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:3e:ce', 'vm-uuid': '700e95c1-08b0-4613-992b-4314b127e14a'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:36 user nova-compute[73484]: INFO os_vif [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:3e:ce,bridge_name='br-int',has_traffic_filtering=True,id=28b48249-b438-4d6d-9432-5c94ed450cb8,network=Network(10d4738f-25c6-4995-a4b7-6fbee86f070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b48249-b4')
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] No VIF found with MAC fa:16:3e:bb:3e:ce, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.network.neutron [req-7c55be52-7d61-41d7-85cb-a0d8b4b3de5f req-f577ddbd-a67e-4688-a3fe-835742386316 service nova] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Updated VIF entry in instance network info cache for port 28b48249-b438-4d6d-9432-5c94ed450cb8. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG nova.network.neutron [req-7c55be52-7d61-41d7-85cb-a0d8b4b3de5f req-f577ddbd-a67e-4688-a3fe-835742386316 service nova] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Updating instance_info_cache with network_info: [{"id": "28b48249-b438-4d6d-9432-5c94ed450cb8", "address": "fa:16:3e:bb:3e:ce", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b48249-b4", "ovs_interfaceid": "28b48249-b438-4d6d-9432-5c94ed450cb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:47:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-7c55be52-7d61-41d7-85cb-a0d8b4b3de5f req-f577ddbd-a67e-4688-a3fe-835742386316 service nova] Releasing lock "refresh_cache-700e95c1-08b0-4613-992b-4314b127e14a" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:47:37 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020857.4382143, 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:47:37 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] VM Resumed (Lifecycle Event)
Aug 14 13:47:37 user nova-compute[73484]: DEBUG nova.compute.manager [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:47:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:47:37 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Instance spawned successfully.
Aug 14 13:47:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:47:37 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:47:37 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:47:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:47:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:47:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:47:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:47:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:47:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:47:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:37 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:47:37 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020857.4399, 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:47:37 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] VM Started (Lifecycle Event)
Aug 14 13:47:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:37 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:47:37 user nova-compute[73484]: DEBUG nova.compute.manager [req-167163a8-5f85-46c8-9be5-be72f733922e req-72ccad7b-fcb5-4b5d-8d4f-c30a665fb9b9 service nova] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Received event network-vif-plugged-3a7e7a5d-c80e-427f-96fe-92670978d8ee {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:47:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-167163a8-5f85-46c8-9be5-be72f733922e req-72ccad7b-fcb5-4b5d-8d4f-c30a665fb9b9 service nova] Acquiring lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-167163a8-5f85-46c8-9be5-be72f733922e req-72ccad7b-fcb5-4b5d-8d4f-c30a665fb9b9 service nova] Lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-167163a8-5f85-46c8-9be5-be72f733922e req-72ccad7b-fcb5-4b5d-8d4f-c30a665fb9b9 service nova] Lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:37 user nova-compute[73484]: DEBUG nova.compute.manager [req-167163a8-5f85-46c8-9be5-be72f733922e req-72ccad7b-fcb5-4b5d-8d4f-c30a665fb9b9 service nova] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] No waiting events found dispatching network-vif-plugged-3a7e7a5d-c80e-427f-96fe-92670978d8ee {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:47:37 user nova-compute[73484]: WARNING nova.compute.manager [req-167163a8-5f85-46c8-9be5-be72f733922e req-72ccad7b-fcb5-4b5d-8d4f-c30a665fb9b9 service nova] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Received unexpected event network-vif-plugged-3a7e7a5d-c80e-427f-96fe-92670978d8ee for instance with vm_state building and task_state spawning.
Aug 14 13:47:37 user nova-compute[73484]: DEBUG nova.compute.manager [req-167163a8-5f85-46c8-9be5-be72f733922e req-72ccad7b-fcb5-4b5d-8d4f-c30a665fb9b9 service nova] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Received event network-vif-plugged-3a7e7a5d-c80e-427f-96fe-92670978d8ee {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:47:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-167163a8-5f85-46c8-9be5-be72f733922e req-72ccad7b-fcb5-4b5d-8d4f-c30a665fb9b9 service nova] Acquiring lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-167163a8-5f85-46c8-9be5-be72f733922e req-72ccad7b-fcb5-4b5d-8d4f-c30a665fb9b9 service nova] Lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-167163a8-5f85-46c8-9be5-be72f733922e req-72ccad7b-fcb5-4b5d-8d4f-c30a665fb9b9 service nova] Lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:37 user nova-compute[73484]: DEBUG nova.compute.manager [req-167163a8-5f85-46c8-9be5-be72f733922e req-72ccad7b-fcb5-4b5d-8d4f-c30a665fb9b9 service nova] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] No waiting events found dispatching network-vif-plugged-3a7e7a5d-c80e-427f-96fe-92670978d8ee {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:47:37 user nova-compute[73484]: WARNING nova.compute.manager [req-167163a8-5f85-46c8-9be5-be72f733922e req-72ccad7b-fcb5-4b5d-8d4f-c30a665fb9b9 service nova] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Received unexpected event network-vif-plugged-3a7e7a5d-c80e-427f-96fe-92670978d8ee for instance with vm_state building and task_state spawning.
Aug 14 13:47:37 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:47:37 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:47:37 user nova-compute[73484]: INFO nova.compute.manager [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Took 6.17 seconds to spawn the instance on the hypervisor.
Aug 14 13:47:37 user nova-compute[73484]: DEBUG nova.compute.manager [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:47:37 user nova-compute[73484]: INFO nova.compute.manager [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Took 7.07 seconds to build instance.
Aug 14 13:47:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-33e8c2c2-c5e2-4cad-8011-4cfa110bed97 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.177s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:38 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:47:38 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 13:47:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-bd43e3a9-0413-4e55-b6a1-7f3f792ba872" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:47:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-bd43e3a9-0413-4e55-b6a1-7f3f792ba872" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:47:38 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 13:47:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:39 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Updating instance_info_cache with network_info: [{"id": "0a161ec7-dffc-474f-b741-381bf53615d4", "address": "fa:16:3e:bf:29:a7", "network": {"id": "893008ed-2c71-42ba-bf31-28baba1b8c2c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1936284602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ff7afafc2d4b1fa74902cdf0ce08d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a161ec7-df", "ovs_interfaceid": "0a161ec7-dffc-474f-b741-381bf53615d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:47:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-bd43e3a9-0413-4e55-b6a1-7f3f792ba872" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:47:39 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 13:47:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-c27f99ba-e636-4613-9f0d-a367f9bd0326 req-f9a2703c-e476-4ca8-906f-f5dbe0c6ee7a service nova] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Received event network-vif-plugged-28b48249-b438-4d6d-9432-5c94ed450cb8 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:47:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c27f99ba-e636-4613-9f0d-a367f9bd0326 req-f9a2703c-e476-4ca8-906f-f5dbe0c6ee7a service nova] Acquiring lock "700e95c1-08b0-4613-992b-4314b127e14a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c27f99ba-e636-4613-9f0d-a367f9bd0326 req-f9a2703c-e476-4ca8-906f-f5dbe0c6ee7a service nova] Lock "700e95c1-08b0-4613-992b-4314b127e14a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c27f99ba-e636-4613-9f0d-a367f9bd0326 req-f9a2703c-e476-4ca8-906f-f5dbe0c6ee7a service nova] Lock "700e95c1-08b0-4613-992b-4314b127e14a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-c27f99ba-e636-4613-9f0d-a367f9bd0326 req-f9a2703c-e476-4ca8-906f-f5dbe0c6ee7a service nova] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] No waiting events found dispatching network-vif-plugged-28b48249-b438-4d6d-9432-5c94ed450cb8 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:47:39 user nova-compute[73484]: WARNING nova.compute.manager [req-c27f99ba-e636-4613-9f0d-a367f9bd0326 req-f9a2703c-e476-4ca8-906f-f5dbe0c6ee7a service nova] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Received unexpected event network-vif-plugged-28b48249-b438-4d6d-9432-5c94ed450cb8 for instance with vm_state building and task_state spawning.
Aug 14 13:47:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-c27f99ba-e636-4613-9f0d-a367f9bd0326 req-f9a2703c-e476-4ca8-906f-f5dbe0c6ee7a service nova] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Received event network-vif-plugged-28b48249-b438-4d6d-9432-5c94ed450cb8 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:47:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c27f99ba-e636-4613-9f0d-a367f9bd0326 req-f9a2703c-e476-4ca8-906f-f5dbe0c6ee7a service nova] Acquiring lock "700e95c1-08b0-4613-992b-4314b127e14a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c27f99ba-e636-4613-9f0d-a367f9bd0326 req-f9a2703c-e476-4ca8-906f-f5dbe0c6ee7a service nova] Lock "700e95c1-08b0-4613-992b-4314b127e14a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c27f99ba-e636-4613-9f0d-a367f9bd0326 req-f9a2703c-e476-4ca8-906f-f5dbe0c6ee7a service nova] Lock "700e95c1-08b0-4613-992b-4314b127e14a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-c27f99ba-e636-4613-9f0d-a367f9bd0326 req-f9a2703c-e476-4ca8-906f-f5dbe0c6ee7a service nova] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] No waiting events found dispatching network-vif-plugged-28b48249-b438-4d6d-9432-5c94ed450cb8 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:47:39 user nova-compute[73484]: WARNING nova.compute.manager [req-c27f99ba-e636-4613-9f0d-a367f9bd0326 req-f9a2703c-e476-4ca8-906f-f5dbe0c6ee7a service nova] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Received unexpected event network-vif-plugged-28b48249-b438-4d6d-9432-5c94ed450cb8 for instance with vm_state building and task_state spawning.
Aug 14 13:47:39 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:47:39 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:47:39 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 13:47:39 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020859.8822799, 700e95c1-08b0-4613-992b-4314b127e14a => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:47:39 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] VM Resumed (Lifecycle Event)
Aug 14 13:47:39 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:47:39 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:47:39 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Instance spawned successfully.
Aug 14 13:47:39 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:47:39 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:47:39 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:47:39 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:47:39 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:47:39 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:47:39 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:47:39 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:47:39 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:47:39 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:47:39 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020859.884658, 700e95c1-08b0-4613-992b-4314b127e14a => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:47:39 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] VM Started (Lifecycle Event)
Aug 14 13:47:39 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:47:39 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:47:40 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:47:40 user nova-compute[73484]: INFO nova.compute.manager [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Took 6.20 seconds to spawn the instance on the hypervisor.
Aug 14 13:47:40 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:47:40 user nova-compute[73484]: INFO nova.compute.manager [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Took 7.20 seconds to build instance.
Aug 14 13:47:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0473b9d7-5323-4933-b0b9-37165216975b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "700e95c1-08b0-4613-992b-4314b127e14a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.355s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:40 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:47:41 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:41 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:47:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:41 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 13:47:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:42 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:47:42 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:47:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json" returned: 0 in 0.252s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json" returned: 0 in 0.236s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2545f107-974a-4ee8-ba9b-7d7f7bb1ae91/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2545f107-974a-4ee8-ba9b-7d7f7bb1ae91/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2545f107-974a-4ee8-ba9b-7d7f7bb1ae91/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2545f107-974a-4ee8-ba9b-7d7f7bb1ae91/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:47:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:47:47 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:47:47 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:47:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=7299MB free_disk=25.309894561767578GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 13:47:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:47:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:47:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Applying migration context for instance 09ba29fd-8161-485c-ba6d-71d24ab086bc as it has an incoming, in-progress migration d3095941-fb94-498e-a661-cc4079498cc9. Migration status is finished {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 13:47:47 user nova-compute[73484]: INFO nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Updating resource usage from migration d3095941-fb94-498e-a661-cc4079498cc9
Aug 14 13:47:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance f4f7788c-fcca-47c1-b5b8-72892253982d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:47:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 07bac569-8b2c-4555-b4d5-a74f7384630b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:47:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance a9d4ec42-3db9-439b-87a7-02bcaab514a4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:47:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance bd43e3a9-0413-4e55-b6a1-7f3f792ba872 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:47:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance c0994bac-3b43-414e-aa81-a9d7198775a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:47:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 8220a084-e402-435a-b6a7-ffd94f91a211 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:47:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 782c6142-757a-49ae-9292-787a7f1e8a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:47:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 03255d24-b6fd-459c-8ac6-f9c4063b54b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:47:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Migration d3095941-fb94-498e-a661-cc4079498cc9 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 13:47:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 09ba29fd-8161-485c-ba6d-71d24ab086bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:47:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:47:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 700e95c1-08b0-4613-992b-4314b127e14a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:47:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 13:47:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 13:47:47 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Refreshing inventories for resource provider 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 13:47:47 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Updating ProviderTree inventory for provider 165d4635-93b4-49a6-879a-21c1324822ab from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 13:47:47 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Updating inventory in ProviderTree for provider 165d4635-93b4-49a6-879a-21c1324822ab with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 13:47:47 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Refreshing aggregate associations for resource provider 165d4635-93b4-49a6-879a-21c1324822ab, aggregates: None {{(pid=73484) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 13:47:47 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Refreshing trait associations for resource provider 165d4635-93b4-49a6-879a-21c1324822ab, traits: COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS {{(pid=73484) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 13:47:48 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:47:48 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:47:48 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 13:47:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.810s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:47:48 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:47:48 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:47:48 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:47:48 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:47:48 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:47:48 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:47:48 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Cleaning up deleted instances {{(pid=73484) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 13:47:48 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] There are 0 instances to clean {{(pid=73484) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 13:47:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:47:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9495da56-e136-4d56-b437-bfca09f5d8e6 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "8220a084-e402-435a-b6a7-ffd94f91a211" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:48:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9495da56-e136-4d56-b437-bfca09f5d8e6 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "8220a084-e402-435a-b6a7-ffd94f91a211" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:48:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9495da56-e136-4d56-b437-bfca09f5d8e6 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "8220a084-e402-435a-b6a7-ffd94f91a211-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:48:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9495da56-e136-4d56-b437-bfca09f5d8e6 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "8220a084-e402-435a-b6a7-ffd94f91a211-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:48:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9495da56-e136-4d56-b437-bfca09f5d8e6 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "8220a084-e402-435a-b6a7-ffd94f91a211-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:48:03 user nova-compute[73484]: INFO nova.compute.manager [None req-9495da56-e136-4d56-b437-bfca09f5d8e6 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Terminating instance
Aug 14 13:48:03 user nova-compute[73484]: DEBUG nova.compute.manager [None req-9495da56-e136-4d56-b437-bfca09f5d8e6 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:48:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:03 user nova-compute[73484]: DEBUG nova.compute.manager [req-8dcc8997-afe4-4014-a9e8-c90f66d3cb18 req-f086b981-9ec7-44e3-a7c8-844926c906d8 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Received event network-vif-unplugged-3ef63421-a4aa-4126-b8ee-c141b2ef10cb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:48:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8dcc8997-afe4-4014-a9e8-c90f66d3cb18 req-f086b981-9ec7-44e3-a7c8-844926c906d8 service nova] Acquiring lock "8220a084-e402-435a-b6a7-ffd94f91a211-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:48:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8dcc8997-afe4-4014-a9e8-c90f66d3cb18 req-f086b981-9ec7-44e3-a7c8-844926c906d8 service nova] Lock "8220a084-e402-435a-b6a7-ffd94f91a211-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:48:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8dcc8997-afe4-4014-a9e8-c90f66d3cb18 req-f086b981-9ec7-44e3-a7c8-844926c906d8 service nova] Lock "8220a084-e402-435a-b6a7-ffd94f91a211-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:48:03 user nova-compute[73484]: DEBUG nova.compute.manager [req-8dcc8997-afe4-4014-a9e8-c90f66d3cb18 req-f086b981-9ec7-44e3-a7c8-844926c906d8 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] No waiting events found dispatching network-vif-unplugged-3ef63421-a4aa-4126-b8ee-c141b2ef10cb {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:48:03 user nova-compute[73484]: DEBUG nova.compute.manager [req-8dcc8997-afe4-4014-a9e8-c90f66d3cb18 req-f086b981-9ec7-44e3-a7c8-844926c906d8 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Received event network-vif-unplugged-3ef63421-a4aa-4126-b8ee-c141b2ef10cb for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:48:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:04 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Instance destroyed successfully.
Aug 14 13:48:04 user nova-compute[73484]: DEBUG nova.objects.instance [None req-9495da56-e136-4d56-b437-bfca09f5d8e6 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lazy-loading 'resources' on Instance uuid 8220a084-e402-435a-b6a7-ffd94f91a211 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:48:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-9495da56-e136-4d56-b437-bfca09f5d8e6 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T13:41:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1500691485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1500691485',id=17,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbZYzDLzDUqAfp9/0tMMWal0Npb7Q9VW764vBVt/78de6sGHrTc6QryY/PPWtnTrkZNOrBVy1sS2Lv9880nGFfXr7m+xb6JqE7SCtrvvtov8Bx57jr2o0U2QK23gjDKkw==',key_name='tempest-keypair-1575579439',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:45:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c1ccc7c1aaf497da5f1d325d79e9301',ramdisk_id='',reservation_id='r-j80xfzw1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1730232968',owner_user_name='tempest-AttachVolumeShelveTestJSON-1730232968-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:46:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bda36df8b1f64c7894bfee5da258c1e6',uuid=8220a084-e402-435a-b6a7-ffd94f91a211,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "address": "fa:16:3e:ca:70:43", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef63421-a4", "ovs_interfaceid": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:48:04 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-9495da56-e136-4d56-b437-bfca09f5d8e6 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Converting VIF {"id": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "address": "fa:16:3e:ca:70:43", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ef63421-a4", "ovs_interfaceid": "3ef63421-a4aa-4126-b8ee-c141b2ef10cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:48:04 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-9495da56-e136-4d56-b437-bfca09f5d8e6 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:70:43,bridge_name='br-int',has_traffic_filtering=True,id=3ef63421-a4aa-4126-b8ee-c141b2ef10cb,network=Network(cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ef63421-a4') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:48:04 user nova-compute[73484]: DEBUG os_vif [None req-9495da56-e136-4d56-b437-bfca09f5d8e6 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:70:43,bridge_name='br-int',has_traffic_filtering=True,id=3ef63421-a4aa-4126-b8ee-c141b2ef10cb,network=Network(cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ef63421-a4') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:48:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ef63421-a4, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:48:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:48:04 user nova-compute[73484]: INFO os_vif [None req-9495da56-e136-4d56-b437-bfca09f5d8e6 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:70:43,bridge_name='br-int',has_traffic_filtering=True,id=3ef63421-a4aa-4126-b8ee-c141b2ef10cb,network=Network(cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ef63421-a4')
Aug 14 13:48:04 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-9495da56-e136-4d56-b437-bfca09f5d8e6 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Deleting instance files /opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211_del
Aug 14 13:48:04 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-9495da56-e136-4d56-b437-bfca09f5d8e6 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Deletion of /opt/stack/data/nova/instances/8220a084-e402-435a-b6a7-ffd94f91a211_del complete
Aug 14 13:48:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:04 user nova-compute[73484]: INFO nova.compute.manager [None req-9495da56-e136-4d56-b437-bfca09f5d8e6 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 14 13:48:04 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-9495da56-e136-4d56-b437-bfca09f5d8e6 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:48:04 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:48:04 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:48:05 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:48:05 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Took 1.33 seconds to deallocate network for instance.
Aug 14 13:48:05 user nova-compute[73484]: DEBUG nova.compute.manager [req-f8453572-a2a7-4a01-aeb9-b75f56ad3d3b req-38800aad-c1de-4df1-bf28-522580a02308 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Received event network-vif-plugged-3ef63421-a4aa-4126-b8ee-c141b2ef10cb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:48:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f8453572-a2a7-4a01-aeb9-b75f56ad3d3b req-38800aad-c1de-4df1-bf28-522580a02308 service nova] Acquiring lock "8220a084-e402-435a-b6a7-ffd94f91a211-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:48:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f8453572-a2a7-4a01-aeb9-b75f56ad3d3b req-38800aad-c1de-4df1-bf28-522580a02308 service nova] Lock "8220a084-e402-435a-b6a7-ffd94f91a211-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:48:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f8453572-a2a7-4a01-aeb9-b75f56ad3d3b req-38800aad-c1de-4df1-bf28-522580a02308 service nova] Lock "8220a084-e402-435a-b6a7-ffd94f91a211-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:48:05 user nova-compute[73484]: DEBUG nova.compute.manager [req-f8453572-a2a7-4a01-aeb9-b75f56ad3d3b req-38800aad-c1de-4df1-bf28-522580a02308 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] No waiting events found dispatching network-vif-plugged-3ef63421-a4aa-4126-b8ee-c141b2ef10cb {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:48:05 user nova-compute[73484]: WARNING nova.compute.manager [req-f8453572-a2a7-4a01-aeb9-b75f56ad3d3b req-38800aad-c1de-4df1-bf28-522580a02308 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Received unexpected event network-vif-plugged-3ef63421-a4aa-4126-b8ee-c141b2ef10cb for instance with vm_state active and task_state deleting.
Aug 14 13:48:05 user nova-compute[73484]: DEBUG nova.compute.manager [req-f8453572-a2a7-4a01-aeb9-b75f56ad3d3b req-38800aad-c1de-4df1-bf28-522580a02308 service nova] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Received event network-vif-deleted-3ef63421-a4aa-4126-b8ee-c141b2ef10cb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:48:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9495da56-e136-4d56-b437-bfca09f5d8e6 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:48:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9495da56-e136-4d56-b437-bfca09f5d8e6 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:48:06 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-9495da56-e136-4d56-b437-bfca09f5d8e6 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:48:06 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-9495da56-e136-4d56-b437-bfca09f5d8e6 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:48:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9495da56-e136-4d56-b437-bfca09f5d8e6 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.472s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:48:06 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-9495da56-e136-4d56-b437-bfca09f5d8e6 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Deleted allocations for instance 8220a084-e402-435a-b6a7-ffd94f91a211
Aug 14 13:48:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9495da56-e136-4d56-b437-bfca09f5d8e6 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "8220a084-e402-435a-b6a7-ffd94f91a211" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.302s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:48:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:19 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692020884.1172533, 8220a084-e402-435a-b6a7-ffd94f91a211 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:48:19 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] VM Stopped (Lifecycle Event)
Aug 14 13:48:19 user nova-compute[73484]: DEBUG nova.compute.manager [None req-ec0baf0a-469f-461a-9dc8-d181af4d8946 None None] [instance: 8220a084-e402-435a-b6a7-ffd94f91a211] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:48:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:48:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:48:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:48:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:48:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:48:21 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:48:21 user nova-compute[73484]: INFO nova.compute.claims [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Claim successful on node user
Aug 14 13:48:21 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:48:21 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:48:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.447s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:48:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:48:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:48:21 user nova-compute[73484]: DEBUG nova.network.neutron [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:48:21 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:48:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:48:21 user nova-compute[73484]: INFO nova.virt.block_device [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Booting with volume-backed-image 35547d66-318f-468f-9286-e10554f69bf8 at /dev/vda
Aug 14 13:48:21 user nova-compute[73484]: DEBUG nova.policy [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a0f55ad018d4c0ca587d8bdd40df4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c7f2c51c0f84bf1aedcf493a9ff860f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:48:22 user nova-compute[73484]: DEBUG nova.network.neutron [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Successfully created port: ea301764-93d8-4c55-a51f-5e50918be405 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:48:23 user nova-compute[73484]: DEBUG nova.network.neutron [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Successfully updated port: ea301764-93d8-4c55-a51f-5e50918be405 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:48:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "refresh_cache-b43ccb18-6d2d-43f2-a185-bb558d5d6f45" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:48:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquired lock "refresh_cache-b43ccb18-6d2d-43f2-a185-bb558d5d6f45" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:48:23 user nova-compute[73484]: DEBUG nova.network.neutron [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:48:23 user nova-compute[73484]: DEBUG nova.compute.manager [req-4478ca6e-14f2-4214-b043-8131a94ae70b req-785a0bd2-802a-473c-998e-18d9af515e93 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Received event network-changed-ea301764-93d8-4c55-a51f-5e50918be405 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:48:23 user nova-compute[73484]: DEBUG nova.compute.manager [req-4478ca6e-14f2-4214-b043-8131a94ae70b req-785a0bd2-802a-473c-998e-18d9af515e93 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Refreshing instance network info cache due to event network-changed-ea301764-93d8-4c55-a51f-5e50918be405. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:48:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4478ca6e-14f2-4214-b043-8131a94ae70b req-785a0bd2-802a-473c-998e-18d9af515e93 service nova] Acquiring lock "refresh_cache-b43ccb18-6d2d-43f2-a185-bb558d5d6f45" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:48:23 user nova-compute[73484]: DEBUG nova.network.neutron [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:48:24 user nova-compute[73484]: DEBUG nova.network.neutron [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Updating instance_info_cache with network_info: [{"id": "ea301764-93d8-4c55-a51f-5e50918be405", "address": "fa:16:3e:ff:7c:5c", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea301764-93", "ovs_interfaceid": "ea301764-93d8-4c55-a51f-5e50918be405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:48:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Releasing lock "refresh_cache-b43ccb18-6d2d-43f2-a185-bb558d5d6f45" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:48:24 user nova-compute[73484]: DEBUG nova.compute.manager [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Instance network_info: |[{"id": "ea301764-93d8-4c55-a51f-5e50918be405", "address": "fa:16:3e:ff:7c:5c", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea301764-93", "ovs_interfaceid": "ea301764-93d8-4c55-a51f-5e50918be405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:48:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4478ca6e-14f2-4214-b043-8131a94ae70b req-785a0bd2-802a-473c-998e-18d9af515e93 service nova] Acquired lock "refresh_cache-b43ccb18-6d2d-43f2-a185-bb558d5d6f45" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:48:24 user nova-compute[73484]: DEBUG nova.network.neutron [req-4478ca6e-14f2-4214-b043-8131a94ae70b req-785a0bd2-802a-473c-998e-18d9af515e93 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Refreshing network info cache for port ea301764-93d8-4c55-a51f-5e50918be405 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:48:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:48:24 user nova-compute[73484]: DEBUG nova.network.neutron [req-4478ca6e-14f2-4214-b043-8131a94ae70b req-785a0bd2-802a-473c-998e-18d9af515e93 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Updated VIF entry in instance network info cache for port ea301764-93d8-4c55-a51f-5e50918be405. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:48:24 user nova-compute[73484]: DEBUG nova.network.neutron [req-4478ca6e-14f2-4214-b043-8131a94ae70b req-785a0bd2-802a-473c-998e-18d9af515e93 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Updating instance_info_cache with network_info: [{"id": "ea301764-93d8-4c55-a51f-5e50918be405", "address": "fa:16:3e:ff:7c:5c", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea301764-93", "ovs_interfaceid": "ea301764-93d8-4c55-a51f-5e50918be405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:48:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4478ca6e-14f2-4214-b043-8131a94ae70b req-785a0bd2-802a-473c-998e-18d9af515e93 service nova] Releasing lock "refresh_cache-b43ccb18-6d2d-43f2-a185-bb558d5d6f45" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:48:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:48:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 13:48:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:48:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:48:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:29 user nova-compute[73484]: DEBUG nova.network.neutron [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Port 0b54646a-71ed-4087-adf7-66645e7d2907 binding to destination host user is already ACTIVE {{(pid=73484) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 14 13:48:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquiring lock "refresh_cache-09ba29fd-8161-485c-ba6d-71d24ab086bc" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:48:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquired lock "refresh_cache-09ba29fd-8161-485c-ba6d-71d24ab086bc" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:48:29 user nova-compute[73484]: DEBUG nova.network.neutron [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:48:29 user nova-compute[73484]: DEBUG nova.network.neutron [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Updating instance_info_cache with network_info: [{"id": "0b54646a-71ed-4087-adf7-66645e7d2907", "address": "fa:16:3e:30:6a:b2", "network": {"id": "a417bb93-b1ed-47a4-be83-6679c2ea34b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872770450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07a8a61d3f14061b44b8f37968c54e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b54646a-71", "ovs_interfaceid": "0b54646a-71ed-4087-adf7-66645e7d2907", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Releasing lock "refresh_cache-09ba29fd-8161-485c-ba6d-71d24ab086bc" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Creating tmpfile /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/tmp320qc6h6 to verify with other compute node that the instance is on the same shared storage. {{(pid=73484) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG nova.compute.manager [req-7261eeac-b258-43a2-b28c-83911805d6e8 req-6d4a8f31-316b-4319-9452-7fa56121f2a3 service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Received event network-vif-unplugged-0b54646a-71ed-4087-adf7-66645e7d2907 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-7261eeac-b258-43a2-b28c-83911805d6e8 req-6d4a8f31-316b-4319-9452-7fa56121f2a3 service nova] Acquiring lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-7261eeac-b258-43a2-b28c-83911805d6e8 req-6d4a8f31-316b-4319-9452-7fa56121f2a3 service nova] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-7261eeac-b258-43a2-b28c-83911805d6e8 req-6d4a8f31-316b-4319-9452-7fa56121f2a3 service nova] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG nova.compute.manager [req-7261eeac-b258-43a2-b28c-83911805d6e8 req-6d4a8f31-316b-4319-9452-7fa56121f2a3 service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] No waiting events found dispatching network-vif-unplugged-0b54646a-71ed-4087-adf7-66645e7d2907 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:48:30 user nova-compute[73484]: WARNING nova.compute.manager [req-7261eeac-b258-43a2-b28c-83911805d6e8 req-6d4a8f31-316b-4319-9452-7fa56121f2a3 service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Received unexpected event network-vif-unplugged-0b54646a-71ed-4087-adf7-66645e7d2907 for instance with vm_state resized and task_state resize_reverting.
Aug 14 13:48:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:30 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Instance destroyed successfully.
Aug 14 13:48:30 user nova-compute[73484]: DEBUG nova.objects.instance [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lazy-loading 'resources' on Instance uuid 09ba29fd-8161-485c-ba6d-71d24ab086bc {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:42:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1361765687',display_name='tempest-ServerActionsTestOtherB-server-1361765687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1361765687',id=20,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF57s7WDcr5LrA3gfxfpgDNJt6UZ/rZhkiS+Nfi/DIO/C85ZFU7Y17ny/O/CEqdXEP2/mm1AA46PPquOjl5qC1/2wZc0eZa1Tjpvt/2IPyALMO4YPxf1Hkqx4YMdA9qx2g==',key_name='tempest-keypair-345523160',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:47:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a07a8a61d3f14061b44b8f37968c54e9',ramdisk_id='',reservation_id='r-b3zcr056',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1221611824',owner_user_name='tempest-ServerActionsTestOtherB-1221611824-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:47:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55e77cc182bc4ec79429025c6a9f14af',uuid=09ba29fd-8161-485c-ba6d-71d24ab086bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "0b54646a-71ed-4087-adf7-66645e7d2907", "address": "fa:16:3e:30:6a:b2", "network": {"id": "a417bb93-b1ed-47a4-be83-6679c2ea34b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872770450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07a8a61d3f14061b44b8f37968c54e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b54646a-71", "ovs_interfaceid": "0b54646a-71ed-4087-adf7-66645e7d2907", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Converting VIF {"id": "0b54646a-71ed-4087-adf7-66645e7d2907", "address": "fa:16:3e:30:6a:b2", "network": {"id": "a417bb93-b1ed-47a4-be83-6679c2ea34b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872770450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07a8a61d3f14061b44b8f37968c54e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b54646a-71", "ovs_interfaceid": "0b54646a-71ed-4087-adf7-66645e7d2907", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:6a:b2,bridge_name='br-int',has_traffic_filtering=True,id=0b54646a-71ed-4087-adf7-66645e7d2907,network=Network(a417bb93-b1ed-47a4-be83-6679c2ea34b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b54646a-71') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG os_vif [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:6a:b2,bridge_name='br-int',has_traffic_filtering=True,id=0b54646a-71ed-4087-adf7-66645e7d2907,network=Network(a417bb93-b1ed-47a4-be83-6679c2ea34b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b54646a-71') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b54646a-71, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:48:30 user nova-compute[73484]: INFO os_vif [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:6a:b2,bridge_name='br-int',has_traffic_filtering=True,id=0b54646a-71ed-4087-adf7-66645e7d2907,network=Network(a417bb93-b1ed-47a4-be83-6679c2ea34b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b54646a-71')
Aug 14 13:48:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vMjRCghr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:48:30 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:48:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[038b165a-3221-4a5c-afad-fd4b0432655c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a905d4-b725-4870-a283-78d87a8d191f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:48:30 user nova-compute[73484]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:48:30 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:48:30 user nova-compute[73484]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:48:30 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4781bec20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781'): ({'sdc'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Removing single pathed devices sdc {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e23b947-b634-4441-b299-790763be746f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc57712-8bf5-444a-b605-7ca60d07222b]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Flushing IO for device /dev/sdc {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb2c039-5933-4223-ab4c-66d7adee684d]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:48:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6eb23b-46e6-43d3-a9e4-c3abea833297]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:31 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:48:31 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:48:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:48:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddd9ff7-63ef-4dc2-881e-7dcd17de65a6]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:48:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d80c5a-a940-4bbe-9f4a-4fadf2f34b1a]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781, portal: 172.16.0.220,3260]
Aug 14 13:48:31 user nova-compute[73484]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781, portal: 172.16.0.220,3260] successful.
Aug 14 13:48:31 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:48:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcce1bdb-2ec0-403e-9261-66a8db370bcc]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:48:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:48:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] <== disconnect_volume: return (297ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:48:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:48:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:48:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:48:32 user nova-compute[73484]: DEBUG nova.objects.instance [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lazy-loading 'migration_context' on Instance uuid 09ba29fd-8161-485c-ba6d-71d24ab086bc {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:48:32 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:48:32 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:48:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.470s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:48:32 user nova-compute[73484]: DEBUG os_brick.utils [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:48:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[df585b96-022b-4130-9352-a6070193ab6e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65cb500-6d66-436f-a321-e212cbf86869]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[da52338a-66ef-4e4f-acb0-f4ffa18350da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c038a8-a9ed-4b1e-bde0-2ad27061eb04]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:48:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:48:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:48:32 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:48:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[654fd9fe-d701-4731-bbb3-deb1cfbb8c1b]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:48:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:48:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:48:32 user nova-compute[73484]: DEBUG os_brick.utils [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:48:32 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Updating existing volume attachment record: fceddf5d-7872-4d0a-b02d-4daee70df0dd {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:48:32 user nova-compute[73484]: INFO nova.compute.manager [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Swapping old allocation on dict_keys(['165d4635-93b4-49a6-879a-21c1324822ab']) held by migration d3095941-fb94-498e-a661-cc4079498cc9 for instance
Aug 14 13:48:32 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Overwriting current allocation {'allocations': {'165d4635-93b4-49a6-879a-21c1324822ab': {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}, 'generation': 33}}, 'project_id': 'a07a8a61d3f14061b44b8f37968c54e9', 'user_id': '55e77cc182bc4ec79429025c6a9f14af', 'consumer_generation': 1} on consumer 09ba29fd-8161-485c-ba6d-71d24ab086bc {{(pid=73484) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 14 13:48:33 user nova-compute[73484]: DEBUG nova.compute.manager [req-faed4d48-d826-4dc8-974d-42fee8454390 req-e7255d01-96f5-4f40-bfae-dee8a1faee81 service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Received event network-vif-plugged-0b54646a-71ed-4087-adf7-66645e7d2907 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:48:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-faed4d48-d826-4dc8-974d-42fee8454390 req-e7255d01-96f5-4f40-bfae-dee8a1faee81 service nova] Acquiring lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:48:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-faed4d48-d826-4dc8-974d-42fee8454390 req-e7255d01-96f5-4f40-bfae-dee8a1faee81 service nova] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:48:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-faed4d48-d826-4dc8-974d-42fee8454390 req-e7255d01-96f5-4f40-bfae-dee8a1faee81 service nova] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:48:33 user nova-compute[73484]: DEBUG nova.compute.manager [req-faed4d48-d826-4dc8-974d-42fee8454390 req-e7255d01-96f5-4f40-bfae-dee8a1faee81 service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] No waiting events found dispatching network-vif-plugged-0b54646a-71ed-4087-adf7-66645e7d2907 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:48:33 user nova-compute[73484]: WARNING nova.compute.manager [req-faed4d48-d826-4dc8-974d-42fee8454390 req-e7255d01-96f5-4f40-bfae-dee8a1faee81 service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Received unexpected event network-vif-plugged-0b54646a-71ed-4087-adf7-66645e7d2907 for instance with vm_state resized and task_state resize_reverting.
Aug 14 13:48:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquiring lock "refresh_cache-09ba29fd-8161-485c-ba6d-71d24ab086bc" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:48:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquired lock "refresh_cache-09ba29fd-8161-485c-ba6d-71d24ab086bc" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:48:33 user nova-compute[73484]: DEBUG nova.network.neutron [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:48:33 user nova-compute[73484]: DEBUG nova.network.neutron [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Updating instance_info_cache with network_info: [{"id": "0b54646a-71ed-4087-adf7-66645e7d2907", "address": "fa:16:3e:30:6a:b2", "network": {"id": "a417bb93-b1ed-47a4-be83-6679c2ea34b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872770450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07a8a61d3f14061b44b8f37968c54e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b54646a-71", "ovs_interfaceid": "0b54646a-71ed-4087-adf7-66645e7d2907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:48:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Releasing lock "refresh_cache-09ba29fd-8161-485c-ba6d-71d24ab086bc" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:48:34 user nova-compute[73484]: DEBUG os_brick.utils [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:48:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda22a42-d71b-4af0-8e16-93ebf9a08fc9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede3c785-9fae-4359-99b3-7fdf611eb4af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e692eaf7-4e2e-4f23-9028-fe2d83193937]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[82eeb3a7-35fc-4a80-a8ba-b730f79e716d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:48:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:48:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:48:34 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:48:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad927243-c0ff-4f3c-b8b9-a2114f5dbe7b]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:48:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:48:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:48:34 user nova-compute[73484]: DEBUG os_brick.utils [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:48:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "72f007af-a1e7-4a80-954c-ed12aaf129fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:48:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "72f007af-a1e7-4a80-954c-ed12aaf129fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:48:36 user nova-compute[73484]: DEBUG nova.compute.manager [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:48:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:48:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:48:36 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:48:36 user nova-compute[73484]: INFO nova.compute.claims [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Claim successful on node user
Aug 14 13:48:37 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:48:37 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:48:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:48:37 user nova-compute[73484]: DEBUG nova.compute.manager [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:48:37 user nova-compute[73484]: DEBUG nova.compute.manager [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:48:37 user nova-compute[73484]: DEBUG nova.network.neutron [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:48:37 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:48:37 user nova-compute[73484]: DEBUG nova.compute.manager [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:48:37 user nova-compute[73484]: DEBUG nova.policy [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b22dfe5647e149a5b3a19d843f0efd66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9e3bd3df8a408e96e9054775c3cb83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:48:37 user nova-compute[73484]: INFO nova.virt.block_device [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Booting with volume cc7990bf-85e5-4d3a-9073-716c7875c812 at /dev/vda
Aug 14 13:48:37 user nova-compute[73484]: DEBUG os_brick.utils [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:48:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:37 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4f9744-e12b-4efd-8523-8c28b6d967e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:37 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90c8f9c-0007-415c-bc1c-3ffe459d8344]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:37 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[312d2520-5a75-4f85-b9fd-233e3542b843]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:37 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[059df908-009c-449e-bbfd-4741e81e5f4d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:48:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:48:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:48:37 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:48:37 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fc72d2-4557-46f3-bcff-d31570be2777]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:48:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:48:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:48:37 user nova-compute[73484]: DEBUG os_brick.utils [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:48:37 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Updating existing volume attachment record: ec0ffe61-de8a-4db1-8177-0efc0fdbc116 {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:48:38 user nova-compute[73484]: DEBUG nova.network.neutron [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Successfully created port: 19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:48:38 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:48:38 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 13:48:38 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Didn't find any instances for network info cache update. {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 13:48:39 user nova-compute[73484]: DEBUG nova.network.neutron [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Successfully updated port: 19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:48:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "refresh_cache-72f007af-a1e7-4a80-954c-ed12aaf129fd" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:48:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquired lock "refresh_cache-72f007af-a1e7-4a80-954c-ed12aaf129fd" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:48:39 user nova-compute[73484]: DEBUG nova.network.neutron [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:48:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-f6121b82-cf19-4b4b-a7cf-e2e63259f058 req-e0e625d2-84f8-4102-8068-7da2616d46a2 service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Received event network-changed-19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:48:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-f6121b82-cf19-4b4b-a7cf-e2e63259f058 req-e0e625d2-84f8-4102-8068-7da2616d46a2 service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Refreshing instance network info cache due to event network-changed-19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:48:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f6121b82-cf19-4b4b-a7cf-e2e63259f058 req-e0e625d2-84f8-4102-8068-7da2616d46a2 service nova] Acquiring lock "refresh_cache-72f007af-a1e7-4a80-954c-ed12aaf129fd" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:48:39 user nova-compute[73484]: DEBUG nova.network.neutron [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:48:39 user nova-compute[73484]: DEBUG nova.network.neutron [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Updating instance_info_cache with network_info: [{"id": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "address": "fa:16:3e:22:ea:2c", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f75cf0-c8", "ovs_interfaceid": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:48:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Releasing lock "refresh_cache-72f007af-a1e7-4a80-954c-ed12aaf129fd" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:48:39 user nova-compute[73484]: DEBUG nova.compute.manager [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Instance network_info: |[{"id": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "address": "fa:16:3e:22:ea:2c", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f75cf0-c8", "ovs_interfaceid": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:48:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f6121b82-cf19-4b4b-a7cf-e2e63259f058 req-e0e625d2-84f8-4102-8068-7da2616d46a2 service nova] Acquired lock "refresh_cache-72f007af-a1e7-4a80-954c-ed12aaf129fd" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:48:39 user nova-compute[73484]: DEBUG nova.network.neutron [req-f6121b82-cf19-4b4b-a7cf-e2e63259f058 req-e0e625d2-84f8-4102-8068-7da2616d46a2 service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Refreshing network info cache for port 19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:48:39 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:48:39 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:48:39 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 13:48:40 user nova-compute[73484]: DEBUG nova.network.neutron [req-f6121b82-cf19-4b4b-a7cf-e2e63259f058 req-e0e625d2-84f8-4102-8068-7da2616d46a2 service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Updated VIF entry in instance network info cache for port 19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:48:40 user nova-compute[73484]: DEBUG nova.network.neutron [req-f6121b82-cf19-4b4b-a7cf-e2e63259f058 req-e0e625d2-84f8-4102-8068-7da2616d46a2 service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Updating instance_info_cache with network_info: [{"id": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "address": "fa:16:3e:22:ea:2c", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f75cf0-c8", "ovs_interfaceid": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:48:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f6121b82-cf19-4b4b-a7cf-e2e63259f058 req-e0e625d2-84f8-4102-8068-7da2616d46a2 service nova] Releasing lock "refresh_cache-72f007af-a1e7-4a80-954c-ed12aaf129fd" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:48:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG nova.compute.manager [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:48:42 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Creating image(s)
Aug 14 13:48:42 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Did not create local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Ensure instance console log exists: /opt/stack/data/nova/instances/b43ccb18-6d2d-43f2-a185-bb558d5d6f45/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Start _get_guest_xml network_info=[{"id": "ea301764-93d8-4c55-a51f-5e50918be405", "address": "fa:16:3e:ff:7c:5c", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea301764-93", "ovs_interfaceid": "ea301764-93d8-4c55-a51f-5e50918be405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'fceddf5d-7872-4d0a-b02d-4daee70df0dd', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikJcqojh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b43ccb18-6d2d-43f2-a185-bb558d5d6f45', 'attached_at': '', 'detached_at': '', 'volume_id': '15530639-5fd1-464f-895c-1db1b454c158', 'serial': '15530639-5fd1-464f-895c-1db1b454c158'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:48:42 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:48:42 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:48:42 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikJcqojh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:48:42 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:48:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:48:42 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:48:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:48:42 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e358d2-b9f4-42c8-ba7a-71317f98c568]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:48:42 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[481e4ca8-21f2-45fc-8023-4d7decbe3695]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158] added
Aug 14 13:48:42 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3431dc-a8cf-463d-bc95-1b1215eff52f]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b25cd1-bdc6-42a9-af20-56d7770c5266]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ikJcqojh {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ikJcqojh" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46a1374-ef2d-4d27-881d-b318426f6ca9]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ikJcqojh'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec464bb-9b9c-4f32-a791-2606c7b27fe6]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[02041aab-060b-4f79-af2a-8f6374d0f9b4]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:48:42 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:48:42 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[376e0378-2afa-40a5-b2db-9948ca40550c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158, portal: 172.16.0.220,3260]
Aug 14 13:48:42 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158, portal: 172.16.0.220,3260] successful.
Aug 14 13:48:42 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f1c8bc-9a02-4dac-a73f-1fa79a0d21b7]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f701c90a-0be4-42da-bf8e-51ca36b963fb]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:48:42 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:48:42 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:48:42 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:48:42 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[555043af-d841-42d6-a0fd-4698f3cd329f]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikJcqojh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:48:42 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 13:48:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:48:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:43 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:48:43 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26335356533383435', 'path': '/dev/sdc'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:48:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335356533383435', 'path': '/dev/sdc'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:48:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:48:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1059435803',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1059435803',id=28,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c7f2c51c0f84bf1aedcf493a9ff860f',ramdisk_id='',reservation_id='r-0us4hfk6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-830908511',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:48:22Z,user_data=None,user_id='5a0f55ad018d4c0ca587d8bdd40df4c8',uuid=b43ccb18-6d2d-43f2-a185-bb558d5d6f45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea301764-93d8-4c55-a51f-5e50918be405", "address": "fa:16:3e:ff:7c:5c", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea301764-93", "ovs_interfaceid": "ea301764-93d8-4c55-a51f-5e50918be405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:48:43 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Converting VIF {"id": "ea301764-93d8-4c55-a51f-5e50918be405", "address": "fa:16:3e:ff:7c:5c", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea301764-93", "ovs_interfaceid": "ea301764-93d8-4c55-a51f-5e50918be405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:48:43 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:7c:5c,bridge_name='br-int',has_traffic_filtering=True,id=ea301764-93d8-4c55-a51f-5e50918be405,network=Network(4ec437fc-4371-48d6-8026-b64423fbc0ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea301764-93') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:48:43 user nova-compute[73484]: DEBUG nova.objects.instance [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lazy-loading 'pci_devices' on Instance uuid b43ccb18-6d2d-43f2-a185-bb558d5d6f45 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:48:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:48:43 user nova-compute[73484]:   <uuid>b43ccb18-6d2d-43f2-a185-bb558d5d6f45</uuid>
Aug 14 13:48:43 user nova-compute[73484]:   <name>instance-0000001c</name>
Aug 14 13:48:43 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:48:43 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:48:43 user nova-compute[73484]:   <metadata>
Aug 14 13:48:43 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:48:43 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:48:43 user nova-compute[73484]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1059435803</nova:name>
Aug 14 13:48:43 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:48:42</nova:creationTime>
Aug 14 13:48:43 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:48:43 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:48:43 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:48:43 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:48:43 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:48:43 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:48:43 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:48:43 user nova-compute[73484]:       <nova:owner>
Aug 14 13:48:43 user nova-compute[73484]:         <nova:user uuid="5a0f55ad018d4c0ca587d8bdd40df4c8">tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member</nova:user>
Aug 14 13:48:43 user nova-compute[73484]:         <nova:project uuid="2c7f2c51c0f84bf1aedcf493a9ff860f">tempest-ServerBootFromVolumeStableRescueTest-830908511</nova:project>
Aug 14 13:48:43 user nova-compute[73484]:       </nova:owner>
Aug 14 13:48:43 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:48:43 user nova-compute[73484]:       <nova:ports>
Aug 14 13:48:43 user nova-compute[73484]:         <nova:port uuid="ea301764-93d8-4c55-a51f-5e50918be405">
Aug 14 13:48:43 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 13:48:43 user nova-compute[73484]:         </nova:port>
Aug 14 13:48:43 user nova-compute[73484]:       </nova:ports>
Aug 14 13:48:43 user nova-compute[73484]:     </nova:instance>
Aug 14 13:48:43 user nova-compute[73484]:   </metadata>
Aug 14 13:48:43 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:48:43 user nova-compute[73484]:     <system>
Aug 14 13:48:43 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:48:43 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:48:43 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:48:43 user nova-compute[73484]:       <entry name="serial">b43ccb18-6d2d-43f2-a185-bb558d5d6f45</entry>
Aug 14 13:48:43 user nova-compute[73484]:       <entry name="uuid">b43ccb18-6d2d-43f2-a185-bb558d5d6f45</entry>
Aug 14 13:48:43 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:48:43 user nova-compute[73484]:     </system>
Aug 14 13:48:43 user nova-compute[73484]:   </sysinfo>
Aug 14 13:48:43 user nova-compute[73484]:   <os>
Aug 14 13:48:43 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:48:43 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:48:43 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:48:43 user nova-compute[73484]:   </os>
Aug 14 13:48:43 user nova-compute[73484]:   <features>
Aug 14 13:48:43 user nova-compute[73484]:     <acpi/>
Aug 14 13:48:43 user nova-compute[73484]:     <apic/>
Aug 14 13:48:43 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:48:43 user nova-compute[73484]:   </features>
Aug 14 13:48:43 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:48:43 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:48:43 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:48:43 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:48:43 user nova-compute[73484]:   </clock>
Aug 14 13:48:43 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:48:43 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:48:43 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:48:43 user nova-compute[73484]:   </cpu>
Aug 14 13:48:43 user nova-compute[73484]:   <devices>
Aug 14 13:48:43 user nova-compute[73484]:     <disk type="block" device="disk">
Aug 14 13:48:43 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:48:43 user nova-compute[73484]:       <source dev="/dev/sdc"/>
Aug 14 13:48:43 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:48:43 user nova-compute[73484]:       <serial>15530639-5fd1-464f-895c-1db1b454c158</serial>
Aug 14 13:48:43 user nova-compute[73484]:     </disk>
Aug 14 13:48:43 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:48:43 user nova-compute[73484]:       <mac address="fa:16:3e:ff:7c:5c"/>
Aug 14 13:48:43 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:48:43 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:48:43 user nova-compute[73484]:       <target dev="tapea301764-93"/>
Aug 14 13:48:43 user nova-compute[73484]:     </interface>
Aug 14 13:48:43 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:48:43 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/b43ccb18-6d2d-43f2-a185-bb558d5d6f45/console.log" append="off"/>
Aug 14 13:48:43 user nova-compute[73484]:     </serial>
Aug 14 13:48:43 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:48:43 user nova-compute[73484]:     <video>
Aug 14 13:48:43 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:48:43 user nova-compute[73484]:     </video>
Aug 14 13:48:43 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:48:43 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:48:43 user nova-compute[73484]:     </rng>
Aug 14 13:48:43 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:48:43 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:48:43 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:48:43 user nova-compute[73484]:     </memballoon>
Aug 14 13:48:43 user nova-compute[73484]:   </devices>
Aug 14 13:48:43 user nova-compute[73484]: </domain>
Aug 14 13:48:43 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:48:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:48:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1059435803',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1059435803',id=28,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c7f2c51c0f84bf1aedcf493a9ff860f',ramdisk_id='',reservation_id='r-0us4hfk6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-830908511',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:48:22Z,user_data=None,user_id='5a0f55ad018d4c0ca587d8bdd40df4c8',uuid=b43ccb18-6d2d-43f2-a185-bb558d5d6f45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea301764-93d8-4c55-a51f-5e50918be405", "address": "fa:16:3e:ff:7c:5c", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea301764-93", "ovs_interfaceid": "ea301764-93d8-4c55-a51f-5e50918be405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:48:43 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Converting VIF {"id": "ea301764-93d8-4c55-a51f-5e50918be405", "address": "fa:16:3e:ff:7c:5c", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea301764-93", "ovs_interfaceid": "ea301764-93d8-4c55-a51f-5e50918be405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:48:43 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:7c:5c,bridge_name='br-int',has_traffic_filtering=True,id=ea301764-93d8-4c55-a51f-5e50918be405,network=Network(4ec437fc-4371-48d6-8026-b64423fbc0ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea301764-93') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:48:43 user nova-compute[73484]: DEBUG os_vif [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:7c:5c,bridge_name='br-int',has_traffic_filtering=True,id=ea301764-93d8-4c55-a51f-5e50918be405,network=Network(4ec437fc-4371-48d6-8026-b64423fbc0ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea301764-93') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:48:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:48:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:48:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea301764-93, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:48:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapea301764-93, col_values=(('external_ids', {'iface-id': 'ea301764-93d8-4c55-a51f-5e50918be405', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:7c:5c', 'vm-uuid': 'b43ccb18-6d2d-43f2-a185-bb558d5d6f45'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:48:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:48:43 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:43 user nova-compute[73484]: INFO os_vif [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:7c:5c,bridge_name='br-int',has_traffic_filtering=True,id=ea301764-93d8-4c55-a51f-5e50918be405,network=Network(4ec437fc-4371-48d6-8026-b64423fbc0ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea301764-93')
Aug 14 13:48:44 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:48:44 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] No VIF found with MAC fa:16:3e:ff:7c:5c, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:48:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:45 user nova-compute[73484]: DEBUG nova.compute.manager [req-cf0aade1-567a-46b5-871e-f406b3641355 req-ae075733-41b0-499a-9dd4-a1ebd585f657 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Received event network-vif-plugged-ea301764-93d8-4c55-a51f-5e50918be405 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:48:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-cf0aade1-567a-46b5-871e-f406b3641355 req-ae075733-41b0-499a-9dd4-a1ebd585f657 service nova] Acquiring lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:48:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-cf0aade1-567a-46b5-871e-f406b3641355 req-ae075733-41b0-499a-9dd4-a1ebd585f657 service nova] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:48:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-cf0aade1-567a-46b5-871e-f406b3641355 req-ae075733-41b0-499a-9dd4-a1ebd585f657 service nova] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:48:45 user nova-compute[73484]: DEBUG nova.compute.manager [req-cf0aade1-567a-46b5-871e-f406b3641355 req-ae075733-41b0-499a-9dd4-a1ebd585f657 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] No waiting events found dispatching network-vif-plugged-ea301764-93d8-4c55-a51f-5e50918be405 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:48:45 user nova-compute[73484]: WARNING nova.compute.manager [req-cf0aade1-567a-46b5-871e-f406b3641355 req-ae075733-41b0-499a-9dd4-a1ebd585f657 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Received unexpected event network-vif-plugged-ea301764-93d8-4c55-a51f-5e50918be405 for instance with vm_state building and task_state spawning.
Aug 14 13:48:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:45 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692020910.82029, 09ba29fd-8161-485c-ba6d-71d24ab086bc => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:48:45 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] VM Stopped (Lifecycle Event)
Aug 14 13:48:45 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6aa614d7-0b73-4575-b6c0-c0aa7637e6ea None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:48:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2545f107-974a-4ee8-ba9b-7d7f7bb1ae91/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2545f107-974a-4ee8-ba9b-7d7f7bb1ae91/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2545f107-974a-4ee8-ba9b-7d7f7bb1ae91/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2545f107-974a-4ee8-ba9b-7d7f7bb1ae91/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020927.502954, b43ccb18-6d2d-43f2-a185-bb558d5d6f45 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:48:47 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] VM Resumed (Lifecycle Event)
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:48:47 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:48:47 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=7498MB free_disk=25.270214080810547GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:48:47 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Instance spawned successfully.
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.compute.manager [req-d9e4b26a-f326-4182-a209-42d628c59d34 req-ee36a298-28c4-4f12-a7f6-b99b8e81c6c7 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Received event network-vif-plugged-ea301764-93d8-4c55-a51f-5e50918be405 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d9e4b26a-f326-4182-a209-42d628c59d34 req-ee36a298-28c4-4f12-a7f6-b99b8e81c6c7 service nova] Acquiring lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d9e4b26a-f326-4182-a209-42d628c59d34 req-ee36a298-28c4-4f12-a7f6-b99b8e81c6c7 service nova] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d9e4b26a-f326-4182-a209-42d628c59d34 req-ee36a298-28c4-4f12-a7f6-b99b8e81c6c7 service nova] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.compute.manager [req-d9e4b26a-f326-4182-a209-42d628c59d34 req-ee36a298-28c4-4f12-a7f6-b99b8e81c6c7 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] No waiting events found dispatching network-vif-plugged-ea301764-93d8-4c55-a51f-5e50918be405 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:48:47 user nova-compute[73484]: WARNING nova.compute.manager [req-d9e4b26a-f326-4182-a209-42d628c59d34 req-ee36a298-28c4-4f12-a7f6-b99b8e81c6c7 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Received unexpected event network-vif-plugged-ea301764-93d8-4c55-a51f-5e50918be405 for instance with vm_state building and task_state spawning.
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:48:47 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020927.5038087, b43ccb18-6d2d-43f2-a185-bb558d5d6f45 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:48:47 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] VM Started (Lifecycle Event)
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:48:47 user nova-compute[73484]: INFO nova.compute.manager [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Took 5.45 seconds to spawn the instance on the hypervisor.
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:48:47 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:48:47 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Creating image(s)
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Did not create local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Ensure instance console log exists: /opt/stack/data/nova/instances/72f007af-a1e7-4a80-954c-ed12aaf129fd/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Start _get_guest_xml network_info=[{"id": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "address": "fa:16:3e:22:ea:2c", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f75cf0-c8", "ovs_interfaceid": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ec0ffe61-de8a-4db1-8177-0efc0fdbc116', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EqNPGcOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '72f007af-a1e7-4a80-954c-ed12aaf129fd', 'attached_at': '', 'detached_at': '', 'volume_id': 'cc7990bf-85e5-4d3a-9073-716c7875c812', 'serial': 'cc7990bf-85e5-4d3a-9073-716c7875c812'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:48:47 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:48:47 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance f4f7788c-fcca-47c1-b5b8-72892253982d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 07bac569-8b2c-4555-b4d5-a74f7384630b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance a9d4ec42-3db9-439b-87a7-02bcaab514a4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance bd43e3a9-0413-4e55-b6a1-7f3f792ba872 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance c0994bac-3b43-414e-aa81-a9d7198775a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 782c6142-757a-49ae-9292-787a7f1e8a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 03255d24-b6fd-459c-8ac6-f9c4063b54b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 700e95c1-08b0-4613-992b-4314b127e14a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance b43ccb18-6d2d-43f2-a185-bb558d5d6f45 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 09ba29fd-8161-485c-ba6d-71d24ab086bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 72f007af-a1e7-4a80-954c-ed12aaf129fd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EqNPGcOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:48:47 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:48:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:48:47 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:48:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:48:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:48:47 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:48:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:47 user nova-compute[73484]: INFO nova.compute.manager [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Took 26.69 seconds to build instance.
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[029e8c6e-5ae4-4b8a-949f-349159540d16]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:48:48 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc6813b-12fd-4482-834b-4d27c2ec1cd6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812] added
Aug 14 13:48:48 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-72aea941-0a03-4528-9ed7-44d56648e16d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.828s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9f114c-ff69-4e25-940e-e7a00dd1aee9]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5807d2-ce4b-4adb-9d2a-53a6788a43c2]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EqNPGcOn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EqNPGcOn" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[70593945-4c45-4c40-a305-cbc631f54c7b]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EqNPGcOn'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6119fd-c0ef-4300-bacd-0abaff9ad1f6]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7adc37-26d0-457d-9bc4-b2dfb4d91f31]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:48:48 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:48:48 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:48:48 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:48:48 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[535481dc-8ef9-4f72-ac2e-0f4a743733b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812, portal: 172.16.0.220,3260]
Aug 14 13:48:48 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812, portal: 172.16.0.220,3260] successful.
Aug 14 13:48:48 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fe685d-fecc-4d55-bf65-43de6373c2c0]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85ede2a-7dcb-4fc8-b41f-49b2a9d33d4c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:48:48 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:48:48 user nova-compute[73484]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:48:48 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:48:48 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:48:48 user nova-compute[73484]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:48:48 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.061s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cfdb80-73ad-4acf-ba68-f6fd6a73af6c]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: None {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.757s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:48:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Starting finish_revert_migration {{(pid=73484) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Start _get_guest_xml network_info=[{"id": "0b54646a-71ed-4087-adf7-66645e7d2907", "address": "fa:16:3e:30:6a:b2", "network": {"id": "a417bb93-b1ed-47a4-be83-6679c2ea34b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872770450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07a8a61d3f14061b44b8f37968c54e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b54646a-71", "ovs_interfaceid": "0b54646a-71ed-4087-adf7-66645e7d2907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '88d00781-881c-46a9-adad-06cba1eb2566', 'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vMjRCghr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '09ba29fd-8161-485c-ba6d-71d24ab086bc', 'attached_at': '2023-08-14T13:48:49.000000', 'detached_at': '', 'volume_id': 'b76da63f-391a-4087-8ffd-19c9648cd781', 'serial': 'b76da63f-391a-4087-8ffd-19c9648cd781'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:48:49 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:48:49 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:48:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG nova.objects.instance [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lazy-loading 'vcpu_model' on Instance uuid 09ba29fd-8161-485c-ba6d-71d24ab086bc {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vMjRCghr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:48:49 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:48:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EqNPGcOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '23966663566306231', 'path': '/dev/sdd'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966663566306231', 'path': '/dev/sdd'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.169s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:48:49 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:48:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:48:49 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1769794670',display_name='tempest-ServerActionsTestOtherA-server-1769794670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1769794670',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+U0YM0H+9FtSMWW9gC7hlmEYl+cufNxOVmMIw8gQGmCCRzcGdOpZ2rClVjHI02XniG6rU6cneNsbww6ySr+rPSIW5KD8/op2pTaoCA25ZKyUod+b+1u3EAmeZWFbiG0g==',key_name='tempest-keypair-1679559247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff9e3bd3df8a408e96e9054775c3cb83',ramdisk_id='',reservation_id='r-50052euq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2033458528',owner_user_name='tempest-ServerActionsTestOtherA-2033458528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:48:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b22dfe5647e149a5b3a19d843f0efd66',uuid=72f007af-a1e7-4a80-954c-ed12aaf129fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "address": "fa:16:3e:22:ea:2c", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f75cf0-c8", "ovs_interfaceid": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Converting VIF {"id": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "address": "fa:16:3e:22:ea:2c", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f75cf0-c8", "ovs_interfaceid": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:ea:2c,bridge_name='br-int',has_traffic_filtering=True,id=19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19f75cf0-c8') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG nova.objects.instance [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lazy-loading 'pci_devices' on Instance uuid 72f007af-a1e7-4a80-954c-ed12aaf129fd {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[23491675-1807-4431-9682-6ff5f230af2e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:48:49 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:48:49 user nova-compute[73484]:   <uuid>72f007af-a1e7-4a80-954c-ed12aaf129fd</uuid>
Aug 14 13:48:49 user nova-compute[73484]:   <name>instance-0000001d</name>
Aug 14 13:48:49 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:48:49 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:48:49 user nova-compute[73484]:   <metadata>
Aug 14 13:48:49 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:48:49 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:48:49 user nova-compute[73484]:       <nova:name>tempest-ServerActionsTestOtherA-server-1769794670</nova:name>
Aug 14 13:48:49 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:48:47</nova:creationTime>
Aug 14 13:48:49 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:48:49 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:48:49 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:48:49 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:48:49 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:48:49 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:48:49 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:48:49 user nova-compute[73484]:       <nova:owner>
Aug 14 13:48:49 user nova-compute[73484]:         <nova:user uuid="b22dfe5647e149a5b3a19d843f0efd66">tempest-ServerActionsTestOtherA-2033458528-project-member</nova:user>
Aug 14 13:48:49 user nova-compute[73484]:         <nova:project uuid="ff9e3bd3df8a408e96e9054775c3cb83">tempest-ServerActionsTestOtherA-2033458528</nova:project>
Aug 14 13:48:49 user nova-compute[73484]:       </nova:owner>
Aug 14 13:48:49 user nova-compute[73484]:       <nova:ports>
Aug 14 13:48:49 user nova-compute[73484]:         <nova:port uuid="19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9">
Aug 14 13:48:49 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 13:48:49 user nova-compute[73484]:         </nova:port>
Aug 14 13:48:49 user nova-compute[73484]:       </nova:ports>
Aug 14 13:48:49 user nova-compute[73484]:     </nova:instance>
Aug 14 13:48:49 user nova-compute[73484]:   </metadata>
Aug 14 13:48:49 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:48:49 user nova-compute[73484]:     <system>
Aug 14 13:48:49 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:48:49 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:48:49 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:48:49 user nova-compute[73484]:       <entry name="serial">72f007af-a1e7-4a80-954c-ed12aaf129fd</entry>
Aug 14 13:48:49 user nova-compute[73484]:       <entry name="uuid">72f007af-a1e7-4a80-954c-ed12aaf129fd</entry>
Aug 14 13:48:49 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:48:49 user nova-compute[73484]:     </system>
Aug 14 13:48:49 user nova-compute[73484]:   </sysinfo>
Aug 14 13:48:49 user nova-compute[73484]:   <os>
Aug 14 13:48:49 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:48:49 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:48:49 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:48:49 user nova-compute[73484]:   </os>
Aug 14 13:48:49 user nova-compute[73484]:   <features>
Aug 14 13:48:49 user nova-compute[73484]:     <acpi/>
Aug 14 13:48:49 user nova-compute[73484]:     <apic/>
Aug 14 13:48:49 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:48:49 user nova-compute[73484]:   </features>
Aug 14 13:48:49 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:48:49 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:48:49 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:48:49 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:48:49 user nova-compute[73484]:   </clock>
Aug 14 13:48:49 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:48:49 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:48:49 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:48:49 user nova-compute[73484]:   </cpu>
Aug 14 13:48:49 user nova-compute[73484]:   <devices>
Aug 14 13:48:49 user nova-compute[73484]:     <disk type="block" device="disk">
Aug 14 13:48:49 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:48:49 user nova-compute[73484]:       <source dev="/dev/sdd"/>
Aug 14 13:48:49 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:48:49 user nova-compute[73484]:       <serial>cc7990bf-85e5-4d3a-9073-716c7875c812</serial>
Aug 14 13:48:49 user nova-compute[73484]:     </disk>
Aug 14 13:48:49 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:48:49 user nova-compute[73484]:       <mac address="fa:16:3e:22:ea:2c"/>
Aug 14 13:48:49 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:48:49 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:48:49 user nova-compute[73484]:       <target dev="tap19f75cf0-c8"/>
Aug 14 13:48:49 user nova-compute[73484]:     </interface>
Aug 14 13:48:49 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:48:49 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/72f007af-a1e7-4a80-954c-ed12aaf129fd/console.log" append="off"/>
Aug 14 13:48:49 user nova-compute[73484]:     </serial>
Aug 14 13:48:49 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:48:49 user nova-compute[73484]:     <video>
Aug 14 13:48:49 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:48:49 user nova-compute[73484]:     </video>
Aug 14 13:48:49 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:48:49 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:48:49 user nova-compute[73484]:     </rng>
Aug 14 13:48:49 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:48:49 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:48:49 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:48:49 user nova-compute[73484]:     </memballoon>
Aug 14 13:48:49 user nova-compute[73484]:   </devices>
Aug 14 13:48:49 user nova-compute[73484]: </domain>
Aug 14 13:48:49 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1769794670',display_name='tempest-ServerActionsTestOtherA-server-1769794670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1769794670',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+U0YM0H+9FtSMWW9gC7hlmEYl+cufNxOVmMIw8gQGmCCRzcGdOpZ2rClVjHI02XniG6rU6cneNsbww6ySr+rPSIW5KD8/op2pTaoCA25ZKyUod+b+1u3EAmeZWFbiG0g==',key_name='tempest-keypair-1679559247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff9e3bd3df8a408e96e9054775c3cb83',ramdisk_id='',reservation_id='r-50052euq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2033458528',owner_user_name='tempest-ServerActionsTestOtherA-2033458528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:48:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b22dfe5647e149a5b3a19d843f0efd66',uuid=72f007af-a1e7-4a80-954c-ed12aaf129fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "address": "fa:16:3e:22:ea:2c", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f75cf0-c8", "ovs_interfaceid": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Converting VIF {"id": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "address": "fa:16:3e:22:ea:2c", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f75cf0-c8", "ovs_interfaceid": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:ea:2c,bridge_name='br-int',has_traffic_filtering=True,id=19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19f75cf0-c8') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG os_vif [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:ea:2c,bridge_name='br-int',has_traffic_filtering=True,id=19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19f75cf0-c8') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6599e2aa-6a0d-4bf5-9ff2-dc8400aa6883]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781] added
Aug 14 13:48:49 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19f75cf0-c8, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap19f75cf0-c8, col_values=(('external_ids', {'iface-id': '19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:ea:2c', 'vm-uuid': '72f007af-a1e7-4a80-954c-ed12aaf129fd'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:49 user nova-compute[73484]: INFO os_vif [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:ea:2c,bridge_name='br-int',has_traffic_filtering=True,id=19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19f75cf0-c8')
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d63d155-726d-4b42-b2cf-34fffdf42861]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3dd115-3786-437e-b706-a9a0bd7a72e6]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vMjRCghr {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] No VIF found with MAC fa:16:3e:22:ea:2c, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vMjRCghr" returned: 0 in 0.027s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a39c931-5d5d-452d-8f5f-c98d6aa535d4]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vMjRCghr'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f1cc92-bc06-4397-b79e-45163fe63f6a]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[42857aff-7e58-48b6-9870-80e9603588d7]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:48:49 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:48:49 user nova-compute[73484]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:48:49 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:48:49 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:48:49 user nova-compute[73484]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:48:49 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d3bdb1-3e8d-4931-9c4b-f9b592df46cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781, portal: 172.16.0.220,3260]
Aug 14 13:48:49 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781, portal: 172.16.0.220,3260] successful.
Aug 14 13:48:49 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[29504342-8b92-41a3-8517-345e4538a02a]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9f51f0-65fd-4177-acc6-7a1fcf13f88e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:48:49 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:48:49 user nova-compute[73484]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:48:49 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:48:49 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:48:49 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:48:49 user nova-compute[73484]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:48:49 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:48:49 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4cefc2-3b4d-4b31-ba57-57c2bd1ebfc6]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:48:49 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vMjRCghr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:48:50 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:48:50 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:48:50 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:48:50 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:48:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:48:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] <== connect_volume: return (1538ms) {'type': 'block', 'scsi_wwn': '26661303130656435', 'path': '/dev/sde'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:48:50 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661303130656435', 'path': '/dev/sde'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:48:50 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:42:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1361765687',display_name='tempest-ServerActionsTestOtherB-server-1361765687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1361765687',id=20,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF57s7WDcr5LrA3gfxfpgDNJt6UZ/rZhkiS+Nfi/DIO/C85ZFU7Y17ny/O/CEqdXEP2/mm1AA46PPquOjl5qC1/2wZc0eZa1Tjpvt/2IPyALMO4YPxf1Hkqx4YMdA9qx2g==',key_name='tempest-keypair-345523160',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:47:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a07a8a61d3f14061b44b8f37968c54e9',ramdisk_id='',reservation_id='r-b3zcr056',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1221611824',owner_user_name='tempest-ServerActionsTestOtherB-1221611824-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:48:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55e77cc182bc4ec79429025c6a9f14af',uuid=09ba29fd-8161-485c-ba6d-71d24ab086bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "0b54646a-71ed-4087-adf7-66645e7d2907", "address": "fa:16:3e:30:6a:b2", "network": {"id": "a417bb93-b1ed-47a4-be83-6679c2ea34b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872770450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07a8a61d3f14061b44b8f37968c54e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b54646a-71", "ovs_interfaceid": "0b54646a-71ed-4087-adf7-66645e7d2907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:48:50 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Converting VIF {"id": "0b54646a-71ed-4087-adf7-66645e7d2907", "address": "fa:16:3e:30:6a:b2", "network": {"id": "a417bb93-b1ed-47a4-be83-6679c2ea34b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872770450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07a8a61d3f14061b44b8f37968c54e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b54646a-71", "ovs_interfaceid": "0b54646a-71ed-4087-adf7-66645e7d2907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:48:50 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:6a:b2,bridge_name='br-int',has_traffic_filtering=True,id=0b54646a-71ed-4087-adf7-66645e7d2907,network=Network(a417bb93-b1ed-47a4-be83-6679c2ea34b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b54646a-71') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:48:50 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:48:50 user nova-compute[73484]:   <uuid>09ba29fd-8161-485c-ba6d-71d24ab086bc</uuid>
Aug 14 13:48:50 user nova-compute[73484]:   <name>instance-00000014</name>
Aug 14 13:48:50 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:48:50 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:48:50 user nova-compute[73484]:   <metadata>
Aug 14 13:48:50 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:48:50 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:48:50 user nova-compute[73484]:       <nova:name>tempest-ServerActionsTestOtherB-server-1361765687</nova:name>
Aug 14 13:48:50 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:48:49</nova:creationTime>
Aug 14 13:48:50 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:48:50 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:48:50 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:48:50 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:48:50 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:48:50 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:48:50 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:48:50 user nova-compute[73484]:       <nova:owner>
Aug 14 13:48:50 user nova-compute[73484]:         <nova:user uuid="55e77cc182bc4ec79429025c6a9f14af">tempest-ServerActionsTestOtherB-1221611824-project-member</nova:user>
Aug 14 13:48:50 user nova-compute[73484]:         <nova:project uuid="a07a8a61d3f14061b44b8f37968c54e9">tempest-ServerActionsTestOtherB-1221611824</nova:project>
Aug 14 13:48:50 user nova-compute[73484]:       </nova:owner>
Aug 14 13:48:50 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:48:50 user nova-compute[73484]:       <nova:ports>
Aug 14 13:48:50 user nova-compute[73484]:         <nova:port uuid="0b54646a-71ed-4087-adf7-66645e7d2907">
Aug 14 13:48:50 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 13:48:50 user nova-compute[73484]:         </nova:port>
Aug 14 13:48:50 user nova-compute[73484]:       </nova:ports>
Aug 14 13:48:50 user nova-compute[73484]:     </nova:instance>
Aug 14 13:48:50 user nova-compute[73484]:   </metadata>
Aug 14 13:48:50 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:48:50 user nova-compute[73484]:     <system>
Aug 14 13:48:50 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:48:50 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:48:50 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:48:50 user nova-compute[73484]:       <entry name="serial">09ba29fd-8161-485c-ba6d-71d24ab086bc</entry>
Aug 14 13:48:50 user nova-compute[73484]:       <entry name="uuid">09ba29fd-8161-485c-ba6d-71d24ab086bc</entry>
Aug 14 13:48:50 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:48:50 user nova-compute[73484]:     </system>
Aug 14 13:48:50 user nova-compute[73484]:   </sysinfo>
Aug 14 13:48:50 user nova-compute[73484]:   <os>
Aug 14 13:48:50 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:48:50 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:48:50 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:48:50 user nova-compute[73484]:   </os>
Aug 14 13:48:50 user nova-compute[73484]:   <features>
Aug 14 13:48:50 user nova-compute[73484]:     <acpi/>
Aug 14 13:48:50 user nova-compute[73484]:     <apic/>
Aug 14 13:48:50 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:48:50 user nova-compute[73484]:   </features>
Aug 14 13:48:50 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:48:50 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:48:50 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:48:50 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:48:50 user nova-compute[73484]:   </clock>
Aug 14 13:48:50 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:48:50 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:48:50 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:48:50 user nova-compute[73484]:   </cpu>
Aug 14 13:48:50 user nova-compute[73484]:   <devices>
Aug 14 13:48:50 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:48:50 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:48:50 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk"/>
Aug 14 13:48:50 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:48:50 user nova-compute[73484]:     </disk>
Aug 14 13:48:50 user nova-compute[73484]:     <disk type="block" device="disk">
Aug 14 13:48:50 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:48:50 user nova-compute[73484]:       <source dev="/dev/sde"/>
Aug 14 13:48:50 user nova-compute[73484]:       <target dev="vdb" bus="virtio"/>
Aug 14 13:48:50 user nova-compute[73484]:       <serial>b76da63f-391a-4087-8ffd-19c9648cd781</serial>
Aug 14 13:48:50 user nova-compute[73484]:     </disk>
Aug 14 13:48:50 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:48:50 user nova-compute[73484]:       <mac address="fa:16:3e:30:6a:b2"/>
Aug 14 13:48:50 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:48:50 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:48:50 user nova-compute[73484]:       <target dev="tap0b54646a-71"/>
Aug 14 13:48:50 user nova-compute[73484]:     </interface>
Aug 14 13:48:50 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:48:50 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/console.log" append="off"/>
Aug 14 13:48:50 user nova-compute[73484]:     </serial>
Aug 14 13:48:50 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:48:50 user nova-compute[73484]:     <video>
Aug 14 13:48:50 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:48:50 user nova-compute[73484]:     </video>
Aug 14 13:48:50 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:48:50 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:48:50 user nova-compute[73484]:     </rng>
Aug 14 13:48:50 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:48:50 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:48:50 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:48:50 user nova-compute[73484]:     </memballoon>
Aug 14 13:48:50 user nova-compute[73484]:   </devices>
Aug 14 13:48:50 user nova-compute[73484]: </domain>
Aug 14 13:48:50 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:48:50 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:42:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1361765687',display_name='tempest-ServerActionsTestOtherB-server-1361765687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1361765687',id=20,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF57s7WDcr5LrA3gfxfpgDNJt6UZ/rZhkiS+Nfi/DIO/C85ZFU7Y17ny/O/CEqdXEP2/mm1AA46PPquOjl5qC1/2wZc0eZa1Tjpvt/2IPyALMO4YPxf1Hkqx4YMdA9qx2g==',key_name='tempest-keypair-345523160',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:47:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a07a8a61d3f14061b44b8f37968c54e9',ramdisk_id='',reservation_id='r-b3zcr056',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1221611824',owner_user_name='tempest-ServerActionsTestOtherB-1221611824-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:48:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55e77cc182bc4ec79429025c6a9f14af',uuid=09ba29fd-8161-485c-ba6d-71d24ab086bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "0b54646a-71ed-4087-adf7-66645e7d2907", "address": "fa:16:3e:30:6a:b2", "network": {"id": "a417bb93-b1ed-47a4-be83-6679c2ea34b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872770450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07a8a61d3f14061b44b8f37968c54e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b54646a-71", "ovs_interfaceid": "0b54646a-71ed-4087-adf7-66645e7d2907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:48:50 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Converting VIF {"id": "0b54646a-71ed-4087-adf7-66645e7d2907", "address": "fa:16:3e:30:6a:b2", "network": {"id": "a417bb93-b1ed-47a4-be83-6679c2ea34b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872770450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07a8a61d3f14061b44b8f37968c54e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b54646a-71", "ovs_interfaceid": "0b54646a-71ed-4087-adf7-66645e7d2907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:48:50 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:6a:b2,bridge_name='br-int',has_traffic_filtering=True,id=0b54646a-71ed-4087-adf7-66645e7d2907,network=Network(a417bb93-b1ed-47a4-be83-6679c2ea34b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b54646a-71') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:48:50 user nova-compute[73484]: DEBUG os_vif [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:6a:b2,bridge_name='br-int',has_traffic_filtering=True,id=0b54646a-71ed-4087-adf7-66645e7d2907,network=Network(a417bb93-b1ed-47a4-be83-6679c2ea34b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b54646a-71') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:48:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:48:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:48:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b54646a-71, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:48:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0b54646a-71, col_values=(('external_ids', {'iface-id': '0b54646a-71ed-4087-adf7-66645e7d2907', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:6a:b2', 'vm-uuid': '09ba29fd-8161-485c-ba6d-71d24ab086bc'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:48:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:48:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:50 user nova-compute[73484]: INFO os_vif [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:6a:b2,bridge_name='br-int',has_traffic_filtering=True,id=0b54646a-71ed-4087-adf7-66645e7d2907,network=Network(a417bb93-b1ed-47a4-be83-6679c2ea34b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b54646a-71')
Aug 14 13:48:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:51 user nova-compute[73484]: DEBUG nova.compute.manager [req-013cccbe-355c-4df9-90e0-1b4dd2288d64 req-03cd322e-51bb-4e75-b644-f5b22b9d274a service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Received event network-vif-plugged-19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:48:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-013cccbe-355c-4df9-90e0-1b4dd2288d64 req-03cd322e-51bb-4e75-b644-f5b22b9d274a service nova] Acquiring lock "72f007af-a1e7-4a80-954c-ed12aaf129fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:48:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-013cccbe-355c-4df9-90e0-1b4dd2288d64 req-03cd322e-51bb-4e75-b644-f5b22b9d274a service nova] Lock "72f007af-a1e7-4a80-954c-ed12aaf129fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:48:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-013cccbe-355c-4df9-90e0-1b4dd2288d64 req-03cd322e-51bb-4e75-b644-f5b22b9d274a service nova] Lock "72f007af-a1e7-4a80-954c-ed12aaf129fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:48:51 user nova-compute[73484]: DEBUG nova.compute.manager [req-013cccbe-355c-4df9-90e0-1b4dd2288d64 req-03cd322e-51bb-4e75-b644-f5b22b9d274a service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] No waiting events found dispatching network-vif-plugged-19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:48:51 user nova-compute[73484]: WARNING nova.compute.manager [req-013cccbe-355c-4df9-90e0-1b4dd2288d64 req-03cd322e-51bb-4e75-b644-f5b22b9d274a service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Received unexpected event network-vif-plugged-19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 for instance with vm_state building and task_state spawning.
Aug 14 13:48:52 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:52 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:52 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:52 user nova-compute[73484]: DEBUG nova.compute.manager [req-9763f41a-7314-438f-801b-006eb7e08be6 req-5b843478-3d46-46ea-b4ab-d7a921a058ca service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Received event network-vif-plugged-0b54646a-71ed-4087-adf7-66645e7d2907 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:48:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-9763f41a-7314-438f-801b-006eb7e08be6 req-5b843478-3d46-46ea-b4ab-d7a921a058ca service nova] Acquiring lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:48:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-9763f41a-7314-438f-801b-006eb7e08be6 req-5b843478-3d46-46ea-b4ab-d7a921a058ca service nova] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:48:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-9763f41a-7314-438f-801b-006eb7e08be6 req-5b843478-3d46-46ea-b4ab-d7a921a058ca service nova] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:48:52 user nova-compute[73484]: DEBUG nova.compute.manager [req-9763f41a-7314-438f-801b-006eb7e08be6 req-5b843478-3d46-46ea-b4ab-d7a921a058ca service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] No waiting events found dispatching network-vif-plugged-0b54646a-71ed-4087-adf7-66645e7d2907 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:48:52 user nova-compute[73484]: WARNING nova.compute.manager [req-9763f41a-7314-438f-801b-006eb7e08be6 req-5b843478-3d46-46ea-b4ab-d7a921a058ca service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Received unexpected event network-vif-plugged-0b54646a-71ed-4087-adf7-66645e7d2907 for instance with vm_state resized and task_state resize_reverting.
Aug 14 13:48:53 user nova-compute[73484]: DEBUG nova.compute.manager [req-35e4a138-3546-417f-86f3-00355ed43aa1 req-eeafea02-9dba-4d67-937d-46985f930b83 service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Received event network-vif-plugged-19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:48:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-35e4a138-3546-417f-86f3-00355ed43aa1 req-eeafea02-9dba-4d67-937d-46985f930b83 service nova] Acquiring lock "72f007af-a1e7-4a80-954c-ed12aaf129fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:48:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-35e4a138-3546-417f-86f3-00355ed43aa1 req-eeafea02-9dba-4d67-937d-46985f930b83 service nova] Lock "72f007af-a1e7-4a80-954c-ed12aaf129fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:48:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-35e4a138-3546-417f-86f3-00355ed43aa1 req-eeafea02-9dba-4d67-937d-46985f930b83 service nova] Lock "72f007af-a1e7-4a80-954c-ed12aaf129fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:48:53 user nova-compute[73484]: DEBUG nova.compute.manager [req-35e4a138-3546-417f-86f3-00355ed43aa1 req-eeafea02-9dba-4d67-937d-46985f930b83 service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] No waiting events found dispatching network-vif-plugged-19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:48:53 user nova-compute[73484]: WARNING nova.compute.manager [req-35e4a138-3546-417f-86f3-00355ed43aa1 req-eeafea02-9dba-4d67-937d-46985f930b83 service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Received unexpected event network-vif-plugged-19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 for instance with vm_state building and task_state spawning.
Aug 14 13:48:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:54 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020934.650175, 72f007af-a1e7-4a80-954c-ed12aaf129fd => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:48:54 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] VM Resumed (Lifecycle Event)
Aug 14 13:48:54 user nova-compute[73484]: DEBUG nova.compute.manager [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:48:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:48:54 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Instance spawned successfully.
Aug 14 13:48:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:48:54 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:48:54 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:48:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:48:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:48:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:48:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:48:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:48:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:48:54 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:48:54 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020934.6505477, 72f007af-a1e7-4a80-954c-ed12aaf129fd => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:48:54 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] VM Started (Lifecycle Event)
Aug 14 13:48:54 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:48:54 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:48:54 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:48:54 user nova-compute[73484]: INFO nova.compute.manager [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Took 6.90 seconds to spawn the instance on the hypervisor.
Aug 14 13:48:54 user nova-compute[73484]: DEBUG nova.compute.manager [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:48:54 user nova-compute[73484]: INFO nova.compute.manager [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Took 18.05 seconds to build instance.
Aug 14 13:48:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-39f29b06-d1b0-4fb3-a957-ae9f141e3616 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "72f007af-a1e7-4a80-954c-ed12aaf129fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.172s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:48:54 user nova-compute[73484]: DEBUG nova.compute.manager [req-ffdd6a04-97b8-4403-991e-c1153cda4776 req-c9645398-cbde-4fea-a706-32a738e976cd service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Received event network-vif-plugged-0b54646a-71ed-4087-adf7-66645e7d2907 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:48:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ffdd6a04-97b8-4403-991e-c1153cda4776 req-c9645398-cbde-4fea-a706-32a738e976cd service nova] Acquiring lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:48:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ffdd6a04-97b8-4403-991e-c1153cda4776 req-c9645398-cbde-4fea-a706-32a738e976cd service nova] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:48:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ffdd6a04-97b8-4403-991e-c1153cda4776 req-c9645398-cbde-4fea-a706-32a738e976cd service nova] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:48:54 user nova-compute[73484]: DEBUG nova.compute.manager [req-ffdd6a04-97b8-4403-991e-c1153cda4776 req-c9645398-cbde-4fea-a706-32a738e976cd service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] No waiting events found dispatching network-vif-plugged-0b54646a-71ed-4087-adf7-66645e7d2907 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:48:54 user nova-compute[73484]: WARNING nova.compute.manager [req-ffdd6a04-97b8-4403-991e-c1153cda4776 req-c9645398-cbde-4fea-a706-32a738e976cd service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Received unexpected event network-vif-plugged-0b54646a-71ed-4087-adf7-66645e7d2907 for instance with vm_state resized and task_state resize_reverting.
Aug 14 13:48:55 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020935.244278, 09ba29fd-8161-485c-ba6d-71d24ab086bc => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:48:55 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] VM Resumed (Lifecycle Event)
Aug 14 13:48:55 user nova-compute[73484]: DEBUG nova.compute.manager [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:48:55 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Instance running successfully.
Aug 14 13:48:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] finish_revert_migration finished successfully. {{(pid=73484) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 14 13:48:55 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:48:55 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:48:55 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 14 13:48:55 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020935.245697, 09ba29fd-8161-485c-ba6d-71d24ab086bc => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:48:55 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] VM Started (Lifecycle Event)
Aug 14 13:48:55 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:48:55 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:48:55 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 14 13:48:55 user nova-compute[73484]: INFO nova.compute.manager [None req-36675f4c-4207-4ed9-8b2b-a7ab3ebb3482 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Updating instance to original state: 'active'
Aug 14 13:48:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:48:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:48:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:48:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:48:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:48:57 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:48:57 user nova-compute[73484]: INFO nova.compute.claims [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Claim successful on node user
Aug 14 13:48:58 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:48:58 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:48:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:48:58 user nova-compute[73484]: DEBUG nova.compute.manager [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:48:58 user nova-compute[73484]: DEBUG nova.compute.manager [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:48:58 user nova-compute[73484]: DEBUG nova.network.neutron [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:48:58 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:48:58 user nova-compute[73484]: DEBUG nova.compute.manager [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:48:58 user nova-compute[73484]: DEBUG nova.compute.manager [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:48:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:48:58 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Creating image(s)
Aug 14 13:48:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "/opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:48:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "/opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:48:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "/opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:48:58 user nova-compute[73484]: DEBUG nova.policy [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bda36df8b1f64c7894bfee5da258c1e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1ccc7c1aaf497da5f1d325d79e9301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:48:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.210s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:48:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:48:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.229s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk 1073741824" returned: 0 in 0.059s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:48:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.217s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:59 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Checking if we can resize image /opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:48:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:48:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:48:59 user nova-compute[73484]: DEBUG nova.network.neutron [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Successfully created port: 8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:48:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:48:59 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Cannot resize image /opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:48:59 user nova-compute[73484]: DEBUG nova.objects.instance [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lazy-loading 'migration_context' on Instance uuid 86580f0d-dd88-48fb-bce8-dc6f5edc01c6 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:48:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:48:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Ensure instance console log exists: /opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:48:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:48:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:48:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:49:00 user nova-compute[73484]: DEBUG nova.network.neutron [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Successfully updated port: 8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:49:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "refresh_cache-86580f0d-dd88-48fb-bce8-dc6f5edc01c6" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:49:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquired lock "refresh_cache-86580f0d-dd88-48fb-bce8-dc6f5edc01c6" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:49:00 user nova-compute[73484]: DEBUG nova.network.neutron [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:49:00 user nova-compute[73484]: DEBUG nova.compute.manager [req-a7845fa7-75d1-46a7-8785-1cd60d49d119 req-87de226e-a760-42f0-9755-7acb9cca8350 service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Received event network-changed-8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:49:00 user nova-compute[73484]: DEBUG nova.compute.manager [req-a7845fa7-75d1-46a7-8785-1cd60d49d119 req-87de226e-a760-42f0-9755-7acb9cca8350 service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Refreshing instance network info cache due to event network-changed-8f0b7e99-89d1-4234-a552-e92df188cd4e. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:49:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a7845fa7-75d1-46a7-8785-1cd60d49d119 req-87de226e-a760-42f0-9755-7acb9cca8350 service nova] Acquiring lock "refresh_cache-86580f0d-dd88-48fb-bce8-dc6f5edc01c6" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:49:00 user nova-compute[73484]: DEBUG nova.network.neutron [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:49:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.network.neutron [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Updating instance_info_cache with network_info: [{"id": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "address": "fa:16:3e:20:8b:68", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0b7e99-89", "ovs_interfaceid": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Releasing lock "refresh_cache-86580f0d-dd88-48fb-bce8-dc6f5edc01c6" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.compute.manager [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Instance network_info: |[{"id": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "address": "fa:16:3e:20:8b:68", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0b7e99-89", "ovs_interfaceid": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a7845fa7-75d1-46a7-8785-1cd60d49d119 req-87de226e-a760-42f0-9755-7acb9cca8350 service nova] Acquired lock "refresh_cache-86580f0d-dd88-48fb-bce8-dc6f5edc01c6" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.network.neutron [req-a7845fa7-75d1-46a7-8785-1cd60d49d119 req-87de226e-a760-42f0-9755-7acb9cca8350 service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Refreshing network info cache for port 8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Start _get_guest_xml network_info=[{"id": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "address": "fa:16:3e:20:8b:68", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0b7e99-89", "ovs_interfaceid": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:49:01 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:49:01 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:48:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1425856117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1425856117',id=30,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbnYbAG6NpHt2DOEAzWMWcC4//dmDDjdoohHJ9Fhcgro4zefbJFRczoX4bLxibnHjgSCxNgQI7+hK/klX7r00Q0wzHK+QIzN2xNAdcO22IDBNUHlOwSiIg074+PXIFxAg==',key_name='tempest-keypair-396971079',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c1ccc7c1aaf497da5f1d325d79e9301',ramdisk_id='',reservation_id='r-ypie00bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1730232968',owner_user_name='tempest-AttachVolumeShelveTestJSON-1730232968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:48:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bda36df8b1f64c7894bfee5da258c1e6',uuid=86580f0d-dd88-48fb-bce8-dc6f5edc01c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "address": "fa:16:3e:20:8b:68", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0b7e99-89", "ovs_interfaceid": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Converting VIF {"id": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "address": "fa:16:3e:20:8b:68", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0b7e99-89", "ovs_interfaceid": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:8b:68,bridge_name='br-int',has_traffic_filtering=True,id=8f0b7e99-89d1-4234-a552-e92df188cd4e,network=Network(cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f0b7e99-89') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.objects.instance [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lazy-loading 'pci_devices' on Instance uuid 86580f0d-dd88-48fb-bce8-dc6f5edc01c6 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:49:01 user nova-compute[73484]:   <uuid>86580f0d-dd88-48fb-bce8-dc6f5edc01c6</uuid>
Aug 14 13:49:01 user nova-compute[73484]:   <name>instance-0000001e</name>
Aug 14 13:49:01 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:49:01 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:49:01 user nova-compute[73484]:   <metadata>
Aug 14 13:49:01 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:49:01 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:49:01 user nova-compute[73484]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1425856117</nova:name>
Aug 14 13:49:01 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:49:01</nova:creationTime>
Aug 14 13:49:01 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:49:01 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:49:01 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:49:01 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:49:01 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:49:01 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:49:01 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:49:01 user nova-compute[73484]:       <nova:owner>
Aug 14 13:49:01 user nova-compute[73484]:         <nova:user uuid="bda36df8b1f64c7894bfee5da258c1e6">tempest-AttachVolumeShelveTestJSON-1730232968-project-member</nova:user>
Aug 14 13:49:01 user nova-compute[73484]:         <nova:project uuid="0c1ccc7c1aaf497da5f1d325d79e9301">tempest-AttachVolumeShelveTestJSON-1730232968</nova:project>
Aug 14 13:49:01 user nova-compute[73484]:       </nova:owner>
Aug 14 13:49:01 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:49:01 user nova-compute[73484]:       <nova:ports>
Aug 14 13:49:01 user nova-compute[73484]:         <nova:port uuid="8f0b7e99-89d1-4234-a552-e92df188cd4e">
Aug 14 13:49:01 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 13:49:01 user nova-compute[73484]:         </nova:port>
Aug 14 13:49:01 user nova-compute[73484]:       </nova:ports>
Aug 14 13:49:01 user nova-compute[73484]:     </nova:instance>
Aug 14 13:49:01 user nova-compute[73484]:   </metadata>
Aug 14 13:49:01 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:49:01 user nova-compute[73484]:     <system>
Aug 14 13:49:01 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:49:01 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:49:01 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:49:01 user nova-compute[73484]:       <entry name="serial">86580f0d-dd88-48fb-bce8-dc6f5edc01c6</entry>
Aug 14 13:49:01 user nova-compute[73484]:       <entry name="uuid">86580f0d-dd88-48fb-bce8-dc6f5edc01c6</entry>
Aug 14 13:49:01 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:49:01 user nova-compute[73484]:     </system>
Aug 14 13:49:01 user nova-compute[73484]:   </sysinfo>
Aug 14 13:49:01 user nova-compute[73484]:   <os>
Aug 14 13:49:01 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:49:01 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:49:01 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:49:01 user nova-compute[73484]:   </os>
Aug 14 13:49:01 user nova-compute[73484]:   <features>
Aug 14 13:49:01 user nova-compute[73484]:     <acpi/>
Aug 14 13:49:01 user nova-compute[73484]:     <apic/>
Aug 14 13:49:01 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:49:01 user nova-compute[73484]:   </features>
Aug 14 13:49:01 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:49:01 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:49:01 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:49:01 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:49:01 user nova-compute[73484]:   </clock>
Aug 14 13:49:01 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:49:01 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:49:01 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:49:01 user nova-compute[73484]:   </cpu>
Aug 14 13:49:01 user nova-compute[73484]:   <devices>
Aug 14 13:49:01 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:49:01 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:49:01 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk"/>
Aug 14 13:49:01 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:49:01 user nova-compute[73484]:     </disk>
Aug 14 13:49:01 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:49:01 user nova-compute[73484]:       <mac address="fa:16:3e:20:8b:68"/>
Aug 14 13:49:01 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:49:01 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:49:01 user nova-compute[73484]:       <target dev="tap8f0b7e99-89"/>
Aug 14 13:49:01 user nova-compute[73484]:     </interface>
Aug 14 13:49:01 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:49:01 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/console.log" append="off"/>
Aug 14 13:49:01 user nova-compute[73484]:     </serial>
Aug 14 13:49:01 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:49:01 user nova-compute[73484]:     <video>
Aug 14 13:49:01 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:49:01 user nova-compute[73484]:     </video>
Aug 14 13:49:01 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:49:01 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:49:01 user nova-compute[73484]:     </rng>
Aug 14 13:49:01 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:49:01 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:49:01 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:49:01 user nova-compute[73484]:     </memballoon>
Aug 14 13:49:01 user nova-compute[73484]:   </devices>
Aug 14 13:49:01 user nova-compute[73484]: </domain>
Aug 14 13:49:01 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:48:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1425856117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1425856117',id=30,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbnYbAG6NpHt2DOEAzWMWcC4//dmDDjdoohHJ9Fhcgro4zefbJFRczoX4bLxibnHjgSCxNgQI7+hK/klX7r00Q0wzHK+QIzN2xNAdcO22IDBNUHlOwSiIg074+PXIFxAg==',key_name='tempest-keypair-396971079',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c1ccc7c1aaf497da5f1d325d79e9301',ramdisk_id='',reservation_id='r-ypie00bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1730232968',owner_user_name='tempest-AttachVolumeShelveTestJSON-1730232968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:48:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bda36df8b1f64c7894bfee5da258c1e6',uuid=86580f0d-dd88-48fb-bce8-dc6f5edc01c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "address": "fa:16:3e:20:8b:68", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0b7e99-89", "ovs_interfaceid": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Converting VIF {"id": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "address": "fa:16:3e:20:8b:68", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0b7e99-89", "ovs_interfaceid": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:8b:68,bridge_name='br-int',has_traffic_filtering=True,id=8f0b7e99-89d1-4234-a552-e92df188cd4e,network=Network(cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f0b7e99-89') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG os_vif [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:8b:68,bridge_name='br-int',has_traffic_filtering=True,id=8f0b7e99-89d1-4234-a552-e92df188cd4e,network=Network(cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f0b7e99-89') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f0b7e99-89, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8f0b7e99-89, col_values=(('external_ids', {'iface-id': '8f0b7e99-89d1-4234-a552-e92df188cd4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:8b:68', 'vm-uuid': '86580f0d-dd88-48fb-bce8-dc6f5edc01c6'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:01 user nova-compute[73484]: INFO os_vif [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:8b:68,bridge_name='br-int',has_traffic_filtering=True,id=8f0b7e99-89d1-4234-a552-e92df188cd4e,network=Network(cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f0b7e99-89')
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] No VIF found with MAC fa:16:3e:20:8b:68, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.network.neutron [req-a7845fa7-75d1-46a7-8785-1cd60d49d119 req-87de226e-a760-42f0-9755-7acb9cca8350 service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Updated VIF entry in instance network info cache for port 8f0b7e99-89d1-4234-a552-e92df188cd4e. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG nova.network.neutron [req-a7845fa7-75d1-46a7-8785-1cd60d49d119 req-87de226e-a760-42f0-9755-7acb9cca8350 service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Updating instance_info_cache with network_info: [{"id": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "address": "fa:16:3e:20:8b:68", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0b7e99-89", "ovs_interfaceid": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:49:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a7845fa7-75d1-46a7-8785-1cd60d49d119 req-87de226e-a760-42f0-9755-7acb9cca8350 service nova] Releasing lock "refresh_cache-86580f0d-dd88-48fb-bce8-dc6f5edc01c6" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:49:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:03 user nova-compute[73484]: DEBUG nova.compute.manager [req-df66785a-8248-4fa4-a4a7-3ad21f838c26 req-2ab28456-2bec-4ce7-946a-a052740150f0 service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Received event network-vif-plugged-8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:49:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-df66785a-8248-4fa4-a4a7-3ad21f838c26 req-2ab28456-2bec-4ce7-946a-a052740150f0 service nova] Acquiring lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:49:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-df66785a-8248-4fa4-a4a7-3ad21f838c26 req-2ab28456-2bec-4ce7-946a-a052740150f0 service nova] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:49:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-df66785a-8248-4fa4-a4a7-3ad21f838c26 req-2ab28456-2bec-4ce7-946a-a052740150f0 service nova] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:49:03 user nova-compute[73484]: DEBUG nova.compute.manager [req-df66785a-8248-4fa4-a4a7-3ad21f838c26 req-2ab28456-2bec-4ce7-946a-a052740150f0 service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] No waiting events found dispatching network-vif-plugged-8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:49:03 user nova-compute[73484]: WARNING nova.compute.manager [req-df66785a-8248-4fa4-a4a7-3ad21f838c26 req-2ab28456-2bec-4ce7-946a-a052740150f0 service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Received unexpected event network-vif-plugged-8f0b7e99-89d1-4234-a552-e92df188cd4e for instance with vm_state building and task_state spawning.
Aug 14 13:49:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:05 user nova-compute[73484]: DEBUG nova.compute.manager [req-182e8f52-764c-4fa7-84e5-a0c261f01447 req-3f8cd1b8-a980-4d78-86e2-a615d280824f service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Received event network-vif-plugged-8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:49:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-182e8f52-764c-4fa7-84e5-a0c261f01447 req-3f8cd1b8-a980-4d78-86e2-a615d280824f service nova] Acquiring lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:49:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-182e8f52-764c-4fa7-84e5-a0c261f01447 req-3f8cd1b8-a980-4d78-86e2-a615d280824f service nova] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:49:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-182e8f52-764c-4fa7-84e5-a0c261f01447 req-3f8cd1b8-a980-4d78-86e2-a615d280824f service nova] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:49:05 user nova-compute[73484]: DEBUG nova.compute.manager [req-182e8f52-764c-4fa7-84e5-a0c261f01447 req-3f8cd1b8-a980-4d78-86e2-a615d280824f service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] No waiting events found dispatching network-vif-plugged-8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:49:05 user nova-compute[73484]: WARNING nova.compute.manager [req-182e8f52-764c-4fa7-84e5-a0c261f01447 req-3f8cd1b8-a980-4d78-86e2-a615d280824f service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Received unexpected event network-vif-plugged-8f0b7e99-89d1-4234-a552-e92df188cd4e for instance with vm_state building and task_state spawning.
Aug 14 13:49:05 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020945.7607298, 86580f0d-dd88-48fb-bce8-dc6f5edc01c6 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:49:05 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] VM Resumed (Lifecycle Event)
Aug 14 13:49:05 user nova-compute[73484]: DEBUG nova.compute.manager [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:49:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:49:05 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Instance spawned successfully.
Aug 14 13:49:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:49:05 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:49:05 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:49:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:49:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:49:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:49:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:49:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:49:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:49:05 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:49:05 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020945.7651289, 86580f0d-dd88-48fb-bce8-dc6f5edc01c6 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:49:05 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] VM Started (Lifecycle Event)
Aug 14 13:49:05 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:49:05 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:49:05 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:49:05 user nova-compute[73484]: INFO nova.compute.manager [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Took 7.54 seconds to spawn the instance on the hypervisor.
Aug 14 13:49:05 user nova-compute[73484]: DEBUG nova.compute.manager [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:49:06 user nova-compute[73484]: INFO nova.compute.manager [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Took 8.50 seconds to build instance.
Aug 14 13:49:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-95b265ba-c666-4065-bf70-f1af146ab85a tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.642s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:49:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:21 user nova-compute[73484]: DEBUG nova.compute.manager [req-da98ac02-d4c4-4965-8134-efa7076c4fb5 req-e88978f8-aadb-4e0e-abce-bf3fde9ef160 service nova] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Received event network-changed-3a7e7a5d-c80e-427f-96fe-92670978d8ee {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:49:21 user nova-compute[73484]: DEBUG nova.compute.manager [req-da98ac02-d4c4-4965-8134-efa7076c4fb5 req-e88978f8-aadb-4e0e-abce-bf3fde9ef160 service nova] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Refreshing instance network info cache due to event network-changed-3a7e7a5d-c80e-427f-96fe-92670978d8ee. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:49:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-da98ac02-d4c4-4965-8134-efa7076c4fb5 req-e88978f8-aadb-4e0e-abce-bf3fde9ef160 service nova] Acquiring lock "refresh_cache-2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:49:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-da98ac02-d4c4-4965-8134-efa7076c4fb5 req-e88978f8-aadb-4e0e-abce-bf3fde9ef160 service nova] Acquired lock "refresh_cache-2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:49:21 user nova-compute[73484]: DEBUG nova.network.neutron [req-da98ac02-d4c4-4965-8134-efa7076c4fb5 req-e88978f8-aadb-4e0e-abce-bf3fde9ef160 service nova] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Refreshing network info cache for port 3a7e7a5d-c80e-427f-96fe-92670978d8ee {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:49:22 user nova-compute[73484]: DEBUG nova.network.neutron [req-da98ac02-d4c4-4965-8134-efa7076c4fb5 req-e88978f8-aadb-4e0e-abce-bf3fde9ef160 service nova] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Updated VIF entry in instance network info cache for port 3a7e7a5d-c80e-427f-96fe-92670978d8ee. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:49:22 user nova-compute[73484]: DEBUG nova.network.neutron [req-da98ac02-d4c4-4965-8134-efa7076c4fb5 req-e88978f8-aadb-4e0e-abce-bf3fde9ef160 service nova] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Updating instance_info_cache with network_info: [{"id": "3a7e7a5d-c80e-427f-96fe-92670978d8ee", "address": "fa:16:3e:cb:14:c8", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7e7a5d-c8", "ovs_interfaceid": "3a7e7a5d-c80e-427f-96fe-92670978d8ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:49:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-da98ac02-d4c4-4965-8134-efa7076c4fb5 req-e88978f8-aadb-4e0e-abce-bf3fde9ef160 service nova] Releasing lock "refresh_cache-2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:49:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:24 user nova-compute[73484]: DEBUG nova.compute.manager [req-a84bfbbb-0413-4670-8b1a-6f422b53f946 req-bde2ac9d-3333-4598-a7db-bc208a7f5ac0 service nova] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Received event network-changed-28b48249-b438-4d6d-9432-5c94ed450cb8 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:49:24 user nova-compute[73484]: DEBUG nova.compute.manager [req-a84bfbbb-0413-4670-8b1a-6f422b53f946 req-bde2ac9d-3333-4598-a7db-bc208a7f5ac0 service nova] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Refreshing instance network info cache due to event network-changed-28b48249-b438-4d6d-9432-5c94ed450cb8. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:49:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a84bfbbb-0413-4670-8b1a-6f422b53f946 req-bde2ac9d-3333-4598-a7db-bc208a7f5ac0 service nova] Acquiring lock "refresh_cache-700e95c1-08b0-4613-992b-4314b127e14a" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:49:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a84bfbbb-0413-4670-8b1a-6f422b53f946 req-bde2ac9d-3333-4598-a7db-bc208a7f5ac0 service nova] Acquired lock "refresh_cache-700e95c1-08b0-4613-992b-4314b127e14a" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:49:24 user nova-compute[73484]: DEBUG nova.network.neutron [req-a84bfbbb-0413-4670-8b1a-6f422b53f946 req-bde2ac9d-3333-4598-a7db-bc208a7f5ac0 service nova] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Refreshing network info cache for port 28b48249-b438-4d6d-9432-5c94ed450cb8 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:49:24 user nova-compute[73484]: DEBUG nova.network.neutron [req-a84bfbbb-0413-4670-8b1a-6f422b53f946 req-bde2ac9d-3333-4598-a7db-bc208a7f5ac0 service nova] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Updated VIF entry in instance network info cache for port 28b48249-b438-4d6d-9432-5c94ed450cb8. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:49:24 user nova-compute[73484]: DEBUG nova.network.neutron [req-a84bfbbb-0413-4670-8b1a-6f422b53f946 req-bde2ac9d-3333-4598-a7db-bc208a7f5ac0 service nova] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Updating instance_info_cache with network_info: [{"id": "28b48249-b438-4d6d-9432-5c94ed450cb8", "address": "fa:16:3e:bb:3e:ce", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b48249-b4", "ovs_interfaceid": "28b48249-b438-4d6d-9432-5c94ed450cb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:49:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a84bfbbb-0413-4670-8b1a-6f422b53f946 req-bde2ac9d-3333-4598-a7db-bc208a7f5ac0 service nova] Releasing lock "refresh_cache-700e95c1-08b0-4613-992b-4314b127e14a" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:49:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:49:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:49:26 user nova-compute[73484]: DEBUG nova.objects.instance [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'flavor' on Instance uuid 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:49:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:49:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:49:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:49:26 user nova-compute[73484]: INFO nova.compute.manager [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Attaching volume b1ea7889-29b1-4c6a-89a6-fc61dcc6502e to /dev/vdb
Aug 14 13:49:26 user nova-compute[73484]: DEBUG os_brick.utils [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:49:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:26 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f5a445-8c80-4d5e-a9d6-b26c122d0dd0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:26 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7e0b2e-c9c4-4473-b6fa-eedb8ef8a083]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:26 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2de80c4-dd62-40eb-b3ae-f0758a0d0722]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:26 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9254eafd-2fc2-49ce-bcbc-52ceb7dbf1a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:49:26 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:49:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:49:26 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:49:26 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2c7d22-554f-4c56-aebb-db2a5461da66]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:26 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:49:26 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:49:26 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:49:26 user nova-compute[73484]: DEBUG os_brick.utils [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:49:26 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Updating existing volume attachment record: f62a955c-0297-486f-92bf-59474ae7e2bb {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:49:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "700e95c1-08b0-4613-992b-4314b127e14a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:49:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "700e95c1-08b0-4613-992b-4314b127e14a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:49:28 user nova-compute[73484]: DEBUG nova.objects.instance [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lazy-loading 'flavor' on Instance uuid 700e95c1-08b0-4613-992b-4314b127e14a {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:49:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "700e95c1-08b0-4613-992b-4314b127e14a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:49:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "700e95c1-08b0-4613-992b-4314b127e14a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:49:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "700e95c1-08b0-4613-992b-4314b127e14a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:49:28 user nova-compute[73484]: INFO nova.compute.manager [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Attaching volume be929e7f-c83d-4847-9433-fb9bfafaf168 to /dev/vdb
Aug 14 13:49:28 user nova-compute[73484]: DEBUG os_brick.utils [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:49:28 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:28 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:28 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad28140d-ae57-46a9-9494-558c60458822]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:28 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:28 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:28 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb40945-5691-4977-b97d-27af2b341cf6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:28 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:28 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:28 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2690e9-cbdc-479a-ba6b-8b8f65370bd9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:28 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6344ac6d-ae5d-41d7-b161-8719854584e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:28 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:28 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:49:28 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:49:28 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:49:29 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:49:29 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[527ffee3-afee-4bbd-8afb-3188db87cecf]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:49:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:49:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:49:29 user nova-compute[73484]: DEBUG os_brick.utils [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:49:29 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Updating existing volume attachment record: 33fdca68-0968-4626-b68b-ebe80994ff69 {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:49:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:49:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TidINLeP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:49:36 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:49:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:49:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:49:36 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:49:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:49:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:49:36 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:49:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:37 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2ede40-aa28-453c-9d05-1713b68cd58c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:49:37 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:49:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:37 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e9ca69-4ddc-4d1f-a3dc-9fc13bc2245b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e] added
Aug 14 13:49:37 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:49:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.127s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:37 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a20f94-ec00-445b-b2ac-35426d482936]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:49:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:37 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa375c7-0925-4930-9231-f79db07e77cc]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:49:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TidINLeP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TidINLeP" returned: 0 in 0.041s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:37 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6642a3e-f00c-474b-a73d-39a046040e1f]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TidINLeP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:49:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.043s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:37 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf665c6-fa92-402a-8fe2-8c61740692a5]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:49:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:37 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12191b3-b7c1-4a75-a1bd-b97892c324ff]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04265147-3389-41fa-ba41-291b02a3cbcd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63790dc6-fe82-4e7f-894d-29355c3e2b95 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:49:37 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:49:37 user nova-compute[73484]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:49:37 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:49:37 user nova-compute[73484]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04265147-3389-41fa-ba41-291b02a3cbcd (non-flash)
Aug 14 13:49:37 user nova-compute[73484]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63790dc6-fe82-4e7f-894d-29355c3e2b95 (non-flash)
Aug 14 13:49:37 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:49:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:49:37 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:49:37 user nova-compute[73484]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:49:37 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:49:37 user nova-compute[73484]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04265147-3389-41fa-ba41-291b02a3cbcd (non-flash)
Aug 14 13:49:37 user nova-compute[73484]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63790dc6-fe82-4e7f-894d-29355c3e2b95 (non-flash)
Aug 14 13:49:37 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:49:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e -p 172.16.0.220:3260 --login" returned: 0 in 1.124s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:38 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3c74c9-f820-4b25-8ee7-7ce6650d54e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:38 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e, portal: 172.16.0.220,3260]
Aug 14 13:49:38 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e, portal: 172.16.0.220,3260] successful.
Aug 14 13:49:38 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:49:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:38 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[458cc92f-c79c-40b7-8238-006b6d6307fe]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:38 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:49:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:38 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[013aff5b-7a5b-40d2-b117-afbad08f0e9b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04265147-3389-41fa-ba41-291b02a3cbcd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63790dc6-fe82-4e7f-894d-29355c3e2b95 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:38 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:49:38 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:49:38 user nova-compute[73484]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:49:38 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:49:38 user nova-compute[73484]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04265147-3389-41fa-ba41-291b02a3cbcd (non-flash)
Aug 14 13:49:38 user nova-compute[73484]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63790dc6-fe82-4e7f-894d-29355c3e2b95 (non-flash)
Aug 14 13:49:38 user nova-compute[73484]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e (non-flash)
Aug 14 13:49:38 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:49:38 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:49:38 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:49:38 user nova-compute[73484]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:49:38 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:49:38 user nova-compute[73484]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04265147-3389-41fa-ba41-291b02a3cbcd (non-flash)
Aug 14 13:49:38 user nova-compute[73484]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63790dc6-fe82-4e7f-894d-29355c3e2b95 (non-flash)
Aug 14 13:49:38 user nova-compute[73484]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e (non-flash)
Aug 14 13:49:38 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:49:38 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.645s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:49:38 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:49:38 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] HCTL ('39', '-', '-', 0) found on session 36 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:49:38 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:49:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:38 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbe90de-db84-4b4c-bb77-f128f1693e89]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:38 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Searching for a device in session 36 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:49:38 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TidINLeP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuObsBKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:49:39 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:49:39 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.693s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] <== connect_volume: return (2694ms) {'type': 'block', 'scsi_wwn': '26531333266613036', 'path': '/dev/sdh'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531333266613036', 'path': '/dev/sdh'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.433s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:49:39 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:49:39 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:49:39 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:49:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG nova.objects.instance [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'flavor' on Instance uuid 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5573b43-491a-4d14-ab07-0a03fe1032a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:49:39 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 13:49:39 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:49:39 user nova-compute[73484]:   <source dev="/dev/sdh"/>
Aug 14 13:49:39 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:49:39 user nova-compute[73484]:   <serial>b1ea7889-29b1-4c6a-89a6-fc61dcc6502e</serial>
Aug 14 13:49:39 user nova-compute[73484]: </disk>
Aug 14 13:49:39 user nova-compute[73484]:  {{(pid=73484) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[590176e3-a5b0-44d9-ab34-99d7468a4738]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168] added
Aug 14 13:49:39 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[babd7634-7673-490c-b102-6d23023df6d5]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49e8a83-7b55-465f-93f2-807521d6bdc8]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HuObsBKv {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HuObsBKv" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3850b9c7-6c1b-49b7-a688-500a61d3bf03]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HuObsBKv'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9bc5c0-1297-4774-b0ab-ad5c88811331]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[160e1a78-08b4-4ff3-bb55-2b406aace9cf]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04265147-3389-41fa-ba41-291b02a3cbcd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63790dc6-fe82-4e7f-894d-29355c3e2b95 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:49:39 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:49:39 user nova-compute[73484]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:49:39 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:49:39 user nova-compute[73484]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04265147-3389-41fa-ba41-291b02a3cbcd (non-flash)
Aug 14 13:49:39 user nova-compute[73484]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63790dc6-fe82-4e7f-894d-29355c3e2b95 (non-flash)
Aug 14 13:49:39 user nova-compute[73484]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e (non-flash)
Aug 14 13:49:39 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:49:39 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:49:39 user nova-compute[73484]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:49:39 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:49:39 user nova-compute[73484]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04265147-3389-41fa-ba41-291b02a3cbcd (non-flash)
Aug 14 13:49:39 user nova-compute[73484]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63790dc6-fe82-4e7f-894d-29355c3e2b95 (non-flash)
Aug 14 13:49:39 user nova-compute[73484]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e (non-flash)
Aug 14 13:49:39 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5972a97-c808-4221-aaa8-b9936f0e5e76]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:39 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168, portal: 172.16.0.220,3260]
Aug 14 13:49:39 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168, portal: 172.16.0.220,3260] successful.
Aug 14 13:49:39 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:49:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:40 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[544e5f6f-dfd2-45bb-90e4-f2f4dfe1be9c]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:40 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:49:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:40 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce64b428-a6f5-467d-91c3-5b239a11144b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04265147-3389-41fa-ba41-291b02a3cbcd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63790dc6-fe82-4e7f-894d-29355c3e2b95 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:40 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:49:40 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:49:40 user nova-compute[73484]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:49:40 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:49:40 user nova-compute[73484]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04265147-3389-41fa-ba41-291b02a3cbcd (non-flash)
Aug 14 13:49:40 user nova-compute[73484]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63790dc6-fe82-4e7f-894d-29355c3e2b95 (non-flash)
Aug 14 13:49:40 user nova-compute[73484]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e (non-flash)
Aug 14 13:49:40 user nova-compute[73484]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)
Aug 14 13:49:40 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:49:40 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:49:40 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:49:40 user nova-compute[73484]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:49:40 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:49:40 user nova-compute[73484]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04265147-3389-41fa-ba41-291b02a3cbcd (non-flash)
Aug 14 13:49:40 user nova-compute[73484]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63790dc6-fe82-4e7f-894d-29355c3e2b95 (non-flash)
Aug 14 13:49:40 user nova-compute[73484]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e (non-flash)
Aug 14 13:49:40 user nova-compute[73484]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)
Aug 14 13:49:40 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:49:40 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.390s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:49:40 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:49:40 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] HCTL ('40', '-', '-', 0) found on session 37 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:49:40 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:49:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:40 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:40 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d75347-cef9-4fb0-9d51-04ee35421b25]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:40 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Searching for a device in session 37 and hctl ['40', '*', '*', 0] yield: None {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:49:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:49:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:49:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] No VIF found with MAC fa:16:3e:cb:14:c8, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:49:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-29ba4251-adf9-4a87-ad4f-3bac3542377f tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.585s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:49:40 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:49:40 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 13:49:40 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Rebuilding the list of instances to heal {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 13:49:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-f4f7788c-fcca-47c1-b5b8-72892253982d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:49:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-f4f7788c-fcca-47c1-b5b8-72892253982d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:49:40 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 13:49:40 user nova-compute[73484]: DEBUG nova.objects.instance [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lazy-loading 'info_cache' on Instance uuid f4f7788c-fcca-47c1-b5b8-72892253982d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:49:41 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Searching for a device in session 37 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:49:41 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuObsBKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:49:41 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.431s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:49:41 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] <== connect_volume: return (1865ms) {'type': 'block', 'scsi_wwn': '23762306231343539', 'path': '/dev/sdi'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:49:41 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762306231343539', 'path': '/dev/sdi'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:49:41 user nova-compute[73484]: DEBUG nova.objects.instance [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lazy-loading 'flavor' on Instance uuid 700e95c1-08b0-4613-992b-4314b127e14a {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:49:41 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 13:49:41 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:49:41 user nova-compute[73484]:   <source dev="/dev/sdi"/>
Aug 14 13:49:41 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:49:41 user nova-compute[73484]:   <serial>be929e7f-c83d-4847-9433-fb9bfafaf168</serial>
Aug 14 13:49:41 user nova-compute[73484]: </disk>
Aug 14 13:49:41 user nova-compute[73484]:  {{(pid=73484) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 13:49:41 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:41 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Updating instance_info_cache with network_info: [{"id": "5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b", "address": "fa:16:3e:8b:e0:96", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc7ee1a-4f", "ovs_interfaceid": "5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:49:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-f4f7788c-fcca-47c1-b5b8-72892253982d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:49:41 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 13:49:41 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:49:41 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 13:49:41 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:49:41 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:49:41 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] No VIF found with MAC fa:16:3e:bb:3e:ce, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:49:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-99c3f97c-df7d-4c04-9ab3-b74a0e729d05 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "700e95c1-08b0-4613-992b-4314b127e14a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.898s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:49:42 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:42 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:49:43 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:49:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:49:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:49:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:49:43 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 13:49:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:44 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:49:44 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:49:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:49:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:49:44 user nova-compute[73484]: DEBUG nova.objects.instance [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'flavor' on Instance uuid 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:49:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.106s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:49:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:49:45 user nova-compute[73484]: INFO nova.compute.manager [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Attaching volume 08fe7574-b9fd-433f-9d0b-9cc277b9370d to /dev/vdc
Aug 14 13:49:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG os_brick.utils [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ace4a0-b20c-4f5e-8b14-e678f0488aa1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6a658f-f86b-4324-8891-14dd3a6d28ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89b91d0-0039-4741-ba24-30aea00ce357]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c829ed44-385f-408c-9641-7edb3274e3a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:49:45 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:49:45 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[795cd8c5-3ac4-4243-b73a-e12f7ae8a15e]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG os_brick.utils [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Updating existing volume attachment record: 6ab742f0-64e8-4c14-b77b-3b32bf4d45eb {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG nova.compute.manager [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:49:45 user nova-compute[73484]: INFO nova.compute.claims [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Claim successful on node user
Aug 14 13:49:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:46 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:49:46 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:49:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.302s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:49:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:49:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:49:47 user nova-compute[73484]: DEBUG nova.network.neutron [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:49:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:49:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:47 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:49:47 user nova-compute[73484]: DEBUG nova.policy [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3ccc9cc867644d9bc040e9dfd4eb231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404795fcace4922a10abdb33740e87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:49:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:49:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:49:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:49:47 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Creating image(s)
Aug 14 13:49:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:49:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "/opt/stack/data/nova/instances/b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:49:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "/opt/stack/data/nova/instances/b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:49:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:49:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2545f107-974a-4ee8-ba9b-7d7f7bb1ae91/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.225s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:49:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:49:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2545f107-974a-4ee8-ba9b-7d7f7bb1ae91/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2545f107-974a-4ee8-ba9b-7d7f7bb1ae91/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.210s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25/disk 1073741824" returned: 0 in 0.057s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:49:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2545f107-974a-4ee8-ba9b-7d7f7bb1ae91/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:48 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:49:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.174s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:48 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:49:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:48 user nova-compute[73484]: DEBUG nova.network.neutron [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Successfully created port: 394f5b05-1b37-43b0-adc5-070c7a914bd6 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:49:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:48 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Cannot resize image /opt/stack/data/nova/instances/b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:49:48 user nova-compute[73484]: DEBUG nova.objects.instance [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lazy-loading 'migration_context' on Instance uuid b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:49:48 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:49:48 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Ensure instance console log exists: /opt/stack/data/nova/instances/b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:49:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:49:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:49:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:49:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:49 user nova-compute[73484]: DEBUG nova.network.neutron [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Successfully updated port: 394f5b05-1b37-43b0-adc5-070c7a914bd6 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:49:49 user nova-compute[73484]: DEBUG nova.compute.manager [req-7da71c46-da3b-4571-b3ce-fa7d5ed5a5a0 req-7e2f8f5d-ae48-4a17-aa03-82b1a6cd6ed2 service nova] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Received event network-changed-394f5b05-1b37-43b0-adc5-070c7a914bd6 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:49:49 user nova-compute[73484]: DEBUG nova.compute.manager [req-7da71c46-da3b-4571-b3ce-fa7d5ed5a5a0 req-7e2f8f5d-ae48-4a17-aa03-82b1a6cd6ed2 service nova] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Refreshing instance network info cache due to event network-changed-394f5b05-1b37-43b0-adc5-070c7a914bd6. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:49:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-7da71c46-da3b-4571-b3ce-fa7d5ed5a5a0 req-7e2f8f5d-ae48-4a17-aa03-82b1a6cd6ed2 service nova] Acquiring lock "refresh_cache-b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:49:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-7da71c46-da3b-4571-b3ce-fa7d5ed5a5a0 req-7e2f8f5d-ae48-4a17-aa03-82b1a6cd6ed2 service nova] Acquired lock "refresh_cache-b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:49:49 user nova-compute[73484]: DEBUG nova.network.neutron [req-7da71c46-da3b-4571-b3ce-fa7d5ed5a5a0 req-7e2f8f5d-ae48-4a17-aa03-82b1a6cd6ed2 service nova] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Refreshing network info cache for port 394f5b05-1b37-43b0-adc5-070c7a914bd6 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:49:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "refresh_cache-b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:49:49 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:49:49 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:49:49 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=6834MB free_disk=25.256202697753906GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 13:49:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:49:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:49:49 user nova-compute[73484]: DEBUG nova.network.neutron [req-7da71c46-da3b-4571-b3ce-fa7d5ed5a5a0 req-7e2f8f5d-ae48-4a17-aa03-82b1a6cd6ed2 service nova] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:49:49 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance f4f7788c-fcca-47c1-b5b8-72892253982d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:49:49 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 07bac569-8b2c-4555-b4d5-a74f7384630b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:49:49 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance a9d4ec42-3db9-439b-87a7-02bcaab514a4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:49:49 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance bd43e3a9-0413-4e55-b6a1-7f3f792ba872 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:49:49 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance c0994bac-3b43-414e-aa81-a9d7198775a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:49:49 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 782c6142-757a-49ae-9292-787a7f1e8a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:49:49 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 03255d24-b6fd-459c-8ac6-f9c4063b54b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:49:49 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 09ba29fd-8161-485c-ba6d-71d24ab086bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:49:49 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:49:49 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 700e95c1-08b0-4613-992b-4314b127e14a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:49:49 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance b43ccb18-6d2d-43f2-a185-bb558d5d6f45 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:49:49 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 72f007af-a1e7-4a80-954c-ed12aaf129fd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:49:49 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 86580f0d-dd88-48fb-bce8-dc6f5edc01c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:49:49 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:49:49 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 13:49:49 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 13:49:50 user nova-compute[73484]: DEBUG nova.network.neutron [req-7da71c46-da3b-4571-b3ce-fa7d5ed5a5a0 req-7e2f8f5d-ae48-4a17-aa03-82b1a6cd6ed2 service nova] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:49:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-7da71c46-da3b-4571-b3ce-fa7d5ed5a5a0 req-7e2f8f5d-ae48-4a17-aa03-82b1a6cd6ed2 service nova] Releasing lock "refresh_cache-b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:49:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquired lock "refresh_cache-b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:49:50 user nova-compute[73484]: DEBUG nova.network.neutron [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:49:50 user nova-compute[73484]: DEBUG nova.network.neutron [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:49:50 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:49:50 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:49:50 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 13:49:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.763s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG nova.network.neutron [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Updating instance_info_cache with network_info: [{"id": "394f5b05-1b37-43b0-adc5-070c7a914bd6", "address": "fa:16:3e:f3:39:1f", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap394f5b05-1b", "ovs_interfaceid": "394f5b05-1b37-43b0-adc5-070c7a914bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Releasing lock "refresh_cache-b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG nova.compute.manager [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Instance network_info: |[{"id": "394f5b05-1b37-43b0-adc5-070c7a914bd6", "address": "fa:16:3e:f3:39:1f", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap394f5b05-1b", "ovs_interfaceid": "394f5b05-1b37-43b0-adc5-070c7a914bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Start _get_guest_xml network_info=[{"id": "394f5b05-1b37-43b0-adc5-070c7a914bd6", "address": "fa:16:3e:f3:39:1f", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap394f5b05-1b", "ovs_interfaceid": "394f5b05-1b37-43b0-adc5-070c7a914bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:49:51 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:49:51 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:49:51 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:49:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-884455025',display_name='tempest-AttachVolumeNegativeTest-server-884455025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-884455025',id=31,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOh6W7bffdduXBmQ4kNMsFsrBazgeuuIEyIb5bubZKcNhtkn4rrVlhWF3BTgMfhR9n3ppEk8JAYTmL3VRNV3aM0RuiKR6EFBn2ZxgMpXm/0x0vL+hdFXEM+/g+Ez4NGWTw==',key_name='tempest-keypair-116814291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f404795fcace4922a10abdb33740e87d',ramdisk_id='',reservation_id='r-xs1m3p1k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1043074889',owner_user_name='tempest-AttachVolumeNegativeTest-1043074889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:49:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3ccc9cc867644d9bc040e9dfd4eb231',uuid=b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "394f5b05-1b37-43b0-adc5-070c7a914bd6", "address": "fa:16:3e:f3:39:1f", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap394f5b05-1b", "ovs_interfaceid": "394f5b05-1b37-43b0-adc5-070c7a914bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Converting VIF {"id": "394f5b05-1b37-43b0-adc5-070c7a914bd6", "address": "fa:16:3e:f3:39:1f", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap394f5b05-1b", "ovs_interfaceid": "394f5b05-1b37-43b0-adc5-070c7a914bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:39:1f,bridge_name='br-int',has_traffic_filtering=True,id=394f5b05-1b37-43b0-adc5-070c7a914bd6,network=Network(10d4738f-25c6-4995-a4b7-6fbee86f070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap394f5b05-1b') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG nova.objects.instance [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lazy-loading 'pci_devices' on Instance uuid b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:49:51 user nova-compute[73484]:   <uuid>b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25</uuid>
Aug 14 13:49:51 user nova-compute[73484]:   <name>instance-0000001f</name>
Aug 14 13:49:51 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:49:51 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:49:51 user nova-compute[73484]:   <metadata>
Aug 14 13:49:51 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:49:51 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:49:51 user nova-compute[73484]:       <nova:name>tempest-AttachVolumeNegativeTest-server-884455025</nova:name>
Aug 14 13:49:51 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:49:51</nova:creationTime>
Aug 14 13:49:51 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:49:51 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:49:51 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:49:51 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:49:51 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:49:51 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:49:51 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:49:51 user nova-compute[73484]:       <nova:owner>
Aug 14 13:49:51 user nova-compute[73484]:         <nova:user uuid="b3ccc9cc867644d9bc040e9dfd4eb231">tempest-AttachVolumeNegativeTest-1043074889-project-member</nova:user>
Aug 14 13:49:51 user nova-compute[73484]:         <nova:project uuid="f404795fcace4922a10abdb33740e87d">tempest-AttachVolumeNegativeTest-1043074889</nova:project>
Aug 14 13:49:51 user nova-compute[73484]:       </nova:owner>
Aug 14 13:49:51 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:49:51 user nova-compute[73484]:       <nova:ports>
Aug 14 13:49:51 user nova-compute[73484]:         <nova:port uuid="394f5b05-1b37-43b0-adc5-070c7a914bd6">
Aug 14 13:49:51 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 13:49:51 user nova-compute[73484]:         </nova:port>
Aug 14 13:49:51 user nova-compute[73484]:       </nova:ports>
Aug 14 13:49:51 user nova-compute[73484]:     </nova:instance>
Aug 14 13:49:51 user nova-compute[73484]:   </metadata>
Aug 14 13:49:51 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:49:51 user nova-compute[73484]:     <system>
Aug 14 13:49:51 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:49:51 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:49:51 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:49:51 user nova-compute[73484]:       <entry name="serial">b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25</entry>
Aug 14 13:49:51 user nova-compute[73484]:       <entry name="uuid">b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25</entry>
Aug 14 13:49:51 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:49:51 user nova-compute[73484]:     </system>
Aug 14 13:49:51 user nova-compute[73484]:   </sysinfo>
Aug 14 13:49:51 user nova-compute[73484]:   <os>
Aug 14 13:49:51 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:49:51 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:49:51 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:49:51 user nova-compute[73484]:   </os>
Aug 14 13:49:51 user nova-compute[73484]:   <features>
Aug 14 13:49:51 user nova-compute[73484]:     <acpi/>
Aug 14 13:49:51 user nova-compute[73484]:     <apic/>
Aug 14 13:49:51 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:49:51 user nova-compute[73484]:   </features>
Aug 14 13:49:51 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:49:51 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:49:51 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:49:51 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:49:51 user nova-compute[73484]:   </clock>
Aug 14 13:49:51 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:49:51 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:49:51 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:49:51 user nova-compute[73484]:   </cpu>
Aug 14 13:49:51 user nova-compute[73484]:   <devices>
Aug 14 13:49:51 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:49:51 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:49:51 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25/disk"/>
Aug 14 13:49:51 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:49:51 user nova-compute[73484]:     </disk>
Aug 14 13:49:51 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:49:51 user nova-compute[73484]:       <mac address="fa:16:3e:f3:39:1f"/>
Aug 14 13:49:51 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:49:51 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:49:51 user nova-compute[73484]:       <target dev="tap394f5b05-1b"/>
Aug 14 13:49:51 user nova-compute[73484]:     </interface>
Aug 14 13:49:51 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:49:51 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25/console.log" append="off"/>
Aug 14 13:49:51 user nova-compute[73484]:     </serial>
Aug 14 13:49:51 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:49:51 user nova-compute[73484]:     <video>
Aug 14 13:49:51 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:49:51 user nova-compute[73484]:     </video>
Aug 14 13:49:51 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:49:51 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:49:51 user nova-compute[73484]:     </rng>
Aug 14 13:49:51 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:49:51 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:49:51 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:49:51 user nova-compute[73484]:     </memballoon>
Aug 14 13:49:51 user nova-compute[73484]:   </devices>
Aug 14 13:49:51 user nova-compute[73484]: </domain>
Aug 14 13:49:51 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:49:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-884455025',display_name='tempest-AttachVolumeNegativeTest-server-884455025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-884455025',id=31,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOh6W7bffdduXBmQ4kNMsFsrBazgeuuIEyIb5bubZKcNhtkn4rrVlhWF3BTgMfhR9n3ppEk8JAYTmL3VRNV3aM0RuiKR6EFBn2ZxgMpXm/0x0vL+hdFXEM+/g+Ez4NGWTw==',key_name='tempest-keypair-116814291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f404795fcace4922a10abdb33740e87d',ramdisk_id='',reservation_id='r-xs1m3p1k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1043074889',owner_user_name='tempest-AttachVolumeNegativeTest-1043074889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:49:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3ccc9cc867644d9bc040e9dfd4eb231',uuid=b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "394f5b05-1b37-43b0-adc5-070c7a914bd6", "address": "fa:16:3e:f3:39:1f", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap394f5b05-1b", "ovs_interfaceid": "394f5b05-1b37-43b0-adc5-070c7a914bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Converting VIF {"id": "394f5b05-1b37-43b0-adc5-070c7a914bd6", "address": "fa:16:3e:f3:39:1f", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap394f5b05-1b", "ovs_interfaceid": "394f5b05-1b37-43b0-adc5-070c7a914bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:39:1f,bridge_name='br-int',has_traffic_filtering=True,id=394f5b05-1b37-43b0-adc5-070c7a914bd6,network=Network(10d4738f-25c6-4995-a4b7-6fbee86f070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap394f5b05-1b') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG os_vif [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:39:1f,bridge_name='br-int',has_traffic_filtering=True,id=394f5b05-1b37-43b0-adc5-070c7a914bd6,network=Network(10d4738f-25c6-4995-a4b7-6fbee86f070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap394f5b05-1b') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap394f5b05-1b, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap394f5b05-1b, col_values=(('external_ids', {'iface-id': '394f5b05-1b37-43b0-adc5-070c7a914bd6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:39:1f', 'vm-uuid': 'b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:51 user nova-compute[73484]: INFO os_vif [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:39:1f,bridge_name='br-int',has_traffic_filtering=True,id=394f5b05-1b37-43b0-adc5-070c7a914bd6,network=Network(10d4738f-25c6-4995-a4b7-6fbee86f070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap394f5b05-1b')
Aug 14 13:49:51 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] No VIF found with MAC fa:16:3e:f3:39:1f, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:49:51 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:49:52 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:52 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:53 user nova-compute[73484]: DEBUG nova.compute.manager [req-1bfbcee4-bc7e-4743-8681-81066c6c9e2a req-be8ac060-8fc9-4b75-a6a8-ecccec2624eb service nova] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Received event network-vif-plugged-394f5b05-1b37-43b0-adc5-070c7a914bd6 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:49:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1bfbcee4-bc7e-4743-8681-81066c6c9e2a req-be8ac060-8fc9-4b75-a6a8-ecccec2624eb service nova] Acquiring lock "b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:49:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1bfbcee4-bc7e-4743-8681-81066c6c9e2a req-be8ac060-8fc9-4b75-a6a8-ecccec2624eb service nova] Lock "b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:49:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1bfbcee4-bc7e-4743-8681-81066c6c9e2a req-be8ac060-8fc9-4b75-a6a8-ecccec2624eb service nova] Lock "b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:49:53 user nova-compute[73484]: DEBUG nova.compute.manager [req-1bfbcee4-bc7e-4743-8681-81066c6c9e2a req-be8ac060-8fc9-4b75-a6a8-ecccec2624eb service nova] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] No waiting events found dispatching network-vif-plugged-394f5b05-1b37-43b0-adc5-070c7a914bd6 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:49:53 user nova-compute[73484]: WARNING nova.compute.manager [req-1bfbcee4-bc7e-4743-8681-81066c6c9e2a req-be8ac060-8fc9-4b75-a6a8-ecccec2624eb service nova] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Received unexpected event network-vif-plugged-394f5b05-1b37-43b0-adc5-070c7a914bd6 for instance with vm_state building and task_state spawning.
Aug 14 13:49:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:55 user nova-compute[73484]: DEBUG nova.compute.manager [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:49:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:49:55 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020995.497779, b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:49:55 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] VM Resumed (Lifecycle Event)
Aug 14 13:49:55 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Instance spawned successfully.
Aug 14 13:49:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:49:55 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:49:55 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:49:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:49:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:49:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:49:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:49:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:49:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:49:55 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:49:55 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692020995.5015254, b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:49:55 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] VM Started (Lifecycle Event)
Aug 14 13:49:55 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:49:55 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:49:55 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:49:55 user nova-compute[73484]: INFO nova.compute.manager [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Took 8.10 seconds to spawn the instance on the hypervisor.
Aug 14 13:49:55 user nova-compute[73484]: DEBUG nova.compute.manager [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:49:55 user nova-compute[73484]: INFO nova.compute.manager [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Took 10.08 seconds to build instance.
Aug 14 13:49:55 user nova-compute[73484]: DEBUG nova.compute.manager [req-59d6b7b7-dcb1-4206-a1b4-91d20dda3a02 req-0467d0ff-8b66-44f6-848e-161a048de251 service nova] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Received event network-vif-plugged-394f5b05-1b37-43b0-adc5-070c7a914bd6 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:49:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-59d6b7b7-dcb1-4206-a1b4-91d20dda3a02 req-0467d0ff-8b66-44f6-848e-161a048de251 service nova] Acquiring lock "b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:49:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-59d6b7b7-dcb1-4206-a1b4-91d20dda3a02 req-0467d0ff-8b66-44f6-848e-161a048de251 service nova] Lock "b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:49:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-59d6b7b7-dcb1-4206-a1b4-91d20dda3a02 req-0467d0ff-8b66-44f6-848e-161a048de251 service nova] Lock "b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:49:55 user nova-compute[73484]: DEBUG nova.compute.manager [req-59d6b7b7-dcb1-4206-a1b4-91d20dda3a02 req-0467d0ff-8b66-44f6-848e-161a048de251 service nova] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] No waiting events found dispatching network-vif-plugged-394f5b05-1b37-43b0-adc5-070c7a914bd6 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:49:55 user nova-compute[73484]: WARNING nova.compute.manager [req-59d6b7b7-dcb1-4206-a1b4-91d20dda3a02 req-0467d0ff-8b66-44f6-848e-161a048de251 service nova] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Received unexpected event network-vif-plugged-394f5b05-1b37-43b0-adc5-070c7a914bd6 for instance with vm_state active and task_state None.
Aug 14 13:49:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cac56382-1f71-47cb-9329-599e90f94f99 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.531s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-12d875f7-3016-47c4-b868-d4b242ebf240 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Acquiring lock "bd43e3a9-0413-4e55-b6a1-7f3f792ba872" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-12d875f7-3016-47c4-b868-d4b242ebf240 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "bd43e3a9-0413-4e55-b6a1-7f3f792ba872" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-12d875f7-3016-47c4-b868-d4b242ebf240 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Acquiring lock "bd43e3a9-0413-4e55-b6a1-7f3f792ba872-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-12d875f7-3016-47c4-b868-d4b242ebf240 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "bd43e3a9-0413-4e55-b6a1-7f3f792ba872-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-12d875f7-3016-47c4-b868-d4b242ebf240 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "bd43e3a9-0413-4e55-b6a1-7f3f792ba872-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:49:56 user nova-compute[73484]: INFO nova.compute.manager [None req-12d875f7-3016-47c4-b868-d4b242ebf240 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Terminating instance
Aug 14 13:49:56 user nova-compute[73484]: DEBUG nova.compute.manager [None req-12d875f7-3016-47c4-b868-d4b242ebf240 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GOhBJMbp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:49:56 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:49:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:49:56 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:49:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:49:56 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:49:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb0487c-4d7b-4b70-9ff2-36e0d4396fff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:49:56 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8b4926-cc5d-4e84-81c7-ed95c9080efe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d] added
Aug 14 13:49:56 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf22f67-eb1e-401c-9fe9-fa6c1e63a70c]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d7a265-6929-4703-a191-2956060245c3]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GOhBJMbp {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GOhBJMbp" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e83f85-2dcf-4c1b-8ef7-3fbda47dc614]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GOhBJMbp'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6e929c-1816-4944-b75b-f827d8d21b95]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[033faf3a-655f-46fe-836d-ce00ceba5103]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:49:56 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:49:56 user nova-compute[73484]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:49:56 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:49:56 user nova-compute[73484]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e (non-flash)
Aug 14 13:49:56 user nova-compute[73484]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)
Aug 14 13:49:56 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:49:56 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:49:56 user nova-compute[73484]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:49:56 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:49:56 user nova-compute[73484]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e (non-flash)
Aug 14 13:49:56 user nova-compute[73484]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)
Aug 14 13:49:56 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:49:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a332f5-aa3f-45eb-8ea5-379de8d60b19]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d, portal: 172.16.0.220,3260]
Aug 14 13:49:57 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d, portal: 172.16.0.220,3260] successful.
Aug 14 13:49:57 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:49:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[312f4623-29f7-45ed-89e3-ffbde765020e]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:49:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3377a2-f12e-4a52-acbb-31d2dbacafef]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:49:57 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:49:57 user nova-compute[73484]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:49:57 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:49:57 user nova-compute[73484]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e (non-flash)
Aug 14 13:49:57 user nova-compute[73484]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)
Aug 14 13:49:57 user nova-compute[73484]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d (non-flash)
Aug 14 13:49:57 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:49:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:49:57 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:49:57 user nova-compute[73484]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:49:57 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:49:57 user nova-compute[73484]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e (non-flash)
Aug 14 13:49:57 user nova-compute[73484]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)
Aug 14 13:49:57 user nova-compute[73484]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d (non-flash)
Aug 14 13:49:57 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:49:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.415s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:49:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:49:57 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] HCTL ('37', '-', '-', 0) found on session 38 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:49:57 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:49:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:49:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:49:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a851f93-1f65-483d-aaef-1bec7e4b10ae]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:49:57 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: None {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:49:57 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Instance destroyed successfully.
Aug 14 13:49:57 user nova-compute[73484]: DEBUG nova.objects.instance [None req-12d875f7-3016-47c4-b868-d4b242ebf240 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lazy-loading 'resources' on Instance uuid bd43e3a9-0413-4e55-b6a1-7f3f792ba872 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:49:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-12d875f7-3016-47c4-b868-d4b242ebf240 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:40:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1494210179',display_name='tempest-ServersNegativeTestJSON-server-1494210179',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1494210179',id=16,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:41:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76ff7afafc2d4b1fa74902cdf0ce08d6',ramdisk_id='',reservation_id='r-uq87c6tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-287955364',owner_user_name='tempest-ServersNegativeTestJSON-287955364-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:41:07Z,user_data=None,user_id='33fea6b1b7dd4b2297bac12011f57a17',uuid=bd43e3a9-0413-4e55-b6a1-7f3f792ba872,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a161ec7-dffc-474f-b741-381bf53615d4", "address": "fa:16:3e:bf:29:a7", "network": {"id": "893008ed-2c71-42ba-bf31-28baba1b8c2c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1936284602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ff7afafc2d4b1fa74902cdf0ce08d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a161ec7-df", "ovs_interfaceid": "0a161ec7-dffc-474f-b741-381bf53615d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:49:57 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-12d875f7-3016-47c4-b868-d4b242ebf240 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Converting VIF {"id": "0a161ec7-dffc-474f-b741-381bf53615d4", "address": "fa:16:3e:bf:29:a7", "network": {"id": "893008ed-2c71-42ba-bf31-28baba1b8c2c", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1936284602-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76ff7afafc2d4b1fa74902cdf0ce08d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a161ec7-df", "ovs_interfaceid": "0a161ec7-dffc-474f-b741-381bf53615d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:49:57 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-12d875f7-3016-47c4-b868-d4b242ebf240 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:29:a7,bridge_name='br-int',has_traffic_filtering=True,id=0a161ec7-dffc-474f-b741-381bf53615d4,network=Network(893008ed-2c71-42ba-bf31-28baba1b8c2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a161ec7-df') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:49:57 user nova-compute[73484]: DEBUG os_vif [None req-12d875f7-3016-47c4-b868-d4b242ebf240 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:29:a7,bridge_name='br-int',has_traffic_filtering=True,id=0a161ec7-dffc-474f-b741-381bf53615d4,network=Network(893008ed-2c71-42ba-bf31-28baba1b8c2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a161ec7-df') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:49:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a161ec7-df, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:49:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:49:57 user nova-compute[73484]: INFO os_vif [None req-12d875f7-3016-47c4-b868-d4b242ebf240 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:29:a7,bridge_name='br-int',has_traffic_filtering=True,id=0a161ec7-dffc-474f-b741-381bf53615d4,network=Network(893008ed-2c71-42ba-bf31-28baba1b8c2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a161ec7-df')
Aug 14 13:49:57 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-12d875f7-3016-47c4-b868-d4b242ebf240 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Deleting instance files /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872_del
Aug 14 13:49:57 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-12d875f7-3016-47c4-b868-d4b242ebf240 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Deletion of /opt/stack/data/nova/instances/bd43e3a9-0413-4e55-b6a1-7f3f792ba872_del complete
Aug 14 13:49:57 user nova-compute[73484]: INFO nova.compute.manager [None req-12d875f7-3016-47c4-b868-d4b242ebf240 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 14 13:49:57 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-12d875f7-3016-47c4-b868-d4b242ebf240 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:49:57 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:49:57 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:49:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:58 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:49:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GOhBJMbp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:49:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.454s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:49:58 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] <== connect_volume: return (1456ms) {'type': 'block', 'scsi_wwn': '23865316536393862', 'path': '/dev/sdf'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:49:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865316536393862', 'path': '/dev/sdf'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:49:58 user nova-compute[73484]: DEBUG nova.objects.instance [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'flavor' on Instance uuid 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:49:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 13:49:58 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:49:58 user nova-compute[73484]:   <source dev="/dev/sdf"/>
Aug 14 13:49:58 user nova-compute[73484]:   <target dev="vdc" bus="virtio"/>
Aug 14 13:49:58 user nova-compute[73484]:   <serial>08fe7574-b9fd-433f-9d0b-9cc277b9370d</serial>
Aug 14 13:49:58 user nova-compute[73484]: </disk>
Aug 14 13:49:58 user nova-compute[73484]:  {{(pid=73484) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 13:49:58 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:49:58 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Took 1.14 seconds to deallocate network for instance.
Aug 14 13:49:58 user nova-compute[73484]: DEBUG nova.compute.manager [req-e79cff8f-e1be-467a-aef8-6206d12bacd3 req-10ccc42c-4bf2-47b5-9812-2faaa1d4e537 service nova] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Received event network-vif-deleted-0a161ec7-dffc-474f-b741-381bf53615d4 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:49:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-12d875f7-3016-47c4-b868-d4b242ebf240 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:49:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-12d875f7-3016-47c4-b868-d4b242ebf240 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:49:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:49:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:49:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:49:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] No VIF found with MAC fa:16:3e:cb:14:c8, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:49:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-29913b12-bb40-4bc8-9ce3-ad27bd5db41e tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.768s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:49:59 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-12d875f7-3016-47c4-b868-d4b242ebf240 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:49:59 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-12d875f7-3016-47c4-b868-d4b242ebf240 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:49:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-12d875f7-3016-47c4-b868-d4b242ebf240 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.563s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:49:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:49:59 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-12d875f7-3016-47c4-b868-d4b242ebf240 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Deleted allocations for instance bd43e3a9-0413-4e55-b6a1-7f3f792ba872
Aug 14 13:49:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-12d875f7-3016-47c4-b868-d4b242ebf240 tempest-ServersNegativeTestJSON-287955364 tempest-ServersNegativeTestJSON-287955364-project-member] Lock "bd43e3a9-0413-4e55-b6a1-7f3f792ba872" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.934s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:49:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:49:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:49:59 user nova-compute[73484]: INFO nova.compute.manager [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Detaching volume b1ea7889-29b1-4c6a-89a6-fc61dcc6502e
Aug 14 13:50:00 user nova-compute[73484]: INFO nova.virt.block_device [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Attempting to driver detach volume b1ea7889-29b1-4c6a-89a6-fc61dcc6502e from mountpoint /dev/vdb
Aug 14 13:50:00 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Attempting to detach device vdb from instance 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91 from the persistent domain config. {{(pid=73484) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:50:00 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:50:00 user nova-compute[73484]:   <source dev="/dev/sdh"/>
Aug 14 13:50:00 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:50:00 user nova-compute[73484]:   <serial>b1ea7889-29b1-4c6a-89a6-fc61dcc6502e</serial>
Aug 14 13:50:00 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 13:50:00 user nova-compute[73484]: </disk>
Aug 14 13:50:00 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:50:00 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Successfully detached device vdb from instance 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91 from the persistent domain config.
Aug 14 13:50:00 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91 from the live domain config. {{(pid=73484) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:50:00 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:50:00 user nova-compute[73484]:   <source dev="/dev/sdh"/>
Aug 14 13:50:00 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:50:00 user nova-compute[73484]:   <serial>b1ea7889-29b1-4c6a-89a6-fc61dcc6502e</serial>
Aug 14 13:50:00 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 13:50:00 user nova-compute[73484]: </disk>
Aug 14 13:50:00 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Received event <DeviceRemovedEvent: 1692021000.590304, 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73484) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91 {{(pid=73484) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 13:50:00 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Successfully detached device vdb from instance 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91 from the live domain config.
Aug 14 13:50:00 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TidINLeP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:50:00 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:50:00 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efcef06-0b25-4a38-bffa-35951d38492c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3c58d1-e618-4d8f-8157-a3f6dcc420f4]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:50:00 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:50:00 user nova-compute[73484]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:50:00 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:50:00 user nova-compute[73484]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e (non-flash)
Aug 14 13:50:00 user nova-compute[73484]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)
Aug 14 13:50:00 user nova-compute[73484]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d (non-flash)
Aug 14 13:50:00 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:50:00 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:50:00 user nova-compute[73484]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:50:00 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:50:00 user nova-compute[73484]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e (non-flash)
Aug 14 13:50:00 user nova-compute[73484]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)
Aug 14 13:50:00 user nova-compute[73484]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d (non-flash)
Aug 14 13:50:00 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4586e67a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e'): ({'sdh'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Removing single pathed devices sdh {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7ec8fc-21ca-4955-970c-f4f266fdfbff]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[65be9029-3305-42e0-869d-66b75dbf9e2f]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Flushing IO for device /dev/sdh {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fe8f0c-c57e-4442-a842-f9b0efad0569]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6427c6-e6e8-459f-acf6-9a554cc83ddd]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] SCSI volumes sdh have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f5117b-eed2-441c-bdb0-7b2164e5cc07]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53a01bf-7c4d-4e1e-a229-f14b96aff9cd]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e, portal: 172.16.0.220,3260]
Aug 14 13:50:00 user nova-compute[73484]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e, portal: 172.16.0.220,3260] successful.
Aug 14 13:50:00 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ea7889-29b1-4c6a-89a6-fc61dcc6502e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff797a9-2091-4bff-8de6-8bfa2e9c5a92]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] <== disconnect_volume: return (334ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:50:00 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:50:01 user nova-compute[73484]: DEBUG nova.objects.instance [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'flavor' on Instance uuid 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:50:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-04bf2f61-170d-4728-916b-8f468cb926b7 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.913s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:02 user nova-compute[73484]: INFO nova.compute.manager [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Detaching volume 08fe7574-b9fd-433f-9d0b-9cc277b9370d
Aug 14 13:50:02 user nova-compute[73484]: INFO nova.virt.block_device [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Attempting to driver detach volume 08fe7574-b9fd-433f-9d0b-9cc277b9370d from mountpoint /dev/vdc
Aug 14 13:50:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Attempting to detach device vdc from instance 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91 from the persistent domain config. {{(pid=73484) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 13:50:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:50:02 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:50:02 user nova-compute[73484]:   <source dev="/dev/sdf"/>
Aug 14 13:50:02 user nova-compute[73484]:   <target dev="vdc" bus="virtio"/>
Aug 14 13:50:02 user nova-compute[73484]:   <serial>08fe7574-b9fd-433f-9d0b-9cc277b9370d</serial>
Aug 14 13:50:02 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 13:50:02 user nova-compute[73484]: </disk>
Aug 14 13:50:02 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:50:02 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Successfully detached device vdc from instance 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91 from the persistent domain config.
Aug 14 13:50:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91 from the live domain config. {{(pid=73484) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 13:50:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:50:02 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:50:02 user nova-compute[73484]:   <source dev="/dev/sdf"/>
Aug 14 13:50:02 user nova-compute[73484]:   <target dev="vdc" bus="virtio"/>
Aug 14 13:50:02 user nova-compute[73484]:   <serial>08fe7574-b9fd-433f-9d0b-9cc277b9370d</serial>
Aug 14 13:50:02 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 13:50:02 user nova-compute[73484]: </disk>
Aug 14 13:50:02 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Received event <DeviceRemovedEvent: 1692021003.0460474, 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73484) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91 {{(pid=73484) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 13:50:03 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Successfully detached device vdc from instance 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91 from the live domain config.
Aug 14 13:50:03 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GOhBJMbp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:50:03 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:50:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[88491f5d-90e6-4a3f-a43a-9ec34bbd7d25]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c158b577-4382-40ea-9c18-059f2a2b6d27]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:50:03 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:50:03 user nova-compute[73484]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:50:03 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:50:03 user nova-compute[73484]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)
Aug 14 13:50:03 user nova-compute[73484]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d (non-flash)
Aug 14 13:50:03 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:50:03 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:50:03 user nova-compute[73484]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:50:03 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:50:03 user nova-compute[73484]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)
Aug 14 13:50:03 user nova-compute[73484]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d (non-flash)
Aug 14 13:50:03 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc49301b010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d'): ({'sdf'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Removing single pathed devices sdf {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4731d4c5-85f1-4889-b021-0d742808ac2e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4f463b-c42e-4a46-bb5b-ff35ce8727c5]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Flushing IO for device /dev/sdf {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b75cf47-4b61-47c8-a1e3-f6e6330e2f20]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.055s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6235a294-6c22-4eb4-b465-0f3626fbb85d]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] SCSI volumes sdf have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad24bb25-2a20-4b39-9f7c-5b9944268fc0]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b044efd-d7c4-4139-b109-6a883eeeed45]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d, portal: 172.16.0.220,3260]
Aug 14 13:50:03 user nova-compute[73484]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d, portal: 172.16.0.220,3260] successful.
Aug 14 13:50:03 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08fe7574-b9fd-433f-9d0b-9cc277b9370d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ff6240-24eb-4e58-bb92-6e28d2b6059d]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] <== disconnect_volume: return (364ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:50:03 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:50:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:04 user nova-compute[73484]: DEBUG nova.objects.instance [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'flavor' on Instance uuid 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:50:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7f10f28a-0b6f-4914-aee5-41fb6e4e860a tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.922s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f5799194-e9ff-4edf-a425-84b3f5e2ad32 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f5799194-e9ff-4edf-a425-84b3f5e2ad32 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f5799194-e9ff-4edf-a425-84b3f5e2ad32 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f5799194-e9ff-4edf-a425-84b3f5e2ad32 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f5799194-e9ff-4edf-a425-84b3f5e2ad32 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:05 user nova-compute[73484]: INFO nova.compute.manager [None req-f5799194-e9ff-4edf-a425-84b3f5e2ad32 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Terminating instance
Aug 14 13:50:05 user nova-compute[73484]: DEBUG nova.compute.manager [None req-f5799194-e9ff-4edf-a425-84b3f5e2ad32 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:50:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:05 user nova-compute[73484]: DEBUG nova.compute.manager [req-cc9c5bc4-8124-45d5-aaf1-b515bbbae04c req-bad6ef10-9d7b-41f7-b305-ba9daf848ef1 service nova] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Received event network-vif-unplugged-3a7e7a5d-c80e-427f-96fe-92670978d8ee {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:50:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-cc9c5bc4-8124-45d5-aaf1-b515bbbae04c req-bad6ef10-9d7b-41f7-b305-ba9daf848ef1 service nova] Acquiring lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-cc9c5bc4-8124-45d5-aaf1-b515bbbae04c req-bad6ef10-9d7b-41f7-b305-ba9daf848ef1 service nova] Lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-cc9c5bc4-8124-45d5-aaf1-b515bbbae04c req-bad6ef10-9d7b-41f7-b305-ba9daf848ef1 service nova] Lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:05 user nova-compute[73484]: DEBUG nova.compute.manager [req-cc9c5bc4-8124-45d5-aaf1-b515bbbae04c req-bad6ef10-9d7b-41f7-b305-ba9daf848ef1 service nova] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] No waiting events found dispatching network-vif-unplugged-3a7e7a5d-c80e-427f-96fe-92670978d8ee {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:50:05 user nova-compute[73484]: DEBUG nova.compute.manager [req-cc9c5bc4-8124-45d5-aaf1-b515bbbae04c req-bad6ef10-9d7b-41f7-b305-ba9daf848ef1 service nova] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Received event network-vif-unplugged-3a7e7a5d-c80e-427f-96fe-92670978d8ee for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:50:06 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Instance destroyed successfully.
Aug 14 13:50:06 user nova-compute[73484]: DEBUG nova.objects.instance [None req-f5799194-e9ff-4edf-a425-84b3f5e2ad32 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lazy-loading 'resources' on Instance uuid 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:50:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-f5799194-e9ff-4edf-a425-84b3f5e2ad32 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:47:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1772398713',display_name='tempest-AttachVolumeTestJSON-server-1772398713',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1772398713',id=26,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOh5tNnx2XPgpyPTTp9lhvfxf1zbtbSH0K+AJZ4Jo5NVKR/B/nAsUXzNN172vn+IbjlFPU6NNji8kFh0RSfxWrXJGee4MrKBfgE1SnM6Pl8g9OPTHjP5TPB9wTM6WiGv+w==',key_name='tempest-keypair-1322296621',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:47:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d2114819cda450ca1827ddd5557da23',ramdisk_id='',reservation_id='r-niqthdq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-852428779',owner_user_name='tempest-AttachVolumeTestJSON-852428779-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:47:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fac94bacad00447d9743d8a44118ea47',uuid=2545f107-974a-4ee8-ba9b-7d7f7bb1ae91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a7e7a5d-c80e-427f-96fe-92670978d8ee", "address": "fa:16:3e:cb:14:c8", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7e7a5d-c8", "ovs_interfaceid": "3a7e7a5d-c80e-427f-96fe-92670978d8ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:50:06 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-f5799194-e9ff-4edf-a425-84b3f5e2ad32 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Converting VIF {"id": "3a7e7a5d-c80e-427f-96fe-92670978d8ee", "address": "fa:16:3e:cb:14:c8", "network": {"id": "cddd6eb8-767a-42c5-8cca-a1fe1d2eb604", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-82170209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d2114819cda450ca1827ddd5557da23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a7e7a5d-c8", "ovs_interfaceid": "3a7e7a5d-c80e-427f-96fe-92670978d8ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:50:06 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-f5799194-e9ff-4edf-a425-84b3f5e2ad32 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:14:c8,bridge_name='br-int',has_traffic_filtering=True,id=3a7e7a5d-c80e-427f-96fe-92670978d8ee,network=Network(cddd6eb8-767a-42c5-8cca-a1fe1d2eb604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a7e7a5d-c8') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:50:06 user nova-compute[73484]: DEBUG os_vif [None req-f5799194-e9ff-4edf-a425-84b3f5e2ad32 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:14:c8,bridge_name='br-int',has_traffic_filtering=True,id=3a7e7a5d-c80e-427f-96fe-92670978d8ee,network=Network(cddd6eb8-767a-42c5-8cca-a1fe1d2eb604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a7e7a5d-c8') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:50:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a7e7a5d-c8, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:50:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:06 user nova-compute[73484]: INFO os_vif [None req-f5799194-e9ff-4edf-a425-84b3f5e2ad32 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:14:c8,bridge_name='br-int',has_traffic_filtering=True,id=3a7e7a5d-c80e-427f-96fe-92670978d8ee,network=Network(cddd6eb8-767a-42c5-8cca-a1fe1d2eb604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a7e7a5d-c8')
Aug 14 13:50:06 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-f5799194-e9ff-4edf-a425-84b3f5e2ad32 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Deleting instance files /opt/stack/data/nova/instances/2545f107-974a-4ee8-ba9b-7d7f7bb1ae91_del
Aug 14 13:50:06 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-f5799194-e9ff-4edf-a425-84b3f5e2ad32 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Deletion of /opt/stack/data/nova/instances/2545f107-974a-4ee8-ba9b-7d7f7bb1ae91_del complete
Aug 14 13:50:06 user nova-compute[73484]: INFO nova.compute.manager [None req-f5799194-e9ff-4edf-a425-84b3f5e2ad32 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 14 13:50:06 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-f5799194-e9ff-4edf-a425-84b3f5e2ad32 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:50:06 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:50:06 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:50:07 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:50:07 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Took 1.28 seconds to deallocate network for instance.
Aug 14 13:50:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f5799194-e9ff-4edf-a425-84b3f5e2ad32 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f5799194-e9ff-4edf-a425-84b3f5e2ad32 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:07 user nova-compute[73484]: DEBUG nova.compute.manager [req-0826dc8c-028f-47ba-a186-9e9234b3e95a req-e1befaa3-8617-4400-bc9f-ee0fe44aab1f service nova] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Received event network-vif-plugged-3a7e7a5d-c80e-427f-96fe-92670978d8ee {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:50:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0826dc8c-028f-47ba-a186-9e9234b3e95a req-e1befaa3-8617-4400-bc9f-ee0fe44aab1f service nova] Acquiring lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0826dc8c-028f-47ba-a186-9e9234b3e95a req-e1befaa3-8617-4400-bc9f-ee0fe44aab1f service nova] Lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0826dc8c-028f-47ba-a186-9e9234b3e95a req-e1befaa3-8617-4400-bc9f-ee0fe44aab1f service nova] Lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:07 user nova-compute[73484]: DEBUG nova.compute.manager [req-0826dc8c-028f-47ba-a186-9e9234b3e95a req-e1befaa3-8617-4400-bc9f-ee0fe44aab1f service nova] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] No waiting events found dispatching network-vif-plugged-3a7e7a5d-c80e-427f-96fe-92670978d8ee {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:50:07 user nova-compute[73484]: WARNING nova.compute.manager [req-0826dc8c-028f-47ba-a186-9e9234b3e95a req-e1befaa3-8617-4400-bc9f-ee0fe44aab1f service nova] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Received unexpected event network-vif-plugged-3a7e7a5d-c80e-427f-96fe-92670978d8ee for instance with vm_state deleted and task_state None.
Aug 14 13:50:07 user nova-compute[73484]: DEBUG nova.compute.manager [req-0826dc8c-028f-47ba-a186-9e9234b3e95a req-e1befaa3-8617-4400-bc9f-ee0fe44aab1f service nova] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Received event network-vif-deleted-3a7e7a5d-c80e-427f-96fe-92670978d8ee {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:50:07 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-f5799194-e9ff-4edf-a425-84b3f5e2ad32 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:50:08 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-f5799194-e9ff-4edf-a425-84b3f5e2ad32 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:50:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f5799194-e9ff-4edf-a425-84b3f5e2ad32 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:08 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-f5799194-e9ff-4edf-a425-84b3f5e2ad32 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Deleted allocations for instance 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91
Aug 14 13:50:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f5799194-e9ff-4edf-a425-84b3f5e2ad32 tempest-AttachVolumeTestJSON-852428779 tempest-AttachVolumeTestJSON-852428779-project-member] Lock "2545f107-974a-4ee8-ba9b-7d7f7bb1ae91" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.006s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:10 user nova-compute[73484]: INFO nova.compute.manager [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Rescuing
Aug 14 13:50:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "refresh_cache-782c6142-757a-49ae-9292-787a7f1e8a23" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:50:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquired lock "refresh_cache-782c6142-757a-49ae-9292-787a7f1e8a23" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:50:10 user nova-compute[73484]: DEBUG nova.network.neutron [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:50:10 user nova-compute[73484]: DEBUG nova.network.neutron [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Updating instance_info_cache with network_info: [{"id": "2246e004-4f6b-449d-91b2-8e67b4f51006", "address": "fa:16:3e:31:2a:06", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2246e004-4f", "ovs_interfaceid": "2246e004-4f6b-449d-91b2-8e67b4f51006", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:50:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Releasing lock "refresh_cache-782c6142-757a-49ae-9292-787a7f1e8a23" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:50:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG nova.compute.manager [req-adf87fae-5b12-4d3e-b6a0-ec6b37e182d9 req-aea8e557-c9d4-4585-b687-34ab8e6ab71a service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Received event network-vif-unplugged-2246e004-4f6b-449d-91b2-8e67b4f51006 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-adf87fae-5b12-4d3e-b6a0-ec6b37e182d9 req-aea8e557-c9d4-4585-b687-34ab8e6ab71a service nova] Acquiring lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-adf87fae-5b12-4d3e-b6a0-ec6b37e182d9 req-aea8e557-c9d4-4585-b687-34ab8e6ab71a service nova] Lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-adf87fae-5b12-4d3e-b6a0-ec6b37e182d9 req-aea8e557-c9d4-4585-b687-34ab8e6ab71a service nova] Lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG nova.compute.manager [req-adf87fae-5b12-4d3e-b6a0-ec6b37e182d9 req-aea8e557-c9d4-4585-b687-34ab8e6ab71a service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] No waiting events found dispatching network-vif-unplugged-2246e004-4f6b-449d-91b2-8e67b4f51006 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:50:11 user nova-compute[73484]: WARNING nova.compute.manager [req-adf87fae-5b12-4d3e-b6a0-ec6b37e182d9 req-aea8e557-c9d4-4585-b687-34ab8e6ab71a service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Received unexpected event network-vif-unplugged-2246e004-4f6b-449d-91b2-8e67b4f51006 for instance with vm_state active and task_state rescuing.
Aug 14 13:50:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:11 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Instance destroyed successfully.
Aug 14 13:50:11 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Attempting rescue
Aug 14 13:50:11 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73484) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Instance directory exists: not creating {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 13:50:11 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Creating image(s)
Aug 14 13:50:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "/opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "/opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "/opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG nova.objects.instance [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'trusted_certs' on Instance uuid 782c6142-757a-49ae-9292-787a7f1e8a23 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.177s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk.rescue {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk.rescue" returned: 0 in 0.049s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG nova.objects.instance [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'migration_context' on Instance uuid 782c6142-757a-49ae-9292-787a7f1e8a23 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Start _get_guest_xml network_info=[{"id": "2246e004-4f6b-449d-91b2-8e67b4f51006", "address": "fa:16:3e:31:2a:06", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "vif_mac": "fa:16:3e:31:2a:06"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2246e004-4f", "ovs_interfaceid": "2246e004-4f6b-449d-91b2-8e67b4f51006", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '35547d66-318f-468f-9286-e10554f69bf8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG nova.objects.instance [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'resources' on Instance uuid 782c6142-757a-49ae-9292-787a7f1e8a23 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG nova.objects.instance [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'numa_topology' on Instance uuid 782c6142-757a-49ae-9292-787a7f1e8a23 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:50:11 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:50:11 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:50:11 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG nova.objects.instance [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'vcpu_model' on Instance uuid 782c6142-757a-49ae-9292-787a7f1e8a23 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:45:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-260357687',display_name='tempest-ServerRescueNegativeTestJSON-server-260357687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-260357687',id=24,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:45:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f4df46bcfb843b7ac6c17d106703950',ramdisk_id='',reservation_id='r-07yebak7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-496474583',owner_user_name='tempest-ServerRescueNegativeTestJSON-496474583-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:45:34Z,user_data=None,user_id='45d86b9371024e3d95ece74ccb2c37d9',uuid=782c6142-757a-49ae-9292-787a7f1e8a23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2246e004-4f6b-449d-91b2-8e67b4f51006", "address": "fa:16:3e:31:2a:06", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "vif_mac": "fa:16:3e:31:2a:06"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2246e004-4f", "ovs_interfaceid": "2246e004-4f6b-449d-91b2-8e67b4f51006", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Converting VIF {"id": "2246e004-4f6b-449d-91b2-8e67b4f51006", "address": "fa:16:3e:31:2a:06", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "vif_mac": "fa:16:3e:31:2a:06"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2246e004-4f", "ovs_interfaceid": "2246e004-4f6b-449d-91b2-8e67b4f51006", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:2a:06,bridge_name='br-int',has_traffic_filtering=True,id=2246e004-4f6b-449d-91b2-8e67b4f51006,network=Network(cad53782-5ecf-4140-b113-62e807bf87df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2246e004-4f') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:50:11 user nova-compute[73484]: DEBUG nova.objects.instance [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'pci_devices' on Instance uuid 782c6142-757a-49ae-9292-787a7f1e8a23 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:50:12 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:50:12 user nova-compute[73484]:   <uuid>782c6142-757a-49ae-9292-787a7f1e8a23</uuid>
Aug 14 13:50:12 user nova-compute[73484]:   <name>instance-00000018</name>
Aug 14 13:50:12 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:50:12 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:50:12 user nova-compute[73484]:   <metadata>
Aug 14 13:50:12 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:50:12 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:50:12 user nova-compute[73484]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-260357687</nova:name>
Aug 14 13:50:12 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:50:11</nova:creationTime>
Aug 14 13:50:12 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:50:12 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:50:12 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:50:12 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:50:12 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:50:12 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:50:12 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:50:12 user nova-compute[73484]:       <nova:owner>
Aug 14 13:50:12 user nova-compute[73484]:         <nova:user uuid="45d86b9371024e3d95ece74ccb2c37d9">tempest-ServerRescueNegativeTestJSON-496474583-project-member</nova:user>
Aug 14 13:50:12 user nova-compute[73484]:         <nova:project uuid="0f4df46bcfb843b7ac6c17d106703950">tempest-ServerRescueNegativeTestJSON-496474583</nova:project>
Aug 14 13:50:12 user nova-compute[73484]:       </nova:owner>
Aug 14 13:50:12 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:50:12 user nova-compute[73484]:       <nova:ports>
Aug 14 13:50:12 user nova-compute[73484]:         <nova:port uuid="2246e004-4f6b-449d-91b2-8e67b4f51006">
Aug 14 13:50:12 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 13:50:12 user nova-compute[73484]:         </nova:port>
Aug 14 13:50:12 user nova-compute[73484]:       </nova:ports>
Aug 14 13:50:12 user nova-compute[73484]:     </nova:instance>
Aug 14 13:50:12 user nova-compute[73484]:   </metadata>
Aug 14 13:50:12 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:50:12 user nova-compute[73484]:     <system>
Aug 14 13:50:12 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:50:12 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:50:12 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:50:12 user nova-compute[73484]:       <entry name="serial">782c6142-757a-49ae-9292-787a7f1e8a23</entry>
Aug 14 13:50:12 user nova-compute[73484]:       <entry name="uuid">782c6142-757a-49ae-9292-787a7f1e8a23</entry>
Aug 14 13:50:12 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:50:12 user nova-compute[73484]:     </system>
Aug 14 13:50:12 user nova-compute[73484]:   </sysinfo>
Aug 14 13:50:12 user nova-compute[73484]:   <os>
Aug 14 13:50:12 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:50:12 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:50:12 user nova-compute[73484]:   </os>
Aug 14 13:50:12 user nova-compute[73484]:   <features>
Aug 14 13:50:12 user nova-compute[73484]:     <acpi/>
Aug 14 13:50:12 user nova-compute[73484]:     <apic/>
Aug 14 13:50:12 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:50:12 user nova-compute[73484]:   </features>
Aug 14 13:50:12 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:50:12 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:50:12 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:50:12 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:50:12 user nova-compute[73484]:   </clock>
Aug 14 13:50:12 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:50:12 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:50:12 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:50:12 user nova-compute[73484]:   </cpu>
Aug 14 13:50:12 user nova-compute[73484]:   <devices>
Aug 14 13:50:12 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:50:12 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:50:12 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk.rescue"/>
Aug 14 13:50:12 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:50:12 user nova-compute[73484]:     </disk>
Aug 14 13:50:12 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:50:12 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:50:12 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk"/>
Aug 14 13:50:12 user nova-compute[73484]:       <target dev="vdb" bus="virtio"/>
Aug 14 13:50:12 user nova-compute[73484]:     </disk>
Aug 14 13:50:12 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:50:12 user nova-compute[73484]:       <mac address="fa:16:3e:31:2a:06"/>
Aug 14 13:50:12 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:50:12 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:50:12 user nova-compute[73484]:       <target dev="tap2246e004-4f"/>
Aug 14 13:50:12 user nova-compute[73484]:     </interface>
Aug 14 13:50:12 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:50:12 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/console.log" append="off"/>
Aug 14 13:50:12 user nova-compute[73484]:     </serial>
Aug 14 13:50:12 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:50:12 user nova-compute[73484]:     <video>
Aug 14 13:50:12 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:50:12 user nova-compute[73484]:     </video>
Aug 14 13:50:12 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:50:12 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:50:12 user nova-compute[73484]:     </rng>
Aug 14 13:50:12 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:50:12 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:50:12 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:50:12 user nova-compute[73484]:     </memballoon>
Aug 14 13:50:12 user nova-compute[73484]:   </devices>
Aug 14 13:50:12 user nova-compute[73484]: </domain>
Aug 14 13:50:12 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:50:12 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Instance destroyed successfully.
Aug 14 13:50:12 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:50:12 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:50:12 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] No VIF found with MAC fa:16:3e:31:2a:06, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:50:12 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692020997.4045408, bd43e3a9-0413-4e55-b6a1-7f3f792ba872 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:50:12 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] VM Stopped (Lifecycle Event)
Aug 14 13:50:12 user nova-compute[73484]: DEBUG nova.compute.manager [None req-794778a4-e672-4be5-9a95-393c23d38cb5 None None] [instance: bd43e3a9-0413-4e55-b6a1-7f3f792ba872] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:50:12 user nova-compute[73484]: INFO nova.compute.manager [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Rescuing
Aug 14 13:50:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "refresh_cache-b43ccb18-6d2d-43f2-a185-bb558d5d6f45" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:50:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquired lock "refresh_cache-b43ccb18-6d2d-43f2-a185-bb558d5d6f45" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:50:12 user nova-compute[73484]: DEBUG nova.network.neutron [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:50:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Acquiring lock "a54902a5-df8a-473f-9cf1-a112528c3549" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "a54902a5-df8a-473f-9cf1-a112528c3549" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:12 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:50:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:12 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:50:12 user nova-compute[73484]: INFO nova.compute.claims [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Claim successful on node user
Aug 14 13:50:13 user nova-compute[73484]: DEBUG nova.network.neutron [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Updating instance_info_cache with network_info: [{"id": "ea301764-93d8-4c55-a51f-5e50918be405", "address": "fa:16:3e:ff:7c:5c", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea301764-93", "ovs_interfaceid": "ea301764-93d8-4c55-a51f-5e50918be405", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:50:13 user nova-compute[73484]: DEBUG nova.compute.manager [req-b6b6054a-6b4b-4eb0-b3cb-c5b754f2a565 req-842e06cd-1a9d-4da8-8461-8913dcb7499a service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Received event network-vif-plugged-2246e004-4f6b-449d-91b2-8e67b4f51006 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:50:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b6b6054a-6b4b-4eb0-b3cb-c5b754f2a565 req-842e06cd-1a9d-4da8-8461-8913dcb7499a service nova] Acquiring lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b6b6054a-6b4b-4eb0-b3cb-c5b754f2a565 req-842e06cd-1a9d-4da8-8461-8913dcb7499a service nova] Lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b6b6054a-6b4b-4eb0-b3cb-c5b754f2a565 req-842e06cd-1a9d-4da8-8461-8913dcb7499a service nova] Lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:13 user nova-compute[73484]: DEBUG nova.compute.manager [req-b6b6054a-6b4b-4eb0-b3cb-c5b754f2a565 req-842e06cd-1a9d-4da8-8461-8913dcb7499a service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] No waiting events found dispatching network-vif-plugged-2246e004-4f6b-449d-91b2-8e67b4f51006 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:50:13 user nova-compute[73484]: WARNING nova.compute.manager [req-b6b6054a-6b4b-4eb0-b3cb-c5b754f2a565 req-842e06cd-1a9d-4da8-8461-8913dcb7499a service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Received unexpected event network-vif-plugged-2246e004-4f6b-449d-91b2-8e67b4f51006 for instance with vm_state active and task_state rescuing.
Aug 14 13:50:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Releasing lock "refresh_cache-b43ccb18-6d2d-43f2-a185-bb558d5d6f45" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:50:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:13 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:50:13 user nova-compute[73484]: DEBUG nova.compute.manager [req-37156d58-787e-4802-88ef-1ed41ee8a02a req-c71dfee2-0aa6-465a-b969-485ece5c9688 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Received event network-vif-unplugged-ea301764-93d8-4c55-a51f-5e50918be405 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:50:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-37156d58-787e-4802-88ef-1ed41ee8a02a req-c71dfee2-0aa6-465a-b969-485ece5c9688 service nova] Acquiring lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-37156d58-787e-4802-88ef-1ed41ee8a02a req-c71dfee2-0aa6-465a-b969-485ece5c9688 service nova] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-37156d58-787e-4802-88ef-1ed41ee8a02a req-c71dfee2-0aa6-465a-b969-485ece5c9688 service nova] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:13 user nova-compute[73484]: DEBUG nova.compute.manager [req-37156d58-787e-4802-88ef-1ed41ee8a02a req-c71dfee2-0aa6-465a-b969-485ece5c9688 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] No waiting events found dispatching network-vif-unplugged-ea301764-93d8-4c55-a51f-5e50918be405 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:50:13 user nova-compute[73484]: WARNING nova.compute.manager [req-37156d58-787e-4802-88ef-1ed41ee8a02a req-c71dfee2-0aa6-465a-b969-485ece5c9688 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Received unexpected event network-vif-unplugged-ea301764-93d8-4c55-a51f-5e50918be405 for instance with vm_state active and task_state rescuing.
Aug 14 13:50:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:13 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:50:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.890s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:13 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:50:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:13 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:50:13 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:50:13 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:50:13 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:50:14 user nova-compute[73484]: INFO nova.virt.block_device [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Booting with volume 5e55bf6f-36bb-45c9-84fe-491435460475 at /dev/vda
Aug 14 13:50:14 user nova-compute[73484]: DEBUG os_brick.utils [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:50:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:14 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c131442a-8a26-494c-b8a6-add44adc6e67]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:14 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d119712-f73e-4d2a-b998-f5c8d6a6d725]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:14 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a525d5b1-e3c0-4d70-bfe6-0b68ff0e3669]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:14 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb185818-23fc-4b12-8033-4ca40e2853c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:50:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:50:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:50:14 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:50:14 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ce3553-19ed-415c-8b83-36aa9fbb084f]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:14 user nova-compute[73484]: DEBUG nova.policy [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c8d4d6031b59481d93c22075f19559b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844799698ad34e19ba511a302ffa57a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:50:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:50:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:50:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:50:14 user nova-compute[73484]: DEBUG os_brick.utils [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:50:14 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Updating existing volume attachment record: 47611f7e-d99d-44c4-9b43-77263c657204 {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:50:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:14 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Instance destroyed successfully.
Aug 14 13:50:14 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Attempting a stable device rescue
Aug 14 13:50:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73484) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 13:50:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Instance directory exists: not creating {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 13:50:14 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Creating image(s)
Aug 14 13:50:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "/opt/stack/data/nova/instances/b43ccb18-6d2d-43f2-a185-bb558d5d6f45/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "/opt/stack/data/nova/instances/b43ccb18-6d2d-43f2-a185-bb558d5d6f45/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "/opt/stack/data/nova/instances/b43ccb18-6d2d-43f2-a185-bb558d5d6f45/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:14 user nova-compute[73484]: DEBUG nova.objects.instance [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lazy-loading 'trusted_certs' on Instance uuid b43ccb18-6d2d-43f2-a185-bb558d5d6f45 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:50:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "71a296ca4ee1b8d26f23cc885592131c9e00518c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "71a296ca4ee1b8d26f23cc885592131c9e00518c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71a296ca4ee1b8d26f23cc885592131c9e00518c.part --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:15 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Successfully created port: ef1b13c3-d3e6-492e-8082-b5939545f189 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:50:15 user nova-compute[73484]: DEBUG nova.compute.manager [req-102d1f89-2535-4b03-9a6a-143b92542750 req-b76b8044-9bf2-42f0-adf1-77ece920f483 service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Received event network-vif-plugged-2246e004-4f6b-449d-91b2-8e67b4f51006 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:50:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-102d1f89-2535-4b03-9a6a-143b92542750 req-b76b8044-9bf2-42f0-adf1-77ece920f483 service nova] Acquiring lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-102d1f89-2535-4b03-9a6a-143b92542750 req-b76b8044-9bf2-42f0-adf1-77ece920f483 service nova] Lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-102d1f89-2535-4b03-9a6a-143b92542750 req-b76b8044-9bf2-42f0-adf1-77ece920f483 service nova] Lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:15 user nova-compute[73484]: DEBUG nova.compute.manager [req-102d1f89-2535-4b03-9a6a-143b92542750 req-b76b8044-9bf2-42f0-adf1-77ece920f483 service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] No waiting events found dispatching network-vif-plugged-2246e004-4f6b-449d-91b2-8e67b4f51006 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:50:15 user nova-compute[73484]: WARNING nova.compute.manager [req-102d1f89-2535-4b03-9a6a-143b92542750 req-b76b8044-9bf2-42f0-adf1-77ece920f483 service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Received unexpected event network-vif-plugged-2246e004-4f6b-449d-91b2-8e67b4f51006 for instance with vm_state active and task_state rescuing.
Aug 14 13:50:15 user nova-compute[73484]: DEBUG nova.compute.manager [req-102d1f89-2535-4b03-9a6a-143b92542750 req-b76b8044-9bf2-42f0-adf1-77ece920f483 service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Received event network-vif-plugged-2246e004-4f6b-449d-91b2-8e67b4f51006 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:50:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-102d1f89-2535-4b03-9a6a-143b92542750 req-b76b8044-9bf2-42f0-adf1-77ece920f483 service nova] Acquiring lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-102d1f89-2535-4b03-9a6a-143b92542750 req-b76b8044-9bf2-42f0-adf1-77ece920f483 service nova] Lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-102d1f89-2535-4b03-9a6a-143b92542750 req-b76b8044-9bf2-42f0-adf1-77ece920f483 service nova] Lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:15 user nova-compute[73484]: DEBUG nova.compute.manager [req-102d1f89-2535-4b03-9a6a-143b92542750 req-b76b8044-9bf2-42f0-adf1-77ece920f483 service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] No waiting events found dispatching network-vif-plugged-2246e004-4f6b-449d-91b2-8e67b4f51006 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:50:15 user nova-compute[73484]: WARNING nova.compute.manager [req-102d1f89-2535-4b03-9a6a-143b92542750 req-b76b8044-9bf2-42f0-adf1-77ece920f483 service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Received unexpected event network-vif-plugged-2246e004-4f6b-449d-91b2-8e67b4f51006 for instance with vm_state active and task_state rescuing.
Aug 14 13:50:15 user nova-compute[73484]: DEBUG nova.compute.manager [req-2af0b5da-8675-41d7-a70c-32f5b815cde1 req-e387c771-0e70-4013-8b81-6615c25e2e68 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Received event network-vif-plugged-ea301764-93d8-4c55-a51f-5e50918be405 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:50:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2af0b5da-8675-41d7-a70c-32f5b815cde1 req-e387c771-0e70-4013-8b81-6615c25e2e68 service nova] Acquiring lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2af0b5da-8675-41d7-a70c-32f5b815cde1 req-e387c771-0e70-4013-8b81-6615c25e2e68 service nova] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2af0b5da-8675-41d7-a70c-32f5b815cde1 req-e387c771-0e70-4013-8b81-6615c25e2e68 service nova] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:15 user nova-compute[73484]: DEBUG nova.compute.manager [req-2af0b5da-8675-41d7-a70c-32f5b815cde1 req-e387c771-0e70-4013-8b81-6615c25e2e68 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] No waiting events found dispatching network-vif-plugged-ea301764-93d8-4c55-a51f-5e50918be405 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:50:15 user nova-compute[73484]: WARNING nova.compute.manager [req-2af0b5da-8675-41d7-a70c-32f5b815cde1 req-e387c771-0e70-4013-8b81-6615c25e2e68 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Received unexpected event network-vif-plugged-ea301764-93d8-4c55-a51f-5e50918be405 for instance with vm_state active and task_state rescuing.
Aug 14 13:50:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71a296ca4ee1b8d26f23cc885592131c9e00518c.part --force-share --output=json" returned: 0 in 0.183s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:15 user nova-compute[73484]: DEBUG nova.virt.images [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] fd661ba6-a260-4ec9-8d40-dcd242adf732 was qcow2, converting to raw {{(pid=73484) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 13:50:15 user nova-compute[73484]: DEBUG nova.privsep.utils [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73484) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 13:50:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/71a296ca4ee1b8d26f23cc885592131c9e00518c.part /opt/stack/data/nova/instances/_base/71a296ca4ee1b8d26f23cc885592131c9e00518c.converted {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/71a296ca4ee1b8d26f23cc885592131c9e00518c.part /opt/stack/data/nova/instances/_base/71a296ca4ee1b8d26f23cc885592131c9e00518c.converted" returned: 0 in 0.492s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71a296ca4ee1b8d26f23cc885592131c9e00518c.converted --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71a296ca4ee1b8d26f23cc885592131c9e00518c.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "71a296ca4ee1b8d26f23cc885592131c9e00518c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.141s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "71a296ca4ee1b8d26f23cc885592131c9e00518c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "71a296ca4ee1b8d26f23cc885592131c9e00518c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71a296ca4ee1b8d26f23cc885592131c9e00518c --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Successfully updated port: ef1b13c3-d3e6-492e-8082-b5939545f189 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Acquiring lock "refresh_cache-a54902a5-df8a-473f-9cf1-a112528c3549" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Acquired lock "refresh_cache-a54902a5-df8a-473f-9cf1-a112528c3549" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71a296ca4ee1b8d26f23cc885592131c9e00518c --force-share --output=json" returned: 0 in 0.197s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71a296ca4ee1b8d26f23cc885592131c9e00518c,backing_fmt=raw /opt/stack/data/nova/instances/b43ccb18-6d2d-43f2-a185-bb558d5d6f45/disk.rescue {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Removed pending event for 782c6142-757a-49ae-9292-787a7f1e8a23 due to event {{(pid=73484) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021016.8093214, 782c6142-757a-49ae-9292-787a7f1e8a23 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:50:16 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] VM Resumed (Lifecycle Event)
Aug 14 13:50:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71a296ca4ee1b8d26f23cc885592131c9e00518c,backing_fmt=raw /opt/stack/data/nova/instances/b43ccb18-6d2d-43f2-a185-bb558d5d6f45/disk.rescue" returned: 0 in 0.062s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "71a296ca4ee1b8d26f23cc885592131c9e00518c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.objects.instance [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lazy-loading 'migration_context' on Instance uuid b43ccb18-6d2d-43f2-a185-bb558d5d6f45 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.compute.manager [None req-bac7f491-c82e-43d5-813e-ce516e5c60b5 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Start _get_guest_xml network_info=[{"id": "ea301764-93d8-4c55-a51f-5e50918be405", "address": "fa:16:3e:ff:7c:5c", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "vif_mac": "fa:16:3e:ff:7c:5c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea301764-93", "ovs_interfaceid": "ea301764-93d8-4c55-a51f-5e50918be405", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fd661ba6-a260-4ec9-8d40-dcd242adf732', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'fceddf5d-7872-4d0a-b02d-4daee70df0dd', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikJcqojh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'b43ccb18-6d2d-43f2-a185-bb558d5d6f45', 'attached_at': '', 'detached_at': '', 'volume_id': '15530639-5fd1-464f-895c-1db1b454c158', 'serial': '15530639-5fd1-464f-895c-1db1b454c158'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.objects.instance [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lazy-loading 'resources' on Instance uuid b43ccb18-6d2d-43f2-a185-bb558d5d6f45 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.objects.instance [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lazy-loading 'numa_topology' on Instance uuid b43ccb18-6d2d-43f2-a185-bb558d5d6f45 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:50:16 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021016.8109145, 782c6142-757a-49ae-9292-787a7f1e8a23 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:50:16 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] VM Started (Lifecycle Event)
Aug 14 13:50:16 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:50:16 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.objects.instance [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lazy-loading 'vcpu_model' on Instance uuid b43ccb18-6d2d-43f2-a185-bb558d5d6f45 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikJcqojh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:50:16 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:50:16 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:50:16 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:50:16 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:50:16 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:50:16 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:50:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f984ee92-81df-45ae-aac6-a6181ef1e21c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ikJcqojh\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 14 13:50:17 user nova-compute[73484]: node.name = iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158
Aug 14 13:50:17 user nova-compute[73484]: node.tpgt = -1
Aug 14 13:50:17 user nova-compute[73484]: node.startup = automatic
Aug 14 13:50:17 user nova-compute[73484]: node.leading_login = No
Aug 14 13:50:17 user nova-compute[73484]: iface.iscsi_ifacename = default
Aug 14 13:50:17 user nova-compute[73484]: iface.net_ifacename = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.ipaddress = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.prefix_len = 0
Aug 14 13:50:17 user nova-compute[73484]: iface.hwaddress = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.transport_name = tcp
Aug 14 13:50:17 user nova-compute[73484]: iface.initiatorname = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.state = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.vlan_id = 0
Aug 14 13:50:17 user nova-compute[73484]: iface.vlan_priority = 0
Aug 14 13:50:17 user nova-compute[73484]: iface.vlan_state = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.iface_num = 0
Aug 14 13:50:17 user nova-compute[73484]: iface.mtu = 0
Aug 14 13:50:17 user nova-compute[73484]: iface.port = 0
Aug 14 13:50:17 user nova-compute[73484]: iface.bootproto = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.subnet_mask = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.gateway = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.dhcp_alt_client_id_state = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.dhcp_alt_client_id = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.dhcp_dns = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.dhcp_learn_iqn = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.dhcp_req_vendor_id_state = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.dhcp_vendor_id_state = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.dhcp_vendor_id = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.dhcp_slp_da = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.fragmentation = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.gratuitous_arp = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.incoming_forwarding = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.tos_state = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.tos = 0
Aug 14 13:50:17 user nova-compute[73484]: iface.ttl = 0
Aug 14 13:50:17 user nova-compute[73484]: iface.delayed_ack = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.tcp_nagle = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.tcp_wsf_state = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.tcp_wsf = 0
Aug 14 13:50:17 user nova-compute[73484]: iface.tcp_timer_scale = 0
Aug 14 13:50:17 user nova-compute[73484]: iface.tcp_timestamp = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.redirect = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.def_task_mgmt_timeout = 0
Aug 14 13:50:17 user nova-compute[73484]: iface.header_digest = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.data_digest = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.immediate_data = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.initial_r2t = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.data_seq_inorder = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.data_pdu_inorder = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.erl = 0
Aug 14 13:50:17 user nova-compute[73484]: iface.max_receive_data_len = 0
Aug 14 13:50:17 user nova-compute[73484]: iface.first_burst_len = 0
Aug 14 13:50:17 user nova-compute[73484]: iface.max_outstanding_r2t = 0
Aug 14 13:50:17 user nova-compute[73484]: iface.max_burst_len = 0
Aug 14 13:50:17 user nova-compute[73484]: iface.chap_auth = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.bidi_chap = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.strict_login_compliance = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.discovery_auth = <empty>
Aug 14 13:50:17 user nova-compute[73484]: iface.discovery_logout = <empty>
Aug 14 13:50:17 user nova-compute[73484]: node.discovery_address = <empty>
Aug 14 13:50:17 user nova-compute[73484]: node.discovery_port = 0
Aug 14 13:50:17 user nova-compute[73484]: node.discovery_type = static
Aug 14 13:50:17 user nova-compute[73484]: node.session.initial_cmdsn = 0
Aug 14 13:50:17 user nova-compute[73484]: node.session.initial_login_retry_max = 8
Aug 14 13:50:17 user nova-compute[73484]: node.session.xmit_thread_priority = -20
Aug 14 13:50:17 user nova-compute[73484]: node.session.cmds_max = 128
Aug 14 13:50:17 user nova-compute[73484]: node.session.queue_depth = 32
Aug 14 13:50:17 user nova-compute[73484]: node.session.nr_sessions = 1
Aug 14 13:50:17 user nova-compute[73484]: node.session.auth.authmethod = CHAP
Aug 14 13:50:17 user nova-compute[73484]: node.session.auth.username = ikJcqojh
Aug 14 13:50:17 user nova-compute[73484]: node.session.auth.password = ***
Aug 14 13:50:17 user nova-compute[73484]: node.session.auth.username_in = <empty>
Aug 14 13:50:17 user nova-compute[73484]: node.session.auth.password_in = <empty>
Aug 14 13:50:17 user nova-compute[73484]: node.session.auth.chap_algs = MD5
Aug 14 13:50:17 user nova-compute[73484]: node.session.timeo.replacement_timeout = 120
Aug 14 13:50:17 user nova-compute[73484]: node.session.err_timeo.abort_timeout = 15
Aug 14 13:50:17 user nova-compute[73484]: node.session.err_timeo.lu_reset_timeout = 30
Aug 14 13:50:17 user nova-compute[73484]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 14 13:50:17 user nova-compute[73484]: node.session.err_timeo.host_reset_timeout = 60
Aug 14 13:50:17 user nova-compute[73484]: node.session.iscsi.FastAbort = Yes
Aug 14 13:50:17 user nova-compute[73484]: node.session.iscsi.InitialR2T = No
Aug 14 13:50:17 user nova-compute[73484]: node.session.iscsi.ImmediateData = Yes
Aug 14 13:50:17 user nova-compute[73484]: node.session.iscsi.FirstBurstLength = 262144
Aug 14 13:50:17 user nova-compute[73484]: node.session.iscsi.MaxBurstLength = 16776192
Aug 14 13:50:17 user nova-compute[73484]: node.session.iscsi.DefaultTime2Retain = 0
Aug 14 13:50:17 user nova-compute[73484]: node.session.iscsi.DefaultTime2Wait = 2
Aug 14 13:50:17 user nova-compute[73484]: node.session.iscsi.MaxConnections = 1
Aug 14 13:50:17 user nova-compute[73484]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 14 13:50:17 user nova-compute[73484]: node.session.iscsi.ERL = 0
Aug 14 13:50:17 user nova-compute[73484]: node.session.scan = manual
Aug 14 13:50:17 user nova-compute[73484]: node.session.reopen_max = 0
Aug 14 13:50:17 user nova-compute[73484]: node.conn[0].address = 172.16.0.220
Aug 14 13:50:17 user nova-compute[73484]: node.conn[0].port = 3260
Aug 14 13:50:17 user nova-compute[73484]: node.conn[0].startup = manual
Aug 14 13:50:17 user nova-compute[73484]: node.conn[0].tcp.window_size = 524288
Aug 14 13:50:17 user nova-compute[73484]: node.conn[0].tcp.type_of_service = 0
Aug 14 13:50:17 user nova-compute[73484]: node.conn[0].timeo.logout_timeout = 15
Aug 14 13:50:17 user nova-compute[73484]: node.conn[0].timeo.login_timeout = 15
Aug 14 13:50:17 user nova-compute[73484]: node.conn[0].timeo.auth_timeout = 45
Aug 14 13:50:17 user nova-compute[73484]: node.conn[0].timeo.noop_out_interval = 5
Aug 14 13:50:17 user nova-compute[73484]: node.conn[0].timeo.noop_out_timeout = 5
Aug 14 13:50:17 user nova-compute[73484]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 14 13:50:17 user nova-compute[73484]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 14 13:50:17 user nova-compute[73484]: node.conn[0].iscsi.HeaderDigest = None
Aug 14 13:50:17 user nova-compute[73484]: node.conn[0].iscsi.DataDigest = None
Aug 14 13:50:17 user nova-compute[73484]: node.conn[0].iscsi.IFMarker = No
Aug 14 13:50:17 user nova-compute[73484]: node.conn[0].iscsi.OFMarker = No
Aug 14 13:50:17 user nova-compute[73484]: # END RECORD
Aug 14 13:50:17 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee81ca3-dd91-4f88-bc53-8f62bfcefbbd]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c7b615-d373-4387-aca6-902723625f5e]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Updating instance_info_cache with network_info: [{"id": "ef1b13c3-d3e6-492e-8082-b5939545f189", "address": "fa:16:3e:25:ba:8c", "network": {"id": "83e56acf-b902-47d4-8e67-89dd64cb110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773957043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844799698ad34e19ba511a302ffa57a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1b13c3-d3", "ovs_interfaceid": "ef1b13c3-d3e6-492e-8082-b5939545f189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ikJcqojh {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Releasing lock "refresh_cache-a54902a5-df8a-473f-9cf1-a112528c3549" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Instance network_info: |[{"id": "ef1b13c3-d3e6-492e-8082-b5939545f189", "address": "fa:16:3e:25:ba:8c", "network": {"id": "83e56acf-b902-47d4-8e67-89dd64cb110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773957043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844799698ad34e19ba511a302ffa57a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1b13c3-d3", "ovs_interfaceid": "ef1b13c3-d3e6-492e-8082-b5939545f189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ikJcqojh" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[510841a7-c47b-4d07-9890-5360ce514caf]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ikJcqojh'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b783a0-b16a-4b32-9dfe-81308ea3da8d]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG nova.compute.manager [req-c2e1267a-83ae-4e27-ab2a-d27db2d8c1b7 req-5a36c0b8-52d1-42ea-9050-4377da05acbc service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Received event network-changed-ef1b13c3-d3e6-492e-8082-b5939545f189 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG nova.compute.manager [req-c2e1267a-83ae-4e27-ab2a-d27db2d8c1b7 req-5a36c0b8-52d1-42ea-9050-4377da05acbc service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Refreshing instance network info cache due to event network-changed-ef1b13c3-d3e6-492e-8082-b5939545f189. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c2e1267a-83ae-4e27-ab2a-d27db2d8c1b7 req-5a36c0b8-52d1-42ea-9050-4377da05acbc service nova] Acquiring lock "refresh_cache-a54902a5-df8a-473f-9cf1-a112528c3549" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c2e1267a-83ae-4e27-ab2a-d27db2d8c1b7 req-5a36c0b8-52d1-42ea-9050-4377da05acbc service nova] Acquired lock "refresh_cache-a54902a5-df8a-473f-9cf1-a112528c3549" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG nova.network.neutron [req-c2e1267a-83ae-4e27-ab2a-d27db2d8c1b7 req-5a36c0b8-52d1-42ea-9050-4377da05acbc service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Refreshing network info cache for port ef1b13c3-d3e6-492e-8082-b5939545f189 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9527b89-1f8c-45a3-8cc2-eaaee6244c36]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:50:17 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:50:17 user nova-compute[73484]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:50:17 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:50:17 user nova-compute[73484]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)
Aug 14 13:50:17 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:50:17 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:50:17 user nova-compute[73484]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:50:17 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:50:17 user nova-compute[73484]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)
Aug 14 13:50:17 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.192s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] HCTL ('34', '0', '0', 0) found on session 31 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf8a67e-10cc-4439-900b-037bbe0e563e]: (4, ('0 0 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Searching for a device in session 31 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikJcqojh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.218s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] <== connect_volume: return (219ms) {'type': 'block', 'scsi_wwn': '26335356533383435', 'path': '/dev/sdc'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335356533383435', 'path': '/dev/sdc'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:48:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1059435803',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1059435803',id=28,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:48:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c7f2c51c0f84bf1aedcf493a9ff860f',ramdisk_id='',reservation_id='r-0us4hfk6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-830908511',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:48:48Z,user_data=None,user_id='5a0f55ad018d4c0ca587d8bdd40df4c8',uuid=b43ccb18-6d2d-43f2-a185-bb558d5d6f45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea301764-93d8-4c55-a51f-5e50918be405", "address": "fa:16:3e:ff:7c:5c", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "vif_mac": "fa:16:3e:ff:7c:5c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea301764-93", "ovs_interfaceid": "ea301764-93d8-4c55-a51f-5e50918be405", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Converting VIF {"id": "ea301764-93d8-4c55-a51f-5e50918be405", "address": "fa:16:3e:ff:7c:5c", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "vif_mac": "fa:16:3e:ff:7c:5c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea301764-93", "ovs_interfaceid": "ea301764-93d8-4c55-a51f-5e50918be405", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:7c:5c,bridge_name='br-int',has_traffic_filtering=True,id=ea301764-93d8-4c55-a51f-5e50918be405,network=Network(4ec437fc-4371-48d6-8026-b64423fbc0ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea301764-93') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG nova.objects.instance [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lazy-loading 'pci_devices' on Instance uuid b43ccb18-6d2d-43f2-a185-bb558d5d6f45 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:50:17 user nova-compute[73484]:   <uuid>b43ccb18-6d2d-43f2-a185-bb558d5d6f45</uuid>
Aug 14 13:50:17 user nova-compute[73484]:   <name>instance-0000001c</name>
Aug 14 13:50:17 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:50:17 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:50:17 user nova-compute[73484]:   <metadata>
Aug 14 13:50:17 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:50:17 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:50:17 user nova-compute[73484]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1059435803</nova:name>
Aug 14 13:50:17 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:50:16</nova:creationTime>
Aug 14 13:50:17 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:50:17 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:50:17 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:50:17 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:50:17 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:50:17 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:50:17 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:50:17 user nova-compute[73484]:       <nova:owner>
Aug 14 13:50:17 user nova-compute[73484]:         <nova:user uuid="5a0f55ad018d4c0ca587d8bdd40df4c8">tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member</nova:user>
Aug 14 13:50:17 user nova-compute[73484]:         <nova:project uuid="2c7f2c51c0f84bf1aedcf493a9ff860f">tempest-ServerBootFromVolumeStableRescueTest-830908511</nova:project>
Aug 14 13:50:17 user nova-compute[73484]:       </nova:owner>
Aug 14 13:50:17 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:50:17 user nova-compute[73484]:       <nova:ports>
Aug 14 13:50:17 user nova-compute[73484]:         <nova:port uuid="ea301764-93d8-4c55-a51f-5e50918be405">
Aug 14 13:50:17 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 13:50:17 user nova-compute[73484]:         </nova:port>
Aug 14 13:50:17 user nova-compute[73484]:       </nova:ports>
Aug 14 13:50:17 user nova-compute[73484]:     </nova:instance>
Aug 14 13:50:17 user nova-compute[73484]:   </metadata>
Aug 14 13:50:17 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:50:17 user nova-compute[73484]:     <system>
Aug 14 13:50:17 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:50:17 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:50:17 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:50:17 user nova-compute[73484]:       <entry name="serial">b43ccb18-6d2d-43f2-a185-bb558d5d6f45</entry>
Aug 14 13:50:17 user nova-compute[73484]:       <entry name="uuid">b43ccb18-6d2d-43f2-a185-bb558d5d6f45</entry>
Aug 14 13:50:17 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:50:17 user nova-compute[73484]:     </system>
Aug 14 13:50:17 user nova-compute[73484]:   </sysinfo>
Aug 14 13:50:17 user nova-compute[73484]:   <os>
Aug 14 13:50:17 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:50:17 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:50:17 user nova-compute[73484]:   </os>
Aug 14 13:50:17 user nova-compute[73484]:   <features>
Aug 14 13:50:17 user nova-compute[73484]:     <acpi/>
Aug 14 13:50:17 user nova-compute[73484]:     <apic/>
Aug 14 13:50:17 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:50:17 user nova-compute[73484]:   </features>
Aug 14 13:50:17 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:50:17 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:50:17 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:50:17 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:50:17 user nova-compute[73484]:   </clock>
Aug 14 13:50:17 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:50:17 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:50:17 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:50:17 user nova-compute[73484]:   </cpu>
Aug 14 13:50:17 user nova-compute[73484]:   <devices>
Aug 14 13:50:17 user nova-compute[73484]:     <disk type="block" device="disk">
Aug 14 13:50:17 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:50:17 user nova-compute[73484]:       <source dev="/dev/sdc"/>
Aug 14 13:50:17 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:50:17 user nova-compute[73484]:       <serial>15530639-5fd1-464f-895c-1db1b454c158</serial>
Aug 14 13:50:17 user nova-compute[73484]:     </disk>
Aug 14 13:50:17 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:50:17 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:50:17 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/b43ccb18-6d2d-43f2-a185-bb558d5d6f45/disk.rescue"/>
Aug 14 13:50:17 user nova-compute[73484]:       <target dev="vdb" bus="virtio"/>
Aug 14 13:50:17 user nova-compute[73484]:       <boot order="1"/>
Aug 14 13:50:17 user nova-compute[73484]:     </disk>
Aug 14 13:50:17 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:50:17 user nova-compute[73484]:       <mac address="fa:16:3e:ff:7c:5c"/>
Aug 14 13:50:17 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:50:17 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:50:17 user nova-compute[73484]:       <target dev="tapea301764-93"/>
Aug 14 13:50:17 user nova-compute[73484]:     </interface>
Aug 14 13:50:17 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:50:17 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/b43ccb18-6d2d-43f2-a185-bb558d5d6f45/console.log" append="off"/>
Aug 14 13:50:17 user nova-compute[73484]:     </serial>
Aug 14 13:50:17 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:50:17 user nova-compute[73484]:     <video>
Aug 14 13:50:17 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:50:17 user nova-compute[73484]:     </video>
Aug 14 13:50:17 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:50:17 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:50:17 user nova-compute[73484]:     </rng>
Aug 14 13:50:17 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:50:17 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:50:17 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:50:17 user nova-compute[73484]:     </memballoon>
Aug 14 13:50:17 user nova-compute[73484]:   </devices>
Aug 14 13:50:17 user nova-compute[73484]: </domain>
Aug 14 13:50:17 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:50:17 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Instance destroyed successfully.
Aug 14 13:50:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] No VIF found with MAC fa:16:3e:ff:7c:5c, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG nova.network.neutron [req-c2e1267a-83ae-4e27-ab2a-d27db2d8c1b7 req-5a36c0b8-52d1-42ea-9050-4377da05acbc service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Updated VIF entry in instance network info cache for port ef1b13c3-d3e6-492e-8082-b5939545f189. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG nova.network.neutron [req-c2e1267a-83ae-4e27-ab2a-d27db2d8c1b7 req-5a36c0b8-52d1-42ea-9050-4377da05acbc service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Updating instance_info_cache with network_info: [{"id": "ef1b13c3-d3e6-492e-8082-b5939545f189", "address": "fa:16:3e:25:ba:8c", "network": {"id": "83e56acf-b902-47d4-8e67-89dd64cb110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773957043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844799698ad34e19ba511a302ffa57a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1b13c3-d3", "ovs_interfaceid": "ef1b13c3-d3e6-492e-8082-b5939545f189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:50:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c2e1267a-83ae-4e27-ab2a-d27db2d8c1b7 req-5a36c0b8-52d1-42ea-9050-4377da05acbc service nova] Releasing lock "refresh_cache-a54902a5-df8a-473f-9cf1-a112528c3549" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:50:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-31458d1b-5cfe-4acc-b636-e647ce8c10bd req-b5a6db93-1c6c-4010-87e5-cd25e2b71324 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Received event network-vif-plugged-ea301764-93d8-4c55-a51f-5e50918be405 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:50:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-31458d1b-5cfe-4acc-b636-e647ce8c10bd req-b5a6db93-1c6c-4010-87e5-cd25e2b71324 service nova] Acquiring lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-31458d1b-5cfe-4acc-b636-e647ce8c10bd req-b5a6db93-1c6c-4010-87e5-cd25e2b71324 service nova] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-31458d1b-5cfe-4acc-b636-e647ce8c10bd req-b5a6db93-1c6c-4010-87e5-cd25e2b71324 service nova] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-31458d1b-5cfe-4acc-b636-e647ce8c10bd req-b5a6db93-1c6c-4010-87e5-cd25e2b71324 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] No waiting events found dispatching network-vif-plugged-ea301764-93d8-4c55-a51f-5e50918be405 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:50:18 user nova-compute[73484]: WARNING nova.compute.manager [req-31458d1b-5cfe-4acc-b636-e647ce8c10bd req-b5a6db93-1c6c-4010-87e5-cd25e2b71324 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Received unexpected event network-vif-plugged-ea301764-93d8-4c55-a51f-5e50918be405 for instance with vm_state active and task_state rescuing.
Aug 14 13:50:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:21 user nova-compute[73484]: DEBUG nova.compute.manager [req-d2bb2e1a-b5d0-435f-8f0c-de0d6e1a3ef3 req-0eeba5eb-3034-4045-95a9-dc6fd7c9ac43 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Received event network-vif-plugged-ea301764-93d8-4c55-a51f-5e50918be405 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:50:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d2bb2e1a-b5d0-435f-8f0c-de0d6e1a3ef3 req-0eeba5eb-3034-4045-95a9-dc6fd7c9ac43 service nova] Acquiring lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d2bb2e1a-b5d0-435f-8f0c-de0d6e1a3ef3 req-0eeba5eb-3034-4045-95a9-dc6fd7c9ac43 service nova] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d2bb2e1a-b5d0-435f-8f0c-de0d6e1a3ef3 req-0eeba5eb-3034-4045-95a9-dc6fd7c9ac43 service nova] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:21 user nova-compute[73484]: DEBUG nova.compute.manager [req-d2bb2e1a-b5d0-435f-8f0c-de0d6e1a3ef3 req-0eeba5eb-3034-4045-95a9-dc6fd7c9ac43 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] No waiting events found dispatching network-vif-plugged-ea301764-93d8-4c55-a51f-5e50918be405 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:50:21 user nova-compute[73484]: WARNING nova.compute.manager [req-d2bb2e1a-b5d0-435f-8f0c-de0d6e1a3ef3 req-0eeba5eb-3034-4045-95a9-dc6fd7c9ac43 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Received unexpected event network-vif-plugged-ea301764-93d8-4c55-a51f-5e50918be405 for instance with vm_state active and task_state rescuing.
Aug 14 13:50:21 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692021006.1079388, 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:50:21 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] VM Stopped (Lifecycle Event)
Aug 14 13:50:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-73d1e74c-daa1-4645-9d37-288d67c1f1d6 None None] [instance: 2545f107-974a-4ee8-ba9b-7d7f7bb1ae91] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:50:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:21 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Removed pending event for b43ccb18-6d2d-43f2-a185-bb558d5d6f45 due to event {{(pid=73484) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 13:50:21 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021021.2667055, b43ccb18-6d2d-43f2-a185-bb558d5d6f45 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:50:21 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] VM Resumed (Lifecycle Event)
Aug 14 13:50:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-9c33a4a0-f5b7-4b7f-b09e-2df1e704d922 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:50:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:50:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:50:21 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 13:50:21 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021021.2728784, b43ccb18-6d2d-43f2-a185-bb558d5d6f45 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:50:21 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] VM Started (Lifecycle Event)
Aug 14 13:50:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:50:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:50:21 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 13:50:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:50:24 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Creating image(s)
Aug 14 13:50:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Did not create local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Ensure instance console log exists: /opt/stack/data/nova/instances/a54902a5-df8a-473f-9cf1-a112528c3549/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Start _get_guest_xml network_info=[{"id": "ef1b13c3-d3e6-492e-8082-b5939545f189", "address": "fa:16:3e:25:ba:8c", "network": {"id": "83e56acf-b902-47d4-8e67-89dd64cb110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773957043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844799698ad34e19ba511a302ffa57a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1b13c3-d3", "ovs_interfaceid": "ef1b13c3-d3e6-492e-8082-b5939545f189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '47611f7e-d99d-44c4-9b43-77263c657204', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VTMsgrjJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a54902a5-df8a-473f-9cf1-a112528c3549', 'attached_at': '', 'detached_at': '', 'volume_id': '5e55bf6f-36bb-45c9-84fe-491435460475', 'serial': '5e55bf6f-36bb-45c9-84fe-491435460475'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:50:24 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:50:24 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:50:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VTMsgrjJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:50:24 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:50:24 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:50:24 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:50:24 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:50:24 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:50:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d54bb30-4f38-48bd-be66-da7ee16a55f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:50:24 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.175s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4170933b-42f0-4a00-bfff-78f5ec297916]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475] added
Aug 14 13:50:24 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:50:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4991322d-8bd8-40b6-8222-d7d85ccf06f5]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cdf828-ced7-40bb-8d9d-37cf0f773ad7]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VTMsgrjJ {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VTMsgrjJ" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83c84e7-9b8a-47aa-9d5e-404cc2c5093b]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VTMsgrjJ'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9331f7d5-976e-4b55-a622-4cc02442d3bc]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fe7ffb-9cb2-4e10-b231-ef7188b2208f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:50:25 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:50:25 user nova-compute[73484]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:50:25 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:50:25 user nova-compute[73484]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)
Aug 14 13:50:25 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:50:25 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:50:25 user nova-compute[73484]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:50:25 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:50:25 user nova-compute[73484]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)
Aug 14 13:50:25 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebe8bd3-ceaa-4004-a7e5-14dd17053158]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475, portal: 172.16.0.220,3260]
Aug 14 13:50:25 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475, portal: 172.16.0.220,3260] successful.
Aug 14 13:50:25 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[353f4bd0-2b68-46ab-ae48-14d23f5d5609]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4b611e-8875-4f98-b177-fae7a1e958dd]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:50:25 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:50:25 user nova-compute[73484]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:50:25 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:50:25 user nova-compute[73484]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)
Aug 14 13:50:25 user nova-compute[73484]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)
Aug 14 13:50:25 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:50:25 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:50:25 user nova-compute[73484]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:50:25 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:50:25 user nova-compute[73484]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)
Aug 14 13:50:25 user nova-compute[73484]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)
Aug 14 13:50:25 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.542s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] HCTL ('37', '-', '-', 0) found on session 39 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35da9cf-49e2-4b97-b2db-a2fbe814f362]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Searching for a device in session 39 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:50:25 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VTMsgrjJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:50:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:26 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.584s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:50:26 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] <== connect_volume: return (1585ms) {'type': 'block', 'scsi_wwn': '23039363337323634', 'path': '/dev/sdf'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:50:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039363337323634', 'path': '/dev/sdf'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:50:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:50:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1804131842',display_name='tempest-TestShelveInstance-server-1804131842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1804131842',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxsFZ8NKDri+73Tn1zh9Wr6BQVIfh4MxDYhjkRccl1yD5yV+qy8XZKjgzVijNxBrMINGQYKNmEBr2Jszg8sPGJk+mssBnBusEo19PhQ2+8ia4TUjqmwOa2btGBPkDkkNg==',key_name='tempest-TestShelveInstance-1649769704',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='844799698ad34e19ba511a302ffa57a4',ramdisk_id='',reservation_id='r-romjeqoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1441042020',owner_user_name='tempest-TestShelveInstance-1441042020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:50:14Z,user_data=None,user_id='c8d4d6031b59481d93c22075f19559b6',uuid=a54902a5-df8a-473f-9cf1-a112528c3549,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef1b13c3-d3e6-492e-8082-b5939545f189", "address": "fa:16:3e:25:ba:8c", "network": {"id": "83e56acf-b902-47d4-8e67-89dd64cb110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773957043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844799698ad34e19ba511a302ffa57a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1b13c3-d3", "ovs_interfaceid": "ef1b13c3-d3e6-492e-8082-b5939545f189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:50:26 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Converting VIF {"id": "ef1b13c3-d3e6-492e-8082-b5939545f189", "address": "fa:16:3e:25:ba:8c", "network": {"id": "83e56acf-b902-47d4-8e67-89dd64cb110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773957043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844799698ad34e19ba511a302ffa57a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1b13c3-d3", "ovs_interfaceid": "ef1b13c3-d3e6-492e-8082-b5939545f189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:50:26 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:ba:8c,bridge_name='br-int',has_traffic_filtering=True,id=ef1b13c3-d3e6-492e-8082-b5939545f189,network=Network(83e56acf-b902-47d4-8e67-89dd64cb110e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1b13c3-d3') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:50:26 user nova-compute[73484]: DEBUG nova.objects.instance [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lazy-loading 'pci_devices' on Instance uuid a54902a5-df8a-473f-9cf1-a112528c3549 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:50:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:50:26 user nova-compute[73484]:   <uuid>a54902a5-df8a-473f-9cf1-a112528c3549</uuid>
Aug 14 13:50:26 user nova-compute[73484]:   <name>instance-00000020</name>
Aug 14 13:50:26 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:50:26 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:50:26 user nova-compute[73484]:   <metadata>
Aug 14 13:50:26 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:50:26 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:50:26 user nova-compute[73484]:       <nova:name>tempest-TestShelveInstance-server-1804131842</nova:name>
Aug 14 13:50:26 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:50:24</nova:creationTime>
Aug 14 13:50:26 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:50:26 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:50:26 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:50:26 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:50:26 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:50:26 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:50:26 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:50:26 user nova-compute[73484]:       <nova:owner>
Aug 14 13:50:26 user nova-compute[73484]:         <nova:user uuid="c8d4d6031b59481d93c22075f19559b6">tempest-TestShelveInstance-1441042020-project-member</nova:user>
Aug 14 13:50:26 user nova-compute[73484]:         <nova:project uuid="844799698ad34e19ba511a302ffa57a4">tempest-TestShelveInstance-1441042020</nova:project>
Aug 14 13:50:26 user nova-compute[73484]:       </nova:owner>
Aug 14 13:50:26 user nova-compute[73484]:       <nova:ports>
Aug 14 13:50:26 user nova-compute[73484]:         <nova:port uuid="ef1b13c3-d3e6-492e-8082-b5939545f189">
Aug 14 13:50:26 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 13:50:26 user nova-compute[73484]:         </nova:port>
Aug 14 13:50:26 user nova-compute[73484]:       </nova:ports>
Aug 14 13:50:26 user nova-compute[73484]:     </nova:instance>
Aug 14 13:50:26 user nova-compute[73484]:   </metadata>
Aug 14 13:50:26 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:50:26 user nova-compute[73484]:     <system>
Aug 14 13:50:26 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:50:26 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:50:26 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:50:26 user nova-compute[73484]:       <entry name="serial">a54902a5-df8a-473f-9cf1-a112528c3549</entry>
Aug 14 13:50:26 user nova-compute[73484]:       <entry name="uuid">a54902a5-df8a-473f-9cf1-a112528c3549</entry>
Aug 14 13:50:26 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:50:26 user nova-compute[73484]:     </system>
Aug 14 13:50:26 user nova-compute[73484]:   </sysinfo>
Aug 14 13:50:26 user nova-compute[73484]:   <os>
Aug 14 13:50:26 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:50:26 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:50:26 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:50:26 user nova-compute[73484]:   </os>
Aug 14 13:50:26 user nova-compute[73484]:   <features>
Aug 14 13:50:26 user nova-compute[73484]:     <acpi/>
Aug 14 13:50:26 user nova-compute[73484]:     <apic/>
Aug 14 13:50:26 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:50:26 user nova-compute[73484]:   </features>
Aug 14 13:50:26 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:50:26 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:50:26 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:50:26 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:50:26 user nova-compute[73484]:   </clock>
Aug 14 13:50:26 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:50:26 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:50:26 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:50:26 user nova-compute[73484]:   </cpu>
Aug 14 13:50:26 user nova-compute[73484]:   <devices>
Aug 14 13:50:26 user nova-compute[73484]:     <disk type="block" device="disk">
Aug 14 13:50:26 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:50:26 user nova-compute[73484]:       <source dev="/dev/sdf"/>
Aug 14 13:50:26 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:50:26 user nova-compute[73484]:       <serial>5e55bf6f-36bb-45c9-84fe-491435460475</serial>
Aug 14 13:50:26 user nova-compute[73484]:     </disk>
Aug 14 13:50:26 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:50:26 user nova-compute[73484]:       <mac address="fa:16:3e:25:ba:8c"/>
Aug 14 13:50:26 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:50:26 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:50:26 user nova-compute[73484]:       <target dev="tapef1b13c3-d3"/>
Aug 14 13:50:26 user nova-compute[73484]:     </interface>
Aug 14 13:50:26 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:50:26 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/a54902a5-df8a-473f-9cf1-a112528c3549/console.log" append="off"/>
Aug 14 13:50:26 user nova-compute[73484]:     </serial>
Aug 14 13:50:26 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:50:26 user nova-compute[73484]:     <video>
Aug 14 13:50:26 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:50:26 user nova-compute[73484]:     </video>
Aug 14 13:50:26 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:50:26 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:50:26 user nova-compute[73484]:     </rng>
Aug 14 13:50:26 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:50:26 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:50:26 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:50:26 user nova-compute[73484]:     </memballoon>
Aug 14 13:50:26 user nova-compute[73484]:   </devices>
Aug 14 13:50:26 user nova-compute[73484]: </domain>
Aug 14 13:50:26 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:50:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:50:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1804131842',display_name='tempest-TestShelveInstance-server-1804131842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1804131842',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxsFZ8NKDri+73Tn1zh9Wr6BQVIfh4MxDYhjkRccl1yD5yV+qy8XZKjgzVijNxBrMINGQYKNmEBr2Jszg8sPGJk+mssBnBusEo19PhQ2+8ia4TUjqmwOa2btGBPkDkkNg==',key_name='tempest-TestShelveInstance-1649769704',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='844799698ad34e19ba511a302ffa57a4',ramdisk_id='',reservation_id='r-romjeqoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1441042020',owner_user_name='tempest-TestShelveInstance-1441042020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:50:14Z,user_data=None,user_id='c8d4d6031b59481d93c22075f19559b6',uuid=a54902a5-df8a-473f-9cf1-a112528c3549,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef1b13c3-d3e6-492e-8082-b5939545f189", "address": "fa:16:3e:25:ba:8c", "network": {"id": "83e56acf-b902-47d4-8e67-89dd64cb110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773957043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844799698ad34e19ba511a302ffa57a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1b13c3-d3", "ovs_interfaceid": "ef1b13c3-d3e6-492e-8082-b5939545f189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:50:26 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Converting VIF {"id": "ef1b13c3-d3e6-492e-8082-b5939545f189", "address": "fa:16:3e:25:ba:8c", "network": {"id": "83e56acf-b902-47d4-8e67-89dd64cb110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773957043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844799698ad34e19ba511a302ffa57a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1b13c3-d3", "ovs_interfaceid": "ef1b13c3-d3e6-492e-8082-b5939545f189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:50:26 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:ba:8c,bridge_name='br-int',has_traffic_filtering=True,id=ef1b13c3-d3e6-492e-8082-b5939545f189,network=Network(83e56acf-b902-47d4-8e67-89dd64cb110e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1b13c3-d3') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:50:26 user nova-compute[73484]: DEBUG os_vif [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:ba:8c,bridge_name='br-int',has_traffic_filtering=True,id=ef1b13c3-d3e6-492e-8082-b5939545f189,network=Network(83e56acf-b902-47d4-8e67-89dd64cb110e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1b13c3-d3') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:50:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:50:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:50:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef1b13c3-d3, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:50:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapef1b13c3-d3, col_values=(('external_ids', {'iface-id': 'ef1b13c3-d3e6-492e-8082-b5939545f189', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:ba:8c', 'vm-uuid': 'a54902a5-df8a-473f-9cf1-a112528c3549'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:50:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:50:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:26 user nova-compute[73484]: INFO os_vif [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:ba:8c,bridge_name='br-int',has_traffic_filtering=True,id=ef1b13c3-d3e6-492e-8082-b5939545f189,network=Network(83e56acf-b902-47d4-8e67-89dd64cb110e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1b13c3-d3')
Aug 14 13:50:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:50:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] No VIF found with MAC fa:16:3e:25:ba:8c, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:50:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:28 user nova-compute[73484]: DEBUG nova.compute.manager [req-a329ee7c-74d4-4b9d-b732-97f2fb81ee55 req-b432fcbc-a924-4d16-9e26-54a182daf0a8 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Received event network-vif-plugged-ef1b13c3-d3e6-492e-8082-b5939545f189 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:50:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a329ee7c-74d4-4b9d-b732-97f2fb81ee55 req-b432fcbc-a924-4d16-9e26-54a182daf0a8 service nova] Acquiring lock "a54902a5-df8a-473f-9cf1-a112528c3549-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a329ee7c-74d4-4b9d-b732-97f2fb81ee55 req-b432fcbc-a924-4d16-9e26-54a182daf0a8 service nova] Lock "a54902a5-df8a-473f-9cf1-a112528c3549-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a329ee7c-74d4-4b9d-b732-97f2fb81ee55 req-b432fcbc-a924-4d16-9e26-54a182daf0a8 service nova] Lock "a54902a5-df8a-473f-9cf1-a112528c3549-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:28 user nova-compute[73484]: DEBUG nova.compute.manager [req-a329ee7c-74d4-4b9d-b732-97f2fb81ee55 req-b432fcbc-a924-4d16-9e26-54a182daf0a8 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] No waiting events found dispatching network-vif-plugged-ef1b13c3-d3e6-492e-8082-b5939545f189 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:50:28 user nova-compute[73484]: WARNING nova.compute.manager [req-a329ee7c-74d4-4b9d-b732-97f2fb81ee55 req-b432fcbc-a924-4d16-9e26-54a182daf0a8 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Received unexpected event network-vif-plugged-ef1b13c3-d3e6-492e-8082-b5939545f189 for instance with vm_state building and task_state spawning.
Aug 14 13:50:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:29 user nova-compute[73484]: DEBUG nova.compute.manager [req-758a27c0-d95d-436e-92a2-aa4ddb7d3b99 req-8cae2865-a448-4c85-820f-5cd36c910856 service nova] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Received event network-changed-cb7f3901-875e-489a-87f8-5642b9fded9c {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:50:29 user nova-compute[73484]: DEBUG nova.compute.manager [req-758a27c0-d95d-436e-92a2-aa4ddb7d3b99 req-8cae2865-a448-4c85-820f-5cd36c910856 service nova] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Refreshing instance network info cache due to event network-changed-cb7f3901-875e-489a-87f8-5642b9fded9c. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:50:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-758a27c0-d95d-436e-92a2-aa4ddb7d3b99 req-8cae2865-a448-4c85-820f-5cd36c910856 service nova] Acquiring lock "refresh_cache-07bac569-8b2c-4555-b4d5-a74f7384630b" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:50:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-758a27c0-d95d-436e-92a2-aa4ddb7d3b99 req-8cae2865-a448-4c85-820f-5cd36c910856 service nova] Acquired lock "refresh_cache-07bac569-8b2c-4555-b4d5-a74f7384630b" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:50:29 user nova-compute[73484]: DEBUG nova.network.neutron [req-758a27c0-d95d-436e-92a2-aa4ddb7d3b99 req-8cae2865-a448-4c85-820f-5cd36c910856 service nova] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Refreshing network info cache for port cb7f3901-875e-489a-87f8-5642b9fded9c {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:50:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:29 user nova-compute[73484]: DEBUG nova.network.neutron [req-758a27c0-d95d-436e-92a2-aa4ddb7d3b99 req-8cae2865-a448-4c85-820f-5cd36c910856 service nova] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Updated VIF entry in instance network info cache for port cb7f3901-875e-489a-87f8-5642b9fded9c. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:50:29 user nova-compute[73484]: DEBUG nova.network.neutron [req-758a27c0-d95d-436e-92a2-aa4ddb7d3b99 req-8cae2865-a448-4c85-820f-5cd36c910856 service nova] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Updating instance_info_cache with network_info: [{"id": "cb7f3901-875e-489a-87f8-5642b9fded9c", "address": "fa:16:3e:6c:13:9e", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7f3901-87", "ovs_interfaceid": "cb7f3901-875e-489a-87f8-5642b9fded9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:50:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-758a27c0-d95d-436e-92a2-aa4ddb7d3b99 req-8cae2865-a448-4c85-820f-5cd36c910856 service nova] Releasing lock "refresh_cache-07bac569-8b2c-4555-b4d5-a74f7384630b" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:50:30 user nova-compute[73484]: DEBUG nova.compute.manager [req-d9fbbcd0-9be5-4a05-a64f-4a71aae587d1 req-2219a557-aaa3-42e5-a1c7-9bcdd8cc7228 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Received event network-vif-plugged-ef1b13c3-d3e6-492e-8082-b5939545f189 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:50:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d9fbbcd0-9be5-4a05-a64f-4a71aae587d1 req-2219a557-aaa3-42e5-a1c7-9bcdd8cc7228 service nova] Acquiring lock "a54902a5-df8a-473f-9cf1-a112528c3549-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d9fbbcd0-9be5-4a05-a64f-4a71aae587d1 req-2219a557-aaa3-42e5-a1c7-9bcdd8cc7228 service nova] Lock "a54902a5-df8a-473f-9cf1-a112528c3549-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d9fbbcd0-9be5-4a05-a64f-4a71aae587d1 req-2219a557-aaa3-42e5-a1c7-9bcdd8cc7228 service nova] Lock "a54902a5-df8a-473f-9cf1-a112528c3549-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:30 user nova-compute[73484]: DEBUG nova.compute.manager [req-d9fbbcd0-9be5-4a05-a64f-4a71aae587d1 req-2219a557-aaa3-42e5-a1c7-9bcdd8cc7228 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] No waiting events found dispatching network-vif-plugged-ef1b13c3-d3e6-492e-8082-b5939545f189 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:50:30 user nova-compute[73484]: WARNING nova.compute.manager [req-d9fbbcd0-9be5-4a05-a64f-4a71aae587d1 req-2219a557-aaa3-42e5-a1c7-9bcdd8cc7228 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Received unexpected event network-vif-plugged-ef1b13c3-d3e6-492e-8082-b5939545f189 for instance with vm_state building and task_state spawning.
Aug 14 13:50:30 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:50:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:50:30 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021030.6083663, a54902a5-df8a-473f-9cf1-a112528c3549 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:50:30 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] VM Resumed (Lifecycle Event)
Aug 14 13:50:30 user nova-compute[73484]: DEBUG nova.compute.manager [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Stashing vm_state: active {{(pid=73484) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 14 13:50:30 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:50:30 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Instance spawned successfully.
Aug 14 13:50:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:50:30 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:50:30 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:50:30 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021030.6084757, a54902a5-df8a-473f-9cf1-a112528c3549 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:50:30 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] VM Started (Lifecycle Event)
Aug 14 13:50:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:50:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:50:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:50:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:50:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:50:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:50:30 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:50:30 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:50:30 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:50:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:30 user nova-compute[73484]: INFO nova.compute.manager [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Took 6.07 seconds to spawn the instance on the hypervisor.
Aug 14 13:50:30 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:50:30 user nova-compute[73484]: DEBUG nova.objects.instance [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lazy-loading 'pci_requests' on Instance uuid 72f007af-a1e7-4a80-954c-ed12aaf129fd {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:50:30 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:50:30 user nova-compute[73484]: INFO nova.compute.claims [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Claim successful on node user
Aug 14 13:50:30 user nova-compute[73484]: DEBUG nova.objects.instance [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lazy-loading 'resources' on Instance uuid 72f007af-a1e7-4a80-954c-ed12aaf129fd {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:50:30 user nova-compute[73484]: DEBUG nova.objects.instance [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lazy-loading 'pci_devices' on Instance uuid 72f007af-a1e7-4a80-954c-ed12aaf129fd {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:50:30 user nova-compute[73484]: INFO nova.compute.manager [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Took 18.03 seconds to build instance.
Aug 14 13:50:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e183bda-7b0f-42e2-8cc3-93c1bf5ac0d3 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "a54902a5-df8a-473f-9cf1-a112528c3549" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.126s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:30 user nova-compute[73484]: INFO nova.compute.resource_tracker [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Updating resource usage from migration 46f67f47-54df-4173-adbd-c3a2097e9347
Aug 14 13:50:31 user nova-compute[73484]: DEBUG nova.compute.manager [req-fb6696ec-1547-4a4d-b43e-5312a028f77d req-8f5d06d4-8c5d-42bb-bf35-48f5a9595499 service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Received event network-changed-19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:50:31 user nova-compute[73484]: DEBUG nova.compute.manager [req-fb6696ec-1547-4a4d-b43e-5312a028f77d req-8f5d06d4-8c5d-42bb-bf35-48f5a9595499 service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Refreshing instance network info cache due to event network-changed-19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:50:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-fb6696ec-1547-4a4d-b43e-5312a028f77d req-8f5d06d4-8c5d-42bb-bf35-48f5a9595499 service nova] Acquiring lock "refresh_cache-72f007af-a1e7-4a80-954c-ed12aaf129fd" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:50:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-fb6696ec-1547-4a4d-b43e-5312a028f77d req-8f5d06d4-8c5d-42bb-bf35-48f5a9595499 service nova] Acquired lock "refresh_cache-72f007af-a1e7-4a80-954c-ed12aaf129fd" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:50:31 user nova-compute[73484]: DEBUG nova.network.neutron [req-fb6696ec-1547-4a4d-b43e-5312a028f77d req-8f5d06d4-8c5d-42bb-bf35-48f5a9595499 service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Refreshing network info cache for port 19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:50:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:31 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:50:31 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:50:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.831s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:31 user nova-compute[73484]: INFO nova.compute.manager [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Migrating
Aug 14 13:50:31 user nova-compute[73484]: DEBUG nova.network.neutron [req-fb6696ec-1547-4a4d-b43e-5312a028f77d req-8f5d06d4-8c5d-42bb-bf35-48f5a9595499 service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Updated VIF entry in instance network info cache for port 19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:50:31 user nova-compute[73484]: DEBUG nova.network.neutron [req-fb6696ec-1547-4a4d-b43e-5312a028f77d req-8f5d06d4-8c5d-42bb-bf35-48f5a9595499 service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Updating instance_info_cache with network_info: [{"id": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "address": "fa:16:3e:22:ea:2c", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f75cf0-c8", "ovs_interfaceid": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:50:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "refresh_cache-72f007af-a1e7-4a80-954c-ed12aaf129fd" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:50:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-fb6696ec-1547-4a4d-b43e-5312a028f77d req-8f5d06d4-8c5d-42bb-bf35-48f5a9595499 service nova] Releasing lock "refresh_cache-72f007af-a1e7-4a80-954c-ed12aaf129fd" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:50:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquired lock "refresh_cache-72f007af-a1e7-4a80-954c-ed12aaf129fd" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:50:31 user nova-compute[73484]: DEBUG nova.network.neutron [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:50:32 user nova-compute[73484]: DEBUG nova.network.neutron [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Updating instance_info_cache with network_info: [{"id": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "address": "fa:16:3e:22:ea:2c", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f75cf0-c8", "ovs_interfaceid": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:50:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Releasing lock "refresh_cache-72f007af-a1e7-4a80-954c-ed12aaf129fd" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:50:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Starting migrate_disk_and_power_off {{(pid=73484) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 14 13:50:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG nova.compute.manager [req-ae797372-85f9-4b0d-8704-afcc84219338 req-180dd63d-1508-4315-8aee-beefb49fe765 service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Received event network-vif-unplugged-19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ae797372-85f9-4b0d-8704-afcc84219338 req-180dd63d-1508-4315-8aee-beefb49fe765 service nova] Acquiring lock "72f007af-a1e7-4a80-954c-ed12aaf129fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ae797372-85f9-4b0d-8704-afcc84219338 req-180dd63d-1508-4315-8aee-beefb49fe765 service nova] Lock "72f007af-a1e7-4a80-954c-ed12aaf129fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ae797372-85f9-4b0d-8704-afcc84219338 req-180dd63d-1508-4315-8aee-beefb49fe765 service nova] Lock "72f007af-a1e7-4a80-954c-ed12aaf129fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG nova.compute.manager [req-ae797372-85f9-4b0d-8704-afcc84219338 req-180dd63d-1508-4315-8aee-beefb49fe765 service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] No waiting events found dispatching network-vif-unplugged-19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:50:33 user nova-compute[73484]: WARNING nova.compute.manager [req-ae797372-85f9-4b0d-8704-afcc84219338 req-180dd63d-1508-4315-8aee-beefb49fe765 service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Received unexpected event network-vif-unplugged-19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 for instance with vm_state active and task_state resize_migrating.
Aug 14 13:50:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:33 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Instance destroyed successfully.
Aug 14 13:50:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1769794670',display_name='tempest-ServerActionsTestOtherA-server-1769794670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1769794670',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+U0YM0H+9FtSMWW9gC7hlmEYl+cufNxOVmMIw8gQGmCCRzcGdOpZ2rClVjHI02XniG6rU6cneNsbww6ySr+rPSIW5KD8/op2pTaoCA25ZKyUod+b+1u3EAmeZWFbiG0g==',key_name='tempest-keypair-1679559247',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:48:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ff9e3bd3df8a408e96e9054775c3cb83',ramdisk_id='',reservation_id='r-50052euq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2033458528',owner_user_name='tempest-ServerActionsTestOtherA-2033458528-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:50:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b22dfe5647e149a5b3a19d843f0efd66',uuid=72f007af-a1e7-4a80-954c-ed12aaf129fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "address": "fa:16:3e:22:ea:2c", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1493391166-network", "vif_mac": "fa:16:3e:22:ea:2c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f75cf0-c8", "ovs_interfaceid": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Converting VIF {"id": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "address": "fa:16:3e:22:ea:2c", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1493391166-network", "vif_mac": "fa:16:3e:22:ea:2c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f75cf0-c8", "ovs_interfaceid": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:ea:2c,bridge_name='br-int',has_traffic_filtering=True,id=19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19f75cf0-c8') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG os_vif [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:ea:2c,bridge_name='br-int',has_traffic_filtering=True,id=19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19f75cf0-c8') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19f75cf0-c8, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:33 user nova-compute[73484]: INFO os_vif [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:ea:2c,bridge_name='br-int',has_traffic_filtering=True,id=19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19f75cf0-c8')
Aug 14 13:50:33 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EqNPGcOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:50:33 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:50:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8876ed5d-a95c-494c-858c-97264add942d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc57e4a-27d4-4328-9d8e-469c99a08582]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:50:33 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:50:33 user nova-compute[73484]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:50:33 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:50:33 user nova-compute[73484]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)
Aug 14 13:50:33 user nova-compute[73484]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)
Aug 14 13:50:33 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:50:33 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:50:33 user nova-compute[73484]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:50:33 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:50:33 user nova-compute[73484]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)
Aug 14 13:50:33 user nova-compute[73484]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)
Aug 14 13:50:33 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc49301b6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812'): ({'sdd'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Removing single pathed devices sdd {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfa6f7c-eebf-4198-a17d-3a262ecda77d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5f906e-c539-4094-9581-42bd9de3cd1b]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Flushing IO for device /dev/sdd {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b402417-bff3-4a9b-9b41-0a0b4a7fbfe7]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e045da9-ef8e-4955-827c-741a8771d11e]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] SCSI volumes sdd have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO37378e00-9ff5f0b186b3f104', '/dev/disk/by-id/scsi-23966663566306231', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_37378e00') {{(pid=84315) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 13:50:33 user nova-compute[73484]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO37378e00-9ff5f0b186b3f104
Aug 14 13:50:33 user nova-compute[73484]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23966663566306231
Aug 14 13:50:33 user nova-compute[73484]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_37378e00
Aug 14 13:50:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc24327f-2049-49b2-9ed6-bdae6c8ae068]: (4, None) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87ce8c1-aba9-4080-8e60-b59983959ecc]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:50:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0c056b-a4b4-4fb6-baff-afc6107c9751]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812, portal: 172.16.0.220,3260]
Aug 14 13:50:34 user nova-compute[73484]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812, portal: 172.16.0.220,3260] successful.
Aug 14 13:50:34 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:50:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:34 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:34 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4519185e-7d73-4706-aba0-6e47ed436fe3]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:50:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:50:34 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] <== disconnect_volume: return (372ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:50:34 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:50:34 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:50:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:35 user nova-compute[73484]: DEBUG nova.network.neutron [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Port 19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 binding to destination host user is already ACTIVE {{(pid=73484) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 14 13:50:35 user nova-compute[73484]: DEBUG nova.compute.manager [req-bf4d162a-a919-4277-bc51-846a7960b9de req-1f6f76df-4beb-44e7-bd86-7cf95612791e service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Received event network-vif-plugged-19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:50:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-bf4d162a-a919-4277-bc51-846a7960b9de req-1f6f76df-4beb-44e7-bd86-7cf95612791e service nova] Acquiring lock "72f007af-a1e7-4a80-954c-ed12aaf129fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-bf4d162a-a919-4277-bc51-846a7960b9de req-1f6f76df-4beb-44e7-bd86-7cf95612791e service nova] Lock "72f007af-a1e7-4a80-954c-ed12aaf129fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-bf4d162a-a919-4277-bc51-846a7960b9de req-1f6f76df-4beb-44e7-bd86-7cf95612791e service nova] Lock "72f007af-a1e7-4a80-954c-ed12aaf129fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:35 user nova-compute[73484]: DEBUG nova.compute.manager [req-bf4d162a-a919-4277-bc51-846a7960b9de req-1f6f76df-4beb-44e7-bd86-7cf95612791e service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] No waiting events found dispatching network-vif-plugged-19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:50:35 user nova-compute[73484]: WARNING nova.compute.manager [req-bf4d162a-a919-4277-bc51-846a7960b9de req-1f6f76df-4beb-44e7-bd86-7cf95612791e service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Received unexpected event network-vif-plugged-19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 for instance with vm_state active and task_state resize_migrating.
Aug 14 13:50:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "72f007af-a1e7-4a80-954c-ed12aaf129fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "72f007af-a1e7-4a80-954c-ed12aaf129fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "72f007af-a1e7-4a80-954c-ed12aaf129fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "refresh_cache-72f007af-a1e7-4a80-954c-ed12aaf129fd" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:50:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquired lock "refresh_cache-72f007af-a1e7-4a80-954c-ed12aaf129fd" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:50:35 user nova-compute[73484]: DEBUG nova.network.neutron [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:50:35 user nova-compute[73484]: DEBUG nova.network.neutron [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Updating instance_info_cache with network_info: [{"id": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "address": "fa:16:3e:22:ea:2c", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f75cf0-c8", "ovs_interfaceid": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:50:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Releasing lock "refresh_cache-72f007af-a1e7-4a80-954c-ed12aaf129fd" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:50:36 user nova-compute[73484]: DEBUG os_brick.utils [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:50:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54c0a91-235e-40db-81d6-2bac958475c0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae386f2-1549-4811-ab4c-804aebfae8d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[46045d7f-2aa6-40f0-96e1-23ed7cc21177]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[795d802c-3063-4a7d-9324-c86bed16273c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:50:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:50:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:50:36 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:50:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab748636-531e-4b2e-81b7-a465b4321f92]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:50:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:50:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:50:36 user nova-compute[73484]: DEBUG os_brick.utils [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:50:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:40 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:50:40 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:50:40 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 13:50:42 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:50:42 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 13:50:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-07bac569-8b2c-4555-b4d5-a74f7384630b" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:50:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-07bac569-8b2c-4555-b4d5-a74f7384630b" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:50:43 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 13:50:43 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Updating instance_info_cache with network_info: [{"id": "cb7f3901-875e-489a-87f8-5642b9fded9c", "address": "fa:16:3e:6c:13:9e", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7f3901-87", "ovs_interfaceid": "cb7f3901-875e-489a-87f8-5642b9fded9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:50:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-07bac569-8b2c-4555-b4d5-a74f7384630b" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:50:43 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 13:50:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:43 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:50:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:44 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:50:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:44 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Starting finish_migration {{(pid=73484) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Instance directory exists: not creating {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 13:50:45 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Creating image(s)
Aug 14 13:50:45 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Did not create local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Ensure instance console log exists: /opt/stack/data/nova/instances/72f007af-a1e7-4a80-954c-ed12aaf129fd/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Start _get_guest_xml network_info=[{"id": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "address": "fa:16:3e:22:ea:2c", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1493391166-network", "vif_mac": "fa:16:3e:22:ea:2c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f75cf0-c8", "ovs_interfaceid": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8d563c6d-0c11-409a-872b-fdaa1cc6d9dd', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EqNPGcOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '72f007af-a1e7-4a80-954c-ed12aaf129fd', 'attached_at': '2023-08-14T13:50:46.000000', 'detached_at': '', 'volume_id': 'cc7990bf-85e5-4d3a-9073-716c7875c812', 'serial': 'cc7990bf-85e5-4d3a-9073-716c7875c812'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:50:45 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:50:45 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:50:45 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG nova.objects.instance [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lazy-loading 'vcpu_model' on Instance uuid 72f007af-a1e7-4a80-954c-ed12aaf129fd {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EqNPGcOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:50:45 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:50:45 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:50:45 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:50:45 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:50:45 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:50:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94df59e-53c0-49a0-adf4-d4ba5e23f874]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:50:45 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:50:45 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e03f36-c3fa-4d98-9fb4-37d3b448d06c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812] added
Aug 14 13:50:46 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[235668e7-e0fd-4ae2-9f30-579eb49b38b8]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7daa4729-7c7f-4f09-ac51-5b5c8fd097ce]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EqNPGcOn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EqNPGcOn" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9b79a7-14a0-442b-8233-a831dd53c76c]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EqNPGcOn'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70d6d1f-7913-4515-8e88-553665d802ec]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[388c7742-ca37-4b5f-8b54-eb598e45a9db]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:50:46 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:50:46 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:50:46 user nova-compute[73484]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)
Aug 14 13:50:46 user nova-compute[73484]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)
Aug 14 13:50:46 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:50:46 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:50:46 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:50:46 user nova-compute[73484]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)
Aug 14 13:50:46 user nova-compute[73484]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)
Aug 14 13:50:46 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac91326-faf9-424d-827c-c33ede2d04af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812, portal: 172.16.0.220,3260]
Aug 14 13:50:46 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812, portal: 172.16.0.220,3260] successful.
Aug 14 13:50:46 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d4dff8-95d0-48ef-90dc-c082f8d4a2b3]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7bd9e2-5594-4e8b-80de-22fa04af6f29]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:50:46 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:50:46 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:50:46 user nova-compute[73484]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)
Aug 14 13:50:46 user nova-compute[73484]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)
Aug 14 13:50:46 user nova-compute[73484]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:50:46 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:50:46 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:50:46 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:50:46 user nova-compute[73484]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)
Aug 14 13:50:46 user nova-compute[73484]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)
Aug 14 13:50:46 user nova-compute[73484]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:50:46 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[5798f8f0-bbb2-44f9-9961-6013e1fc1a62]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EqNPGcOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '23966663566306231', 'path': '/dev/sdd'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966663566306231', 'path': '/dev/sdd'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1769794670',display_name='tempest-ServerActionsTestOtherA-server-1769794670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1769794670',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+U0YM0H+9FtSMWW9gC7hlmEYl+cufNxOVmMIw8gQGmCCRzcGdOpZ2rClVjHI02XniG6rU6cneNsbww6ySr+rPSIW5KD8/op2pTaoCA25ZKyUod+b+1u3EAmeZWFbiG0g==',key_name='tempest-keypair-1679559247',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:48:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ff9e3bd3df8a408e96e9054775c3cb83',ramdisk_id='',reservation_id='r-50052euq',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2033458528',owner_user_name='tempest-ServerActionsTestOtherA-2033458528-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:50:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b22dfe5647e149a5b3a19d843f0efd66',uuid=72f007af-a1e7-4a80-954c-ed12aaf129fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "address": "fa:16:3e:22:ea:2c", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1493391166-network", "vif_mac": "fa:16:3e:22:ea:2c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f75cf0-c8", "ovs_interfaceid": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Converting VIF {"id": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "address": "fa:16:3e:22:ea:2c", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1493391166-network", "vif_mac": "fa:16:3e:22:ea:2c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f75cf0-c8", "ovs_interfaceid": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:ea:2c,bridge_name='br-int',has_traffic_filtering=True,id=19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19f75cf0-c8') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:50:47 user nova-compute[73484]:   <uuid>72f007af-a1e7-4a80-954c-ed12aaf129fd</uuid>
Aug 14 13:50:47 user nova-compute[73484]:   <name>instance-0000001d</name>
Aug 14 13:50:47 user nova-compute[73484]:   <memory>2097152</memory>
Aug 14 13:50:47 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:50:47 user nova-compute[73484]:   <metadata>
Aug 14 13:50:47 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:50:47 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:50:47 user nova-compute[73484]:       <nova:name>tempest-ServerActionsTestOtherA-server-1769794670</nova:name>
Aug 14 13:50:47 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:50:45</nova:creationTime>
Aug 14 13:50:47 user nova-compute[73484]:       <nova:flavor name="m1.small">
Aug 14 13:50:47 user nova-compute[73484]:         <nova:memory>2048</nova:memory>
Aug 14 13:50:47 user nova-compute[73484]:         <nova:disk>20</nova:disk>
Aug 14 13:50:47 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:50:47 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:50:47 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:50:47 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:50:47 user nova-compute[73484]:       <nova:owner>
Aug 14 13:50:47 user nova-compute[73484]:         <nova:user uuid="b22dfe5647e149a5b3a19d843f0efd66">tempest-ServerActionsTestOtherA-2033458528-project-member</nova:user>
Aug 14 13:50:47 user nova-compute[73484]:         <nova:project uuid="ff9e3bd3df8a408e96e9054775c3cb83">tempest-ServerActionsTestOtherA-2033458528</nova:project>
Aug 14 13:50:47 user nova-compute[73484]:       </nova:owner>
Aug 14 13:50:47 user nova-compute[73484]:       <nova:ports>
Aug 14 13:50:47 user nova-compute[73484]:         <nova:port uuid="19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9">
Aug 14 13:50:47 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 13:50:47 user nova-compute[73484]:         </nova:port>
Aug 14 13:50:47 user nova-compute[73484]:       </nova:ports>
Aug 14 13:50:47 user nova-compute[73484]:     </nova:instance>
Aug 14 13:50:47 user nova-compute[73484]:   </metadata>
Aug 14 13:50:47 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:50:47 user nova-compute[73484]:     <system>
Aug 14 13:50:47 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:50:47 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:50:47 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:50:47 user nova-compute[73484]:       <entry name="serial">72f007af-a1e7-4a80-954c-ed12aaf129fd</entry>
Aug 14 13:50:47 user nova-compute[73484]:       <entry name="uuid">72f007af-a1e7-4a80-954c-ed12aaf129fd</entry>
Aug 14 13:50:47 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:50:47 user nova-compute[73484]:     </system>
Aug 14 13:50:47 user nova-compute[73484]:   </sysinfo>
Aug 14 13:50:47 user nova-compute[73484]:   <os>
Aug 14 13:50:47 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:50:47 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:50:47 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:50:47 user nova-compute[73484]:   </os>
Aug 14 13:50:47 user nova-compute[73484]:   <features>
Aug 14 13:50:47 user nova-compute[73484]:     <acpi/>
Aug 14 13:50:47 user nova-compute[73484]:     <apic/>
Aug 14 13:50:47 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:50:47 user nova-compute[73484]:   </features>
Aug 14 13:50:47 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:50:47 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:50:47 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:50:47 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:50:47 user nova-compute[73484]:   </clock>
Aug 14 13:50:47 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:50:47 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:50:47 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:50:47 user nova-compute[73484]:   </cpu>
Aug 14 13:50:47 user nova-compute[73484]:   <devices>
Aug 14 13:50:47 user nova-compute[73484]:     <disk type="block" device="disk">
Aug 14 13:50:47 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:50:47 user nova-compute[73484]:       <source dev="/dev/sdd"/>
Aug 14 13:50:47 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:50:47 user nova-compute[73484]:       <serial>cc7990bf-85e5-4d3a-9073-716c7875c812</serial>
Aug 14 13:50:47 user nova-compute[73484]:     </disk>
Aug 14 13:50:47 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:50:47 user nova-compute[73484]:       <mac address="fa:16:3e:22:ea:2c"/>
Aug 14 13:50:47 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:50:47 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:50:47 user nova-compute[73484]:       <target dev="tap19f75cf0-c8"/>
Aug 14 13:50:47 user nova-compute[73484]:     </interface>
Aug 14 13:50:47 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:50:47 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/72f007af-a1e7-4a80-954c-ed12aaf129fd/console.log" append="off"/>
Aug 14 13:50:47 user nova-compute[73484]:     </serial>
Aug 14 13:50:47 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:50:47 user nova-compute[73484]:     <video>
Aug 14 13:50:47 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:50:47 user nova-compute[73484]:     </video>
Aug 14 13:50:47 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:50:47 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:50:47 user nova-compute[73484]:     </rng>
Aug 14 13:50:47 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:50:47 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:50:47 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:50:47 user nova-compute[73484]:     </memballoon>
Aug 14 13:50:47 user nova-compute[73484]:   </devices>
Aug 14 13:50:47 user nova-compute[73484]: </domain>
Aug 14 13:50:47 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1769794670',display_name='tempest-ServerActionsTestOtherA-server-1769794670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1769794670',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+U0YM0H+9FtSMWW9gC7hlmEYl+cufNxOVmMIw8gQGmCCRzcGdOpZ2rClVjHI02XniG6rU6cneNsbww6ySr+rPSIW5KD8/op2pTaoCA25ZKyUod+b+1u3EAmeZWFbiG0g==',key_name='tempest-keypair-1679559247',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:48:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ff9e3bd3df8a408e96e9054775c3cb83',ramdisk_id='',reservation_id='r-50052euq',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2033458528',owner_user_name='tempest-ServerActionsTestOtherA-2033458528-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:50:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b22dfe5647e149a5b3a19d843f0efd66',uuid=72f007af-a1e7-4a80-954c-ed12aaf129fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "address": "fa:16:3e:22:ea:2c", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1493391166-network", "vif_mac": "fa:16:3e:22:ea:2c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f75cf0-c8", "ovs_interfaceid": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Converting VIF {"id": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "address": "fa:16:3e:22:ea:2c", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1493391166-network", "vif_mac": "fa:16:3e:22:ea:2c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f75cf0-c8", "ovs_interfaceid": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:ea:2c,bridge_name='br-int',has_traffic_filtering=True,id=19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19f75cf0-c8') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG os_vif [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:ea:2c,bridge_name='br-int',has_traffic_filtering=True,id=19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19f75cf0-c8') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19f75cf0-c8, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap19f75cf0-c8, col_values=(('external_ids', {'iface-id': '19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:ea:2c', 'vm-uuid': '72f007af-a1e7-4a80-954c-ed12aaf129fd'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:47 user nova-compute[73484]: INFO os_vif [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:ea:2c,bridge_name='br-int',has_traffic_filtering=True,id=19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19f75cf0-c8')
Aug 14 13:50:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] No VIF found with MAC fa:16:3e:22:ea:2c, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:48 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:50:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b43ccb18-6d2d-43f2-a185-bb558d5d6f45/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b43ccb18-6d2d-43f2-a185-bb558d5d6f45/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b43ccb18-6d2d-43f2-a185-bb558d5d6f45/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b43ccb18-6d2d-43f2-a185-bb558d5d6f45/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:48 user nova-compute[73484]: DEBUG nova.compute.manager [req-fdcd8242-c1d5-47f2-88e9-4695e75673fd req-a99dc953-1d91-4491-88ba-4540867756ca service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Received event network-changed-8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:50:48 user nova-compute[73484]: DEBUG nova.compute.manager [req-fdcd8242-c1d5-47f2-88e9-4695e75673fd req-a99dc953-1d91-4491-88ba-4540867756ca service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Refreshing instance network info cache due to event network-changed-8f0b7e99-89d1-4234-a552-e92df188cd4e. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:50:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-fdcd8242-c1d5-47f2-88e9-4695e75673fd req-a99dc953-1d91-4491-88ba-4540867756ca service nova] Acquiring lock "refresh_cache-86580f0d-dd88-48fb-bce8-dc6f5edc01c6" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:50:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-fdcd8242-c1d5-47f2-88e9-4695e75673fd req-a99dc953-1d91-4491-88ba-4540867756ca service nova] Acquired lock "refresh_cache-86580f0d-dd88-48fb-bce8-dc6f5edc01c6" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:50:48 user nova-compute[73484]: DEBUG nova.network.neutron [req-fdcd8242-c1d5-47f2-88e9-4695e75673fd req-a99dc953-1d91-4491-88ba-4540867756ca service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Refreshing network info cache for port 8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:50:48 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692021033.6422777, 72f007af-a1e7-4a80-954c-ed12aaf129fd => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:50:48 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] VM Stopped (Lifecycle Event)
Aug 14 13:50:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:48 user nova-compute[73484]: DEBUG nova.compute.manager [None req-4b5df78d-c174-4a23-abb6-ec5d07671c8f None None] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:50:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:50:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:49 user nova-compute[73484]: DEBUG nova.network.neutron [req-fdcd8242-c1d5-47f2-88e9-4695e75673fd req-a99dc953-1d91-4491-88ba-4540867756ca service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Updated VIF entry in instance network info cache for port 8f0b7e99-89d1-4234-a552-e92df188cd4e. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:50:49 user nova-compute[73484]: DEBUG nova.network.neutron [req-fdcd8242-c1d5-47f2-88e9-4695e75673fd req-a99dc953-1d91-4491-88ba-4540867756ca service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Updating instance_info_cache with network_info: [{"id": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "address": "fa:16:3e:20:8b:68", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0b7e99-89", "ovs_interfaceid": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:50:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-fdcd8242-c1d5-47f2-88e9-4695e75673fd req-a99dc953-1d91-4491-88ba-4540867756ca service nova] Releasing lock "refresh_cache-86580f0d-dd88-48fb-bce8-dc6f5edc01c6" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:50:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:50 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:50:50 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:50:50 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=6977MB free_disk=25.173324584960938GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 13:50:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:50 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Applying migration context for instance 72f007af-a1e7-4a80-954c-ed12aaf129fd as it has an incoming, in-progress migration 46f67f47-54df-4173-adbd-c3a2097e9347. Migration status is post-migrating {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 13:50:50 user nova-compute[73484]: INFO nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Updating resource usage from migration 46f67f47-54df-4173-adbd-c3a2097e9347
Aug 14 13:50:50 user nova-compute[73484]: DEBUG nova.compute.manager [req-d49029b4-ea9d-4cc6-b697-8809a732d51a req-9e25d0fe-0a1c-4bf4-8ac7-8755dc20b17d service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Received event network-vif-plugged-19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:50:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d49029b4-ea9d-4cc6-b697-8809a732d51a req-9e25d0fe-0a1c-4bf4-8ac7-8755dc20b17d service nova] Acquiring lock "72f007af-a1e7-4a80-954c-ed12aaf129fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d49029b4-ea9d-4cc6-b697-8809a732d51a req-9e25d0fe-0a1c-4bf4-8ac7-8755dc20b17d service nova] Lock "72f007af-a1e7-4a80-954c-ed12aaf129fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d49029b4-ea9d-4cc6-b697-8809a732d51a req-9e25d0fe-0a1c-4bf4-8ac7-8755dc20b17d service nova] Lock "72f007af-a1e7-4a80-954c-ed12aaf129fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:50 user nova-compute[73484]: DEBUG nova.compute.manager [req-d49029b4-ea9d-4cc6-b697-8809a732d51a req-9e25d0fe-0a1c-4bf4-8ac7-8755dc20b17d service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] No waiting events found dispatching network-vif-plugged-19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:50:50 user nova-compute[73484]: WARNING nova.compute.manager [req-d49029b4-ea9d-4cc6-b697-8809a732d51a req-9e25d0fe-0a1c-4bf4-8ac7-8755dc20b17d service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Received unexpected event network-vif-plugged-19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 for instance with vm_state active and task_state resize_finish.
Aug 14 13:50:50 user nova-compute[73484]: DEBUG nova.compute.manager [req-d49029b4-ea9d-4cc6-b697-8809a732d51a req-9e25d0fe-0a1c-4bf4-8ac7-8755dc20b17d service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Received event network-vif-plugged-19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:50:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d49029b4-ea9d-4cc6-b697-8809a732d51a req-9e25d0fe-0a1c-4bf4-8ac7-8755dc20b17d service nova] Acquiring lock "72f007af-a1e7-4a80-954c-ed12aaf129fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d49029b4-ea9d-4cc6-b697-8809a732d51a req-9e25d0fe-0a1c-4bf4-8ac7-8755dc20b17d service nova] Lock "72f007af-a1e7-4a80-954c-ed12aaf129fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d49029b4-ea9d-4cc6-b697-8809a732d51a req-9e25d0fe-0a1c-4bf4-8ac7-8755dc20b17d service nova] Lock "72f007af-a1e7-4a80-954c-ed12aaf129fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:50 user nova-compute[73484]: DEBUG nova.compute.manager [req-d49029b4-ea9d-4cc6-b697-8809a732d51a req-9e25d0fe-0a1c-4bf4-8ac7-8755dc20b17d service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] No waiting events found dispatching network-vif-plugged-19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:50:50 user nova-compute[73484]: WARNING nova.compute.manager [req-d49029b4-ea9d-4cc6-b697-8809a732d51a req-9e25d0fe-0a1c-4bf4-8ac7-8755dc20b17d service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Received unexpected event network-vif-plugged-19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 for instance with vm_state active and task_state resize_finish.
Aug 14 13:50:50 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance f4f7788c-fcca-47c1-b5b8-72892253982d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:50:50 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 07bac569-8b2c-4555-b4d5-a74f7384630b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:50:50 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance a9d4ec42-3db9-439b-87a7-02bcaab514a4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:50:50 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance c0994bac-3b43-414e-aa81-a9d7198775a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:50:50 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 782c6142-757a-49ae-9292-787a7f1e8a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:50:50 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 03255d24-b6fd-459c-8ac6-f9c4063b54b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:50:50 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 09ba29fd-8161-485c-ba6d-71d24ab086bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:50:50 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 700e95c1-08b0-4613-992b-4314b127e14a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:50:50 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance b43ccb18-6d2d-43f2-a185-bb558d5d6f45 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:50:50 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 86580f0d-dd88-48fb-bce8-dc6f5edc01c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:50:50 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:50:50 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance a54902a5-df8a-473f-9cf1-a112528c3549 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:50:50 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Migration 46f67f47-54df-4173-adbd-c3a2097e9347 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 13:50:50 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 72f007af-a1e7-4a80-954c-ed12aaf129fd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:50:50 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 13:50:50 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 13:50:51 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:50:51 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:50:51 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021051.1275294, 72f007af-a1e7-4a80-954c-ed12aaf129fd => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:50:51 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] VM Resumed (Lifecycle Event)
Aug 14 13:50:51 user nova-compute[73484]: DEBUG nova.compute.manager [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:50:51 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Instance running successfully.
Aug 14 13:50:51 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:50:51 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Failed to set time: agent not configured {{(pid=73484) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 14 13:50:51 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-acba6c13-2506-4af9-91f9-57b46bb6c020 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] finish_migration finished successfully. {{(pid=73484) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 14 13:50:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 13:50:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.639s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:51 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:50:51 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 13:50:51 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021051.1303406, 72f007af-a1e7-4a80-954c-ed12aaf129fd => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:50:51 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] VM Started (Lifecycle Event)
Aug 14 13:50:51 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:50:51 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:50:51 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 13:50:52 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:53 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:50:53 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:50:53 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:50:53 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:50:53 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:50:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:53 user nova-compute[73484]: INFO nova.compute.manager [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Shelving
Aug 14 13:50:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:53 user nova-compute[73484]: DEBUG nova.compute.manager [req-62ab9f24-13ed-4c3e-b194-d0feb464b1db req-5a09ee2f-b954-4aec-8136-6eaffc3d7447 service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Received event network-vif-unplugged-8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:50:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-62ab9f24-13ed-4c3e-b194-d0feb464b1db req-5a09ee2f-b954-4aec-8136-6eaffc3d7447 service nova] Acquiring lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-62ab9f24-13ed-4c3e-b194-d0feb464b1db req-5a09ee2f-b954-4aec-8136-6eaffc3d7447 service nova] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-62ab9f24-13ed-4c3e-b194-d0feb464b1db req-5a09ee2f-b954-4aec-8136-6eaffc3d7447 service nova] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:54 user nova-compute[73484]: DEBUG nova.compute.manager [req-62ab9f24-13ed-4c3e-b194-d0feb464b1db req-5a09ee2f-b954-4aec-8136-6eaffc3d7447 service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] No waiting events found dispatching network-vif-unplugged-8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:50:54 user nova-compute[73484]: WARNING nova.compute.manager [req-62ab9f24-13ed-4c3e-b194-d0feb464b1db req-5a09ee2f-b954-4aec-8136-6eaffc3d7447 service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Received unexpected event network-vif-unplugged-8f0b7e99-89d1-4234-a552-e92df188cd4e for instance with vm_state active and task_state shelving.
Aug 14 13:50:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:54 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Instance destroyed successfully.
Aug 14 13:50:54 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Beginning cold snapshot process
Aug 14 13:50:54 user nova-compute[73484]: DEBUG nova.privsep.utils [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73484) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 13:50:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk /opt/stack/data/nova/instances/snapshots/tmpbebwuhlh/97f5af8296114694a16cfb46d8ece0aa {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:50:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk /opt/stack/data/nova/instances/snapshots/tmpbebwuhlh/97f5af8296114694a16cfb46d8ece0aa" returned: 0 in 0.981s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:50:55 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Snapshot extracted, beginning image upload
Aug 14 13:50:56 user nova-compute[73484]: DEBUG nova.compute.manager [req-dc4b81b2-e824-45d8-824d-aa71d0c1a3a4 req-e3f7e634-4c50-4712-be6d-9d6b0fb5c8c5 service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Received event network-vif-plugged-8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:50:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-dc4b81b2-e824-45d8-824d-aa71d0c1a3a4 req-e3f7e634-4c50-4712-be6d-9d6b0fb5c8c5 service nova] Acquiring lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:50:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-dc4b81b2-e824-45d8-824d-aa71d0c1a3a4 req-e3f7e634-4c50-4712-be6d-9d6b0fb5c8c5 service nova] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:50:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-dc4b81b2-e824-45d8-824d-aa71d0c1a3a4 req-e3f7e634-4c50-4712-be6d-9d6b0fb5c8c5 service nova] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:50:56 user nova-compute[73484]: DEBUG nova.compute.manager [req-dc4b81b2-e824-45d8-824d-aa71d0c1a3a4 req-e3f7e634-4c50-4712-be6d-9d6b0fb5c8c5 service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] No waiting events found dispatching network-vif-plugged-8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:50:56 user nova-compute[73484]: WARNING nova.compute.manager [req-dc4b81b2-e824-45d8-824d-aa71d0c1a3a4 req-e3f7e634-4c50-4712-be6d-9d6b0fb5c8c5 service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Received unexpected event network-vif-plugged-8f0b7e99-89d1-4234-a552-e92df188cd4e for instance with vm_state active and task_state shelving_image_uploading.
Aug 14 13:50:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:59 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Snapshot image upload complete
Aug 14 13:50:59 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:50:59 user nova-compute[73484]: INFO nova.compute.manager [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Shelve offloading
Aug 14 13:50:59 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Instance destroyed successfully.
Aug 14 13:50:59 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:50:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "refresh_cache-86580f0d-dd88-48fb-bce8-dc6f5edc01c6" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:50:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquired lock "refresh_cache-86580f0d-dd88-48fb-bce8-dc6f5edc01c6" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:50:59 user nova-compute[73484]: DEBUG nova.network.neutron [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:50:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:50:59 user nova-compute[73484]: DEBUG nova.network.neutron [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Updating instance_info_cache with network_info: [{"id": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "address": "fa:16:3e:20:8b:68", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0b7e99-89", "ovs_interfaceid": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:50:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Releasing lock "refresh_cache-86580f0d-dd88-48fb-bce8-dc6f5edc01c6" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:51:00 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Instance destroyed successfully.
Aug 14 13:51:00 user nova-compute[73484]: DEBUG nova.objects.instance [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lazy-loading 'resources' on Instance uuid 86580f0d-dd88-48fb-bce8-dc6f5edc01c6 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:51:00 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:48:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1425856117',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1425856117',id=30,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbnYbAG6NpHt2DOEAzWMWcC4//dmDDjdoohHJ9Fhcgro4zefbJFRczoX4bLxibnHjgSCxNgQI7+hK/klX7r00Q0wzHK+QIzN2xNAdcO22IDBNUHlOwSiIg074+PXIFxAg==',key_name='tempest-keypair-396971079',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:49:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0c1ccc7c1aaf497da5f1d325d79e9301',ramdisk_id='',reservation_id='r-ypie00bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1730232968',owner_user_name='tempest-AttachVolumeShelveTestJSON-1730232968-project-member',shelved_at='2023-08-14T13:50:59.026192',shelved_host='user',shelved_image_id='4798089e-db5f-45e6-8a31-ecd7e9b1867f'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:50:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bda36df8b1f64c7894bfee5da258c1e6',uuid=86580f0d-dd88-48fb-bce8-dc6f5edc01c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "address": "fa:16:3e:20:8b:68", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0b7e99-89", "ovs_interfaceid": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:51:00 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Converting VIF {"id": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "address": "fa:16:3e:20:8b:68", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0b7e99-89", "ovs_interfaceid": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:51:00 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:8b:68,bridge_name='br-int',has_traffic_filtering=True,id=8f0b7e99-89d1-4234-a552-e92df188cd4e,network=Network(cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f0b7e99-89') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:51:00 user nova-compute[73484]: DEBUG os_vif [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:8b:68,bridge_name='br-int',has_traffic_filtering=True,id=8f0b7e99-89d1-4234-a552-e92df188cd4e,network=Network(cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f0b7e99-89') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:51:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f0b7e99-89, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:51:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:51:00 user nova-compute[73484]: DEBUG nova.compute.manager [req-0796a319-7d57-4e53-b625-cf2ba212d3a6 req-5caf5c86-909c-4f2f-917a-417d67218981 service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Received event network-changed-8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:51:00 user nova-compute[73484]: DEBUG nova.compute.manager [req-0796a319-7d57-4e53-b625-cf2ba212d3a6 req-5caf5c86-909c-4f2f-917a-417d67218981 service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Refreshing instance network info cache due to event network-changed-8f0b7e99-89d1-4234-a552-e92df188cd4e. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:51:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0796a319-7d57-4e53-b625-cf2ba212d3a6 req-5caf5c86-909c-4f2f-917a-417d67218981 service nova] Acquiring lock "refresh_cache-86580f0d-dd88-48fb-bce8-dc6f5edc01c6" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:51:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0796a319-7d57-4e53-b625-cf2ba212d3a6 req-5caf5c86-909c-4f2f-917a-417d67218981 service nova] Acquired lock "refresh_cache-86580f0d-dd88-48fb-bce8-dc6f5edc01c6" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:51:00 user nova-compute[73484]: DEBUG nova.network.neutron [req-0796a319-7d57-4e53-b625-cf2ba212d3a6 req-5caf5c86-909c-4f2f-917a-417d67218981 service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Refreshing network info cache for port 8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:51:00 user nova-compute[73484]: INFO os_vif [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:8b:68,bridge_name='br-int',has_traffic_filtering=True,id=8f0b7e99-89d1-4234-a552-e92df188cd4e,network=Network(cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f0b7e99-89')
Aug 14 13:51:00 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Deleting instance files /opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6_del
Aug 14 13:51:00 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Deletion of /opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6_del complete
Aug 14 13:51:00 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Deleted allocations for instance 86580f0d-dd88-48fb-bce8-dc6f5edc01c6
Aug 14 13:51:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:51:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:51:00 user nova-compute[73484]: DEBUG nova.objects.instance [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lazy-loading 'numa_topology' on Instance uuid 86580f0d-dd88-48fb-bce8-dc6f5edc01c6 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:51:01 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:51:01 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:51:01 user nova-compute[73484]: DEBUG nova.network.neutron [req-0796a319-7d57-4e53-b625-cf2ba212d3a6 req-5caf5c86-909c-4f2f-917a-417d67218981 service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Updated VIF entry in instance network info cache for port 8f0b7e99-89d1-4234-a552-e92df188cd4e. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:51:01 user nova-compute[73484]: DEBUG nova.network.neutron [req-0796a319-7d57-4e53-b625-cf2ba212d3a6 req-5caf5c86-909c-4f2f-917a-417d67218981 service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Updating instance_info_cache with network_info: [{"id": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "address": "fa:16:3e:20:8b:68", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8f0b7e99-89", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:51:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0796a319-7d57-4e53-b625-cf2ba212d3a6 req-5caf5c86-909c-4f2f-917a-417d67218981 service nova] Releasing lock "refresh_cache-86580f0d-dd88-48fb-bce8-dc6f5edc01c6" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:51:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.514s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:51:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0c4f5955-e019-4037-b9bf-b509615252db tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.821s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:51:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:09 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692021054.5033143, 86580f0d-dd88-48fb-bce8-dc6f5edc01c6 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:51:09 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] VM Stopped (Lifecycle Event)
Aug 14 13:51:09 user nova-compute[73484]: DEBUG nova.compute.manager [None req-539a8326-9bce-4e3c-8dcf-9b30202468e0 None None] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:51:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquiring lock "09ba29fd-8161-485c-ba6d-71d24ab086bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:51:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:51:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquiring lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:51:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:51:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:51:20 user nova-compute[73484]: INFO nova.compute.manager [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Terminating instance
Aug 14 13:51:20 user nova-compute[73484]: DEBUG nova.compute.manager [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:51:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG nova.compute.manager [req-08d80a78-4e29-4a1a-b1c2-31dd548161fc req-c036f61c-353e-4af2-a63f-73778d2ea93a service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Received event network-vif-unplugged-0b54646a-71ed-4087-adf7-66645e7d2907 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-08d80a78-4e29-4a1a-b1c2-31dd548161fc req-c036f61c-353e-4af2-a63f-73778d2ea93a service nova] Acquiring lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-08d80a78-4e29-4a1a-b1c2-31dd548161fc req-c036f61c-353e-4af2-a63f-73778d2ea93a service nova] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-08d80a78-4e29-4a1a-b1c2-31dd548161fc req-c036f61c-353e-4af2-a63f-73778d2ea93a service nova] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG nova.compute.manager [req-08d80a78-4e29-4a1a-b1c2-31dd548161fc req-c036f61c-353e-4af2-a63f-73778d2ea93a service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] No waiting events found dispatching network-vif-unplugged-0b54646a-71ed-4087-adf7-66645e7d2907 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG nova.compute.manager [req-08d80a78-4e29-4a1a-b1c2-31dd548161fc req-c036f61c-353e-4af2-a63f-73778d2ea93a service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Received event network-vif-unplugged-0b54646a-71ed-4087-adf7-66645e7d2907 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:51:21 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Instance destroyed successfully.
Aug 14 13:51:21 user nova-compute[73484]: DEBUG nova.objects.instance [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lazy-loading 'resources' on Instance uuid 09ba29fd-8161-485c-ba6d-71d24ab086bc {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:42:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1361765687',display_name='tempest-ServerActionsTestOtherB-server-1361765687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1361765687',id=20,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF57s7WDcr5LrA3gfxfpgDNJt6UZ/rZhkiS+Nfi/DIO/C85ZFU7Y17ny/O/CEqdXEP2/mm1AA46PPquOjl5qC1/2wZc0eZa1Tjpvt/2IPyALMO4YPxf1Hkqx4YMdA9qx2g==',key_name='tempest-keypair-345523160',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:48:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a07a8a61d3f14061b44b8f37968c54e9',ramdisk_id='',reservation_id='r-b3zcr056',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1221611824',owner_user_name='tempest-ServerActionsTestOtherB-1221611824-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:48:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55e77cc182bc4ec79429025c6a9f14af',uuid=09ba29fd-8161-485c-ba6d-71d24ab086bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b54646a-71ed-4087-adf7-66645e7d2907", "address": "fa:16:3e:30:6a:b2", "network": {"id": "a417bb93-b1ed-47a4-be83-6679c2ea34b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872770450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07a8a61d3f14061b44b8f37968c54e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b54646a-71", "ovs_interfaceid": "0b54646a-71ed-4087-adf7-66645e7d2907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Converting VIF {"id": "0b54646a-71ed-4087-adf7-66645e7d2907", "address": "fa:16:3e:30:6a:b2", "network": {"id": "a417bb93-b1ed-47a4-be83-6679c2ea34b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-872770450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a07a8a61d3f14061b44b8f37968c54e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b54646a-71", "ovs_interfaceid": "0b54646a-71ed-4087-adf7-66645e7d2907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:6a:b2,bridge_name='br-int',has_traffic_filtering=True,id=0b54646a-71ed-4087-adf7-66645e7d2907,network=Network(a417bb93-b1ed-47a4-be83-6679c2ea34b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b54646a-71') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG os_vif [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:6a:b2,bridge_name='br-int',has_traffic_filtering=True,id=0b54646a-71ed-4087-adf7-66645e7d2907,network=Network(a417bb93-b1ed-47a4-be83-6679c2ea34b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b54646a-71') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b54646a-71, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:21 user nova-compute[73484]: INFO os_vif [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:6a:b2,bridge_name='br-int',has_traffic_filtering=True,id=0b54646a-71ed-4087-adf7-66645e7d2907,network=Network(a417bb93-b1ed-47a4-be83-6679c2ea34b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b54646a-71')
Aug 14 13:51:21 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vMjRCghr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:51:21 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:51:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6baa498b-5f56-4781-b86c-c2769e18c3a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d02786-de9d-4096-b53b-e5b8014f9056]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:51:21 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:51:21 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:51:21 user nova-compute[73484]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)
Aug 14 13:51:21 user nova-compute[73484]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)
Aug 14 13:51:21 user nova-compute[73484]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:51:21 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:51:21 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:51:21 user nova-compute[73484]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 (non-flash)
Aug 14 13:51:21 user nova-compute[73484]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)
Aug 14 13:51:21 user nova-compute[73484]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)
Aug 14 13:51:21 user nova-compute[73484]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:51:21 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4951c8ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781'): ({'sde'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Removing single pathed devices sde {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2baafbf-49e5-4b83-b0ec-cadad3dcb470]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f4f576-50b4-47f3-80d4-663554a9823c]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Flushing IO for device /dev/sde {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c660507-9d6f-4cd8-8fb8-05e89ccb1725]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1279119-34fd-45d0-b718-ac7741f7ede2]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] SCSI volumes sde have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e711eb0-c1e7-4bf3-ac2b-dd81d249baf7]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da0a805-3f7b-4173-9e50-af23811c2285]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781, portal: 172.16.0.220,3260]
Aug 14 13:51:21 user nova-compute[73484]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781, portal: 172.16.0.220,3260] successful.
Aug 14 13:51:21 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b76da63f-391a-4087-8ffd-19c9648cd781 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe3e783-cae1-439f-9ad0-571d37c52fb3]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] <== disconnect_volume: return (315ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:51:21 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Deleting instance files /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc_del
Aug 14 13:51:21 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Deletion of /opt/stack/data/nova/instances/09ba29fd-8161-485c-ba6d-71d24ab086bc_del complete
Aug 14 13:51:21 user nova-compute[73484]: INFO nova.compute.manager [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 14 13:51:21 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:51:21 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:51:22 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:51:22 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Took 0.94 seconds to deallocate network for instance.
Aug 14 13:51:23 user nova-compute[73484]: DEBUG nova.compute.manager [req-5048d241-31d4-448c-8fe6-cc12be0f5d05 req-60a22197-5882-4221-ae08-c2a2faac1209 service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Received event network-vif-plugged-0b54646a-71ed-4087-adf7-66645e7d2907 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:51:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5048d241-31d4-448c-8fe6-cc12be0f5d05 req-60a22197-5882-4221-ae08-c2a2faac1209 service nova] Acquiring lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:51:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5048d241-31d4-448c-8fe6-cc12be0f5d05 req-60a22197-5882-4221-ae08-c2a2faac1209 service nova] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:51:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5048d241-31d4-448c-8fe6-cc12be0f5d05 req-60a22197-5882-4221-ae08-c2a2faac1209 service nova] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:51:23 user nova-compute[73484]: DEBUG nova.compute.manager [req-5048d241-31d4-448c-8fe6-cc12be0f5d05 req-60a22197-5882-4221-ae08-c2a2faac1209 service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] No waiting events found dispatching network-vif-plugged-0b54646a-71ed-4087-adf7-66645e7d2907 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:51:23 user nova-compute[73484]: WARNING nova.compute.manager [req-5048d241-31d4-448c-8fe6-cc12be0f5d05 req-60a22197-5882-4221-ae08-c2a2faac1209 service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Received unexpected event network-vif-plugged-0b54646a-71ed-4087-adf7-66645e7d2907 for instance with vm_state active and task_state deleting.
Aug 14 13:51:23 user nova-compute[73484]: DEBUG nova.compute.manager [req-5048d241-31d4-448c-8fe6-cc12be0f5d05 req-60a22197-5882-4221-ae08-c2a2faac1209 service nova] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Received event network-vif-deleted-0b54646a-71ed-4087-adf7-66645e7d2907 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:51:23 user nova-compute[73484]: INFO nova.compute.manager [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Took 0.93 seconds to detach 1 volumes for instance.
Aug 14 13:51:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:51:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:51:24 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:51:24 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:51:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.428s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:51:24 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Deleted allocations for instance 09ba29fd-8161-485c-ba6d-71d24ab086bc
Aug 14 13:51:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b0b1d2db-c9fe-47ed-98f0-33e651fa61f0 tempest-ServerActionsTestOtherB-1221611824 tempest-ServerActionsTestOtherB-1221611824-project-member] Lock "09ba29fd-8161-485c-ba6d-71d24ab086bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.706s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:51:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:51:36 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692021081.453905, 09ba29fd-8161-485c-ba6d-71d24ab086bc => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:51:36 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] VM Stopped (Lifecycle Event)
Aug 14 13:51:36 user nova-compute[73484]: DEBUG nova.compute.manager [None req-382acf3d-8ae5-485a-b319-c014fe55ad69 None None] [instance: 09ba29fd-8161-485c-ba6d-71d24ab086bc] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:51:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:51:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 13:51:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:51:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:51:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:36 user nova-compute[73484]: DEBUG nova.compute.manager [req-e5a9b76a-d7b1-4a4a-8353-290de371fc07 req-6a3052c8-db1b-424d-8255-173cdf434238 service nova] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Received event network-changed-394f5b05-1b37-43b0-adc5-070c7a914bd6 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:51:36 user nova-compute[73484]: DEBUG nova.compute.manager [req-e5a9b76a-d7b1-4a4a-8353-290de371fc07 req-6a3052c8-db1b-424d-8255-173cdf434238 service nova] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Refreshing instance network info cache due to event network-changed-394f5b05-1b37-43b0-adc5-070c7a914bd6. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:51:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e5a9b76a-d7b1-4a4a-8353-290de371fc07 req-6a3052c8-db1b-424d-8255-173cdf434238 service nova] Acquiring lock "refresh_cache-b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:51:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e5a9b76a-d7b1-4a4a-8353-290de371fc07 req-6a3052c8-db1b-424d-8255-173cdf434238 service nova] Acquired lock "refresh_cache-b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:51:36 user nova-compute[73484]: DEBUG nova.network.neutron [req-e5a9b76a-d7b1-4a4a-8353-290de371fc07 req-6a3052c8-db1b-424d-8255-173cdf434238 service nova] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Refreshing network info cache for port 394f5b05-1b37-43b0-adc5-070c7a914bd6 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:51:37 user nova-compute[73484]: DEBUG nova.network.neutron [req-e5a9b76a-d7b1-4a4a-8353-290de371fc07 req-6a3052c8-db1b-424d-8255-173cdf434238 service nova] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Updated VIF entry in instance network info cache for port 394f5b05-1b37-43b0-adc5-070c7a914bd6. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:51:37 user nova-compute[73484]: DEBUG nova.network.neutron [req-e5a9b76a-d7b1-4a4a-8353-290de371fc07 req-6a3052c8-db1b-424d-8255-173cdf434238 service nova] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Updating instance_info_cache with network_info: [{"id": "394f5b05-1b37-43b0-adc5-070c7a914bd6", "address": "fa:16:3e:f3:39:1f", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap394f5b05-1b", "ovs_interfaceid": "394f5b05-1b37-43b0-adc5-070c7a914bd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:51:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e5a9b76a-d7b1-4a4a-8353-290de371fc07 req-6a3052c8-db1b-424d-8255-173cdf434238 service nova] Releasing lock "refresh_cache-b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:51:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3f9f7ea4-5b1b-418d-8535-a4eba2289acb tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:51:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3f9f7ea4-5b1b-418d-8535-a4eba2289acb tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:51:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3f9f7ea4-5b1b-418d-8535-a4eba2289acb tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:51:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3f9f7ea4-5b1b-418d-8535-a4eba2289acb tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:51:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3f9f7ea4-5b1b-418d-8535-a4eba2289acb tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:51:37 user nova-compute[73484]: INFO nova.compute.manager [None req-3f9f7ea4-5b1b-418d-8535-a4eba2289acb tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Terminating instance
Aug 14 13:51:37 user nova-compute[73484]: DEBUG nova.compute.manager [None req-3f9f7ea4-5b1b-418d-8535-a4eba2289acb tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:51:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:38 user nova-compute[73484]: DEBUG nova.compute.manager [req-9c62c906-e30c-4879-ad45-8688eaa8d6b1 req-edf0c215-0f51-4e31-8349-7989d960ad5e service nova] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Received event network-vif-unplugged-394f5b05-1b37-43b0-adc5-070c7a914bd6 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:51:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-9c62c906-e30c-4879-ad45-8688eaa8d6b1 req-edf0c215-0f51-4e31-8349-7989d960ad5e service nova] Acquiring lock "b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:51:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-9c62c906-e30c-4879-ad45-8688eaa8d6b1 req-edf0c215-0f51-4e31-8349-7989d960ad5e service nova] Lock "b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:51:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-9c62c906-e30c-4879-ad45-8688eaa8d6b1 req-edf0c215-0f51-4e31-8349-7989d960ad5e service nova] Lock "b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:51:38 user nova-compute[73484]: DEBUG nova.compute.manager [req-9c62c906-e30c-4879-ad45-8688eaa8d6b1 req-edf0c215-0f51-4e31-8349-7989d960ad5e service nova] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] No waiting events found dispatching network-vif-unplugged-394f5b05-1b37-43b0-adc5-070c7a914bd6 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:51:38 user nova-compute[73484]: DEBUG nova.compute.manager [req-9c62c906-e30c-4879-ad45-8688eaa8d6b1 req-edf0c215-0f51-4e31-8349-7989d960ad5e service nova] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Received event network-vif-unplugged-394f5b05-1b37-43b0-adc5-070c7a914bd6 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:51:38 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Instance destroyed successfully.
Aug 14 13:51:38 user nova-compute[73484]: DEBUG nova.objects.instance [None req-3f9f7ea4-5b1b-418d-8535-a4eba2289acb tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lazy-loading 'resources' on Instance uuid b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:51:38 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-3f9f7ea4-5b1b-418d-8535-a4eba2289acb tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:49:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-884455025',display_name='tempest-AttachVolumeNegativeTest-server-884455025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-884455025',id=31,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOh6W7bffdduXBmQ4kNMsFsrBazgeuuIEyIb5bubZKcNhtkn4rrVlhWF3BTgMfhR9n3ppEk8JAYTmL3VRNV3aM0RuiKR6EFBn2ZxgMpXm/0x0vL+hdFXEM+/g+Ez4NGWTw==',key_name='tempest-keypair-116814291',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:49:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f404795fcace4922a10abdb33740e87d',ramdisk_id='',reservation_id='r-xs1m3p1k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1043074889',owner_user_name='tempest-AttachVolumeNegativeTest-1043074889-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:49:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3ccc9cc867644d9bc040e9dfd4eb231',uuid=b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "394f5b05-1b37-43b0-adc5-070c7a914bd6", "address": "fa:16:3e:f3:39:1f", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap394f5b05-1b", "ovs_interfaceid": "394f5b05-1b37-43b0-adc5-070c7a914bd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:51:38 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-3f9f7ea4-5b1b-418d-8535-a4eba2289acb tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Converting VIF {"id": "394f5b05-1b37-43b0-adc5-070c7a914bd6", "address": "fa:16:3e:f3:39:1f", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap394f5b05-1b", "ovs_interfaceid": "394f5b05-1b37-43b0-adc5-070c7a914bd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:51:38 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-3f9f7ea4-5b1b-418d-8535-a4eba2289acb tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:39:1f,bridge_name='br-int',has_traffic_filtering=True,id=394f5b05-1b37-43b0-adc5-070c7a914bd6,network=Network(10d4738f-25c6-4995-a4b7-6fbee86f070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap394f5b05-1b') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:51:38 user nova-compute[73484]: DEBUG os_vif [None req-3f9f7ea4-5b1b-418d-8535-a4eba2289acb tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:39:1f,bridge_name='br-int',has_traffic_filtering=True,id=394f5b05-1b37-43b0-adc5-070c7a914bd6,network=Network(10d4738f-25c6-4995-a4b7-6fbee86f070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap394f5b05-1b') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:51:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap394f5b05-1b, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:51:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:51:38 user nova-compute[73484]: INFO os_vif [None req-3f9f7ea4-5b1b-418d-8535-a4eba2289acb tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:39:1f,bridge_name='br-int',has_traffic_filtering=True,id=394f5b05-1b37-43b0-adc5-070c7a914bd6,network=Network(10d4738f-25c6-4995-a4b7-6fbee86f070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap394f5b05-1b')
Aug 14 13:51:38 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-3f9f7ea4-5b1b-418d-8535-a4eba2289acb tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Deleting instance files /opt/stack/data/nova/instances/b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25_del
Aug 14 13:51:38 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-3f9f7ea4-5b1b-418d-8535-a4eba2289acb tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Deletion of /opt/stack/data/nova/instances/b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25_del complete
Aug 14 13:51:38 user nova-compute[73484]: INFO nova.compute.manager [None req-3f9f7ea4-5b1b-418d-8535-a4eba2289acb tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Took 0.70 seconds to destroy the instance on the hypervisor.
Aug 14 13:51:38 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-3f9f7ea4-5b1b-418d-8535-a4eba2289acb tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:51:38 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:51:38 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:51:39 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:51:39 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Took 0.96 seconds to deallocate network for instance.
Aug 14 13:51:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-c23bc5cd-8114-495e-b02c-0643ee3bcd9e req-bd6cbc4e-47bd-42f5-b7b1-acfa9c9c2fd6 service nova] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Received event network-vif-deleted-394f5b05-1b37-43b0-adc5-070c7a914bd6 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:51:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3f9f7ea4-5b1b-418d-8535-a4eba2289acb tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:51:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3f9f7ea4-5b1b-418d-8535-a4eba2289acb tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:51:39 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-3f9f7ea4-5b1b-418d-8535-a4eba2289acb tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:51:39 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-3f9f7ea4-5b1b-418d-8535-a4eba2289acb tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:51:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3f9f7ea4-5b1b-418d-8535-a4eba2289acb tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:51:39 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-3f9f7ea4-5b1b-418d-8535-a4eba2289acb tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Deleted allocations for instance b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25
Aug 14 13:51:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3f9f7ea4-5b1b-418d-8535-a4eba2289acb tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.197s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:51:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-15472b3b-d453-4c22-8416-0e807ea81daf req-a4311c87-b736-4bc0-8f1e-e377b17f8675 service nova] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Received event network-vif-plugged-394f5b05-1b37-43b0-adc5-070c7a914bd6 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:51:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-15472b3b-d453-4c22-8416-0e807ea81daf req-a4311c87-b736-4bc0-8f1e-e377b17f8675 service nova] Acquiring lock "b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:51:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-15472b3b-d453-4c22-8416-0e807ea81daf req-a4311c87-b736-4bc0-8f1e-e377b17f8675 service nova] Lock "b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:51:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-15472b3b-d453-4c22-8416-0e807ea81daf req-a4311c87-b736-4bc0-8f1e-e377b17f8675 service nova] Lock "b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:51:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-15472b3b-d453-4c22-8416-0e807ea81daf req-a4311c87-b736-4bc0-8f1e-e377b17f8675 service nova] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] No waiting events found dispatching network-vif-plugged-394f5b05-1b37-43b0-adc5-070c7a914bd6 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:51:40 user nova-compute[73484]: WARNING nova.compute.manager [req-15472b3b-d453-4c22-8416-0e807ea81daf req-a4311c87-b736-4bc0-8f1e-e377b17f8675 service nova] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Received unexpected event network-vif-plugged-394f5b05-1b37-43b0-adc5-070c7a914bd6 for instance with vm_state deleted and task_state None.
Aug 14 13:51:41 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:51:42 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:51:42 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 13:51:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-a9d4ec42-3db9-439b-87a7-02bcaab514a4" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:51:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-a9d4ec42-3db9-439b-87a7-02bcaab514a4" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:51:42 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 13:51:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:43 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Updating instance_info_cache with network_info: [{"id": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "address": "fa:16:3e:a8:f5:8b", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa109f4ac-a7", "ovs_interfaceid": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:51:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-a9d4ec42-3db9-439b-87a7-02bcaab514a4" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:51:43 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 13:51:43 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:51:43 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 13:51:45 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:51:46 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:51:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:51:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:51:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:51:46 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 13:51:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:51:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:51:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:51:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:51:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:51:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:51:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:51:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:51:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:51:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:51:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:51:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:51:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:51:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:51:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:51:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:51:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:51:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:51:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:51:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:51:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:51:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:51:48 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:51:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:51:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:51:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:51:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:51:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:51:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:51:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:51:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:51:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:51:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b43ccb18-6d2d-43f2-a185-bb558d5d6f45/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:51:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b43ccb18-6d2d-43f2-a185-bb558d5d6f45/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:51:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b43ccb18-6d2d-43f2-a185-bb558d5d6f45/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:51:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b43ccb18-6d2d-43f2-a185-bb558d5d6f45/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:51:50 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:51:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:51:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:51:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:51:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:51:51 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:51:51 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:51:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=7251MB free_disk=25.201820373535156GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 13:51:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:51:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:51:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Applying migration context for instance 72f007af-a1e7-4a80-954c-ed12aaf129fd as it has an incoming, in-progress migration 46f67f47-54df-4173-adbd-c3a2097e9347. Migration status is finished {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 13:51:51 user nova-compute[73484]: INFO nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Updating resource usage from migration 46f67f47-54df-4173-adbd-c3a2097e9347
Aug 14 13:51:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance f4f7788c-fcca-47c1-b5b8-72892253982d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:51:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 07bac569-8b2c-4555-b4d5-a74f7384630b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:51:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance a9d4ec42-3db9-439b-87a7-02bcaab514a4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:51:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance c0994bac-3b43-414e-aa81-a9d7198775a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:51:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 782c6142-757a-49ae-9292-787a7f1e8a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:51:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 03255d24-b6fd-459c-8ac6-f9c4063b54b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:51:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 700e95c1-08b0-4613-992b-4314b127e14a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:51:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance b43ccb18-6d2d-43f2-a185-bb558d5d6f45 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:51:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance a54902a5-df8a-473f-9cf1-a112528c3549 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:51:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Migration 46f67f47-54df-4173-adbd-c3a2097e9347 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 13:51:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 72f007af-a1e7-4a80-954c-ed12aaf129fd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:51:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 13:51:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 13:51:51 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:51:51 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:51:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 13:51:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.565s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:51:52 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:51:52 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:51:52 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:51:53 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692021098.3094008, b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:51:53 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] VM Stopped (Lifecycle Event)
Aug 14 13:51:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:51:53 user nova-compute[73484]: DEBUG nova.compute.manager [None req-871ded1d-8e39-460a-acd3-2dc31cb0c59f None None] [instance: b8f8a97f-1fa4-4afd-9313-c2a5acfa1d25] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:51:53 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:51:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:01 user nova-compute[73484]: INFO nova.compute.manager [None req-924edb8c-f118-484d-a7de-dedeeba49707 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Unrescuing
Aug 14 13:52:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-924edb8c-f118-484d-a7de-dedeeba49707 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "refresh_cache-782c6142-757a-49ae-9292-787a7f1e8a23" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:52:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-924edb8c-f118-484d-a7de-dedeeba49707 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquired lock "refresh_cache-782c6142-757a-49ae-9292-787a7f1e8a23" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:52:01 user nova-compute[73484]: DEBUG nova.network.neutron [None req-924edb8c-f118-484d-a7de-dedeeba49707 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:52:02 user nova-compute[73484]: DEBUG nova.network.neutron [None req-924edb8c-f118-484d-a7de-dedeeba49707 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Updating instance_info_cache with network_info: [{"id": "2246e004-4f6b-449d-91b2-8e67b4f51006", "address": "fa:16:3e:31:2a:06", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2246e004-4f", "ovs_interfaceid": "2246e004-4f6b-449d-91b2-8e67b4f51006", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:52:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-924edb8c-f118-484d-a7de-dedeeba49707 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Releasing lock "refresh_cache-782c6142-757a-49ae-9292-787a7f1e8a23" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:52:02 user nova-compute[73484]: DEBUG nova.objects.instance [None req-924edb8c-f118-484d-a7de-dedeeba49707 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'flavor' on Instance uuid 782c6142-757a-49ae-9292-787a7f1e8a23 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:52:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:02 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Instance destroyed successfully.
Aug 14 13:52:03 user nova-compute[73484]: INFO nova.compute.manager [None req-73a462b4-0606-4cfc-89cc-388d0218d177 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Unrescuing
Aug 14 13:52:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-73a462b4-0606-4cfc-89cc-388d0218d177 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "refresh_cache-b43ccb18-6d2d-43f2-a185-bb558d5d6f45" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:52:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-73a462b4-0606-4cfc-89cc-388d0218d177 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquired lock "refresh_cache-b43ccb18-6d2d-43f2-a185-bb558d5d6f45" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:52:03 user nova-compute[73484]: DEBUG nova.network.neutron [None req-73a462b4-0606-4cfc-89cc-388d0218d177 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:52:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:03 user nova-compute[73484]: DEBUG nova.compute.manager [req-24e2a10e-7bed-4210-8cc1-457b7f21ac8e req-1493de25-ea11-461c-8111-fad0e197b8dd service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Received event network-vif-unplugged-2246e004-4f6b-449d-91b2-8e67b4f51006 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:52:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-24e2a10e-7bed-4210-8cc1-457b7f21ac8e req-1493de25-ea11-461c-8111-fad0e197b8dd service nova] Acquiring lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-24e2a10e-7bed-4210-8cc1-457b7f21ac8e req-1493de25-ea11-461c-8111-fad0e197b8dd service nova] Lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-24e2a10e-7bed-4210-8cc1-457b7f21ac8e req-1493de25-ea11-461c-8111-fad0e197b8dd service nova] Lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:03 user nova-compute[73484]: DEBUG nova.compute.manager [req-24e2a10e-7bed-4210-8cc1-457b7f21ac8e req-1493de25-ea11-461c-8111-fad0e197b8dd service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] No waiting events found dispatching network-vif-unplugged-2246e004-4f6b-449d-91b2-8e67b4f51006 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:52:03 user nova-compute[73484]: WARNING nova.compute.manager [req-24e2a10e-7bed-4210-8cc1-457b7f21ac8e req-1493de25-ea11-461c-8111-fad0e197b8dd service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Received unexpected event network-vif-unplugged-2246e004-4f6b-449d-91b2-8e67b4f51006 for instance with vm_state rescued and task_state unrescuing.
Aug 14 13:52:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:04 user nova-compute[73484]: DEBUG nova.network.neutron [None req-73a462b4-0606-4cfc-89cc-388d0218d177 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Updating instance_info_cache with network_info: [{"id": "ea301764-93d8-4c55-a51f-5e50918be405", "address": "fa:16:3e:ff:7c:5c", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea301764-93", "ovs_interfaceid": "ea301764-93d8-4c55-a51f-5e50918be405", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:52:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-73a462b4-0606-4cfc-89cc-388d0218d177 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Releasing lock "refresh_cache-b43ccb18-6d2d-43f2-a185-bb558d5d6f45" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:52:04 user nova-compute[73484]: DEBUG nova.objects.instance [None req-73a462b4-0606-4cfc-89cc-388d0218d177 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lazy-loading 'flavor' on Instance uuid b43ccb18-6d2d-43f2-a185-bb558d5d6f45 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:52:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:05 user nova-compute[73484]: DEBUG nova.compute.manager [req-1f81d368-8676-41bb-9eec-a58601ea1b7f req-e268a50b-4e8a-4ac8-97c6-fb55fbda50ec service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Received event network-vif-unplugged-ea301764-93d8-4c55-a51f-5e50918be405 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:52:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1f81d368-8676-41bb-9eec-a58601ea1b7f req-e268a50b-4e8a-4ac8-97c6-fb55fbda50ec service nova] Acquiring lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1f81d368-8676-41bb-9eec-a58601ea1b7f req-e268a50b-4e8a-4ac8-97c6-fb55fbda50ec service nova] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1f81d368-8676-41bb-9eec-a58601ea1b7f req-e268a50b-4e8a-4ac8-97c6-fb55fbda50ec service nova] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:05 user nova-compute[73484]: DEBUG nova.compute.manager [req-1f81d368-8676-41bb-9eec-a58601ea1b7f req-e268a50b-4e8a-4ac8-97c6-fb55fbda50ec service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] No waiting events found dispatching network-vif-unplugged-ea301764-93d8-4c55-a51f-5e50918be405 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:52:05 user nova-compute[73484]: WARNING nova.compute.manager [req-1f81d368-8676-41bb-9eec-a58601ea1b7f req-e268a50b-4e8a-4ac8-97c6-fb55fbda50ec service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Received unexpected event network-vif-unplugged-ea301764-93d8-4c55-a51f-5e50918be405 for instance with vm_state rescued and task_state unrescuing.
Aug 14 13:52:05 user nova-compute[73484]: DEBUG nova.compute.manager [req-8f1b7c51-9aa8-43a6-9bc1-f8b9f78acdb5 req-52f8893a-57a3-4f9a-a44f-367d466c8aed service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Received event network-vif-plugged-2246e004-4f6b-449d-91b2-8e67b4f51006 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:52:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8f1b7c51-9aa8-43a6-9bc1-f8b9f78acdb5 req-52f8893a-57a3-4f9a-a44f-367d466c8aed service nova] Acquiring lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8f1b7c51-9aa8-43a6-9bc1-f8b9f78acdb5 req-52f8893a-57a3-4f9a-a44f-367d466c8aed service nova] Lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8f1b7c51-9aa8-43a6-9bc1-f8b9f78acdb5 req-52f8893a-57a3-4f9a-a44f-367d466c8aed service nova] Lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:05 user nova-compute[73484]: DEBUG nova.compute.manager [req-8f1b7c51-9aa8-43a6-9bc1-f8b9f78acdb5 req-52f8893a-57a3-4f9a-a44f-367d466c8aed service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] No waiting events found dispatching network-vif-plugged-2246e004-4f6b-449d-91b2-8e67b4f51006 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:52:05 user nova-compute[73484]: WARNING nova.compute.manager [req-8f1b7c51-9aa8-43a6-9bc1-f8b9f78acdb5 req-52f8893a-57a3-4f9a-a44f-367d466c8aed service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Received unexpected event network-vif-plugged-2246e004-4f6b-449d-91b2-8e67b4f51006 for instance with vm_state rescued and task_state unrescuing.
Aug 14 13:52:05 user nova-compute[73484]: DEBUG nova.compute.manager [req-8f1b7c51-9aa8-43a6-9bc1-f8b9f78acdb5 req-52f8893a-57a3-4f9a-a44f-367d466c8aed service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Received event network-vif-plugged-2246e004-4f6b-449d-91b2-8e67b4f51006 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:52:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8f1b7c51-9aa8-43a6-9bc1-f8b9f78acdb5 req-52f8893a-57a3-4f9a-a44f-367d466c8aed service nova] Acquiring lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8f1b7c51-9aa8-43a6-9bc1-f8b9f78acdb5 req-52f8893a-57a3-4f9a-a44f-367d466c8aed service nova] Lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8f1b7c51-9aa8-43a6-9bc1-f8b9f78acdb5 req-52f8893a-57a3-4f9a-a44f-367d466c8aed service nova] Lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:05 user nova-compute[73484]: DEBUG nova.compute.manager [req-8f1b7c51-9aa8-43a6-9bc1-f8b9f78acdb5 req-52f8893a-57a3-4f9a-a44f-367d466c8aed service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] No waiting events found dispatching network-vif-plugged-2246e004-4f6b-449d-91b2-8e67b4f51006 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:52:05 user nova-compute[73484]: WARNING nova.compute.manager [req-8f1b7c51-9aa8-43a6-9bc1-f8b9f78acdb5 req-52f8893a-57a3-4f9a-a44f-367d466c8aed service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Received unexpected event network-vif-plugged-2246e004-4f6b-449d-91b2-8e67b4f51006 for instance with vm_state rescued and task_state unrescuing.
Aug 14 13:52:05 user nova-compute[73484]: DEBUG nova.compute.manager [req-8f1b7c51-9aa8-43a6-9bc1-f8b9f78acdb5 req-52f8893a-57a3-4f9a-a44f-367d466c8aed service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Received event network-vif-plugged-2246e004-4f6b-449d-91b2-8e67b4f51006 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:52:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8f1b7c51-9aa8-43a6-9bc1-f8b9f78acdb5 req-52f8893a-57a3-4f9a-a44f-367d466c8aed service nova] Acquiring lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8f1b7c51-9aa8-43a6-9bc1-f8b9f78acdb5 req-52f8893a-57a3-4f9a-a44f-367d466c8aed service nova] Lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8f1b7c51-9aa8-43a6-9bc1-f8b9f78acdb5 req-52f8893a-57a3-4f9a-a44f-367d466c8aed service nova] Lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:05 user nova-compute[73484]: DEBUG nova.compute.manager [req-8f1b7c51-9aa8-43a6-9bc1-f8b9f78acdb5 req-52f8893a-57a3-4f9a-a44f-367d466c8aed service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] No waiting events found dispatching network-vif-plugged-2246e004-4f6b-449d-91b2-8e67b4f51006 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:52:05 user nova-compute[73484]: WARNING nova.compute.manager [req-8f1b7c51-9aa8-43a6-9bc1-f8b9f78acdb5 req-52f8893a-57a3-4f9a-a44f-367d466c8aed service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Received unexpected event network-vif-plugged-2246e004-4f6b-449d-91b2-8e67b4f51006 for instance with vm_state rescued and task_state unrescuing.
Aug 14 13:52:05 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Instance destroyed successfully.
Aug 14 13:52:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Removed pending event for 782c6142-757a-49ae-9292-787a7f1e8a23 due to event {{(pid=73484) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 13:52:06 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021126.966908, 782c6142-757a-49ae-9292-787a7f1e8a23 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:52:06 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] VM Resumed (Lifecycle Event)
Aug 14 13:52:06 user nova-compute[73484]: DEBUG nova.compute.manager [None req-924edb8c-f118-484d-a7de-dedeeba49707 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:52:07 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:52:07 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:52:07 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 13:52:07 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021126.9678874, 782c6142-757a-49ae-9292-787a7f1e8a23 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:52:07 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] VM Started (Lifecycle Event)
Aug 14 13:52:07 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:52:07 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:52:07 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:07 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:07 user nova-compute[73484]: DEBUG nova.compute.manager [req-d243f111-e7b1-4872-a7df-0db000483c05 req-380b3aa7-61f2-4339-bcad-4e18232ea5e6 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Received event network-vif-plugged-ea301764-93d8-4c55-a51f-5e50918be405 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:52:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d243f111-e7b1-4872-a7df-0db000483c05 req-380b3aa7-61f2-4339-bcad-4e18232ea5e6 service nova] Acquiring lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d243f111-e7b1-4872-a7df-0db000483c05 req-380b3aa7-61f2-4339-bcad-4e18232ea5e6 service nova] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d243f111-e7b1-4872-a7df-0db000483c05 req-380b3aa7-61f2-4339-bcad-4e18232ea5e6 service nova] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:07 user nova-compute[73484]: DEBUG nova.compute.manager [req-d243f111-e7b1-4872-a7df-0db000483c05 req-380b3aa7-61f2-4339-bcad-4e18232ea5e6 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] No waiting events found dispatching network-vif-plugged-ea301764-93d8-4c55-a51f-5e50918be405 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:52:07 user nova-compute[73484]: WARNING nova.compute.manager [req-d243f111-e7b1-4872-a7df-0db000483c05 req-380b3aa7-61f2-4339-bcad-4e18232ea5e6 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Received unexpected event network-vif-plugged-ea301764-93d8-4c55-a51f-5e50918be405 for instance with vm_state rescued and task_state unrescuing.
Aug 14 13:52:07 user nova-compute[73484]: DEBUG nova.compute.manager [req-d243f111-e7b1-4872-a7df-0db000483c05 req-380b3aa7-61f2-4339-bcad-4e18232ea5e6 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Received event network-changed-ef1b13c3-d3e6-492e-8082-b5939545f189 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:52:07 user nova-compute[73484]: DEBUG nova.compute.manager [req-d243f111-e7b1-4872-a7df-0db000483c05 req-380b3aa7-61f2-4339-bcad-4e18232ea5e6 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Refreshing instance network info cache due to event network-changed-ef1b13c3-d3e6-492e-8082-b5939545f189. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:52:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d243f111-e7b1-4872-a7df-0db000483c05 req-380b3aa7-61f2-4339-bcad-4e18232ea5e6 service nova] Acquiring lock "refresh_cache-a54902a5-df8a-473f-9cf1-a112528c3549" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:52:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d243f111-e7b1-4872-a7df-0db000483c05 req-380b3aa7-61f2-4339-bcad-4e18232ea5e6 service nova] Acquired lock "refresh_cache-a54902a5-df8a-473f-9cf1-a112528c3549" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:52:07 user nova-compute[73484]: DEBUG nova.network.neutron [req-d243f111-e7b1-4872-a7df-0db000483c05 req-380b3aa7-61f2-4339-bcad-4e18232ea5e6 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Refreshing network info cache for port ef1b13c3-d3e6-492e-8082-b5939545f189 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:52:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Acquiring lock "a54902a5-df8a-473f-9cf1-a112528c3549" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "a54902a5-df8a-473f-9cf1-a112528c3549" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:07 user nova-compute[73484]: INFO nova.compute.manager [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Shelve offloading
Aug 14 13:52:07 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:07 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:07 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:08 user nova-compute[73484]: DEBUG nova.compute.manager [req-d0585509-b19d-41ea-b067-4827dd33c094 req-7351bdb5-1c7b-47db-8328-f67526aac7ae service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Received event network-vif-unplugged-ef1b13c3-d3e6-492e-8082-b5939545f189 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:52:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d0585509-b19d-41ea-b067-4827dd33c094 req-7351bdb5-1c7b-47db-8328-f67526aac7ae service nova] Acquiring lock "a54902a5-df8a-473f-9cf1-a112528c3549-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d0585509-b19d-41ea-b067-4827dd33c094 req-7351bdb5-1c7b-47db-8328-f67526aac7ae service nova] Lock "a54902a5-df8a-473f-9cf1-a112528c3549-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d0585509-b19d-41ea-b067-4827dd33c094 req-7351bdb5-1c7b-47db-8328-f67526aac7ae service nova] Lock "a54902a5-df8a-473f-9cf1-a112528c3549-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:08 user nova-compute[73484]: DEBUG nova.compute.manager [req-d0585509-b19d-41ea-b067-4827dd33c094 req-7351bdb5-1c7b-47db-8328-f67526aac7ae service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] No waiting events found dispatching network-vif-unplugged-ef1b13c3-d3e6-492e-8082-b5939545f189 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:52:08 user nova-compute[73484]: WARNING nova.compute.manager [req-d0585509-b19d-41ea-b067-4827dd33c094 req-7351bdb5-1c7b-47db-8328-f67526aac7ae service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Received unexpected event network-vif-unplugged-ef1b13c3-d3e6-492e-8082-b5939545f189 for instance with vm_state active and task_state shelving.
Aug 14 13:52:08 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Instance destroyed successfully.
Aug 14 13:52:08 user nova-compute[73484]: DEBUG nova.compute.manager [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:52:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Acquiring lock "refresh_cache-a54902a5-df8a-473f-9cf1-a112528c3549" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:52:08 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:08 user nova-compute[73484]: DEBUG nova.network.neutron [req-d243f111-e7b1-4872-a7df-0db000483c05 req-380b3aa7-61f2-4339-bcad-4e18232ea5e6 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Updated VIF entry in instance network info cache for port ef1b13c3-d3e6-492e-8082-b5939545f189. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:52:08 user nova-compute[73484]: DEBUG nova.network.neutron [req-d243f111-e7b1-4872-a7df-0db000483c05 req-380b3aa7-61f2-4339-bcad-4e18232ea5e6 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Updating instance_info_cache with network_info: [{"id": "ef1b13c3-d3e6-492e-8082-b5939545f189", "address": "fa:16:3e:25:ba:8c", "network": {"id": "83e56acf-b902-47d4-8e67-89dd64cb110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773957043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844799698ad34e19ba511a302ffa57a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1b13c3-d3", "ovs_interfaceid": "ef1b13c3-d3e6-492e-8082-b5939545f189", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:52:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d243f111-e7b1-4872-a7df-0db000483c05 req-380b3aa7-61f2-4339-bcad-4e18232ea5e6 service nova] Releasing lock "refresh_cache-a54902a5-df8a-473f-9cf1-a112528c3549" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:52:08 user nova-compute[73484]: DEBUG nova.compute.manager [req-d243f111-e7b1-4872-a7df-0db000483c05 req-380b3aa7-61f2-4339-bcad-4e18232ea5e6 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Received event network-vif-plugged-ea301764-93d8-4c55-a51f-5e50918be405 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:52:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d243f111-e7b1-4872-a7df-0db000483c05 req-380b3aa7-61f2-4339-bcad-4e18232ea5e6 service nova] Acquiring lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d243f111-e7b1-4872-a7df-0db000483c05 req-380b3aa7-61f2-4339-bcad-4e18232ea5e6 service nova] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d243f111-e7b1-4872-a7df-0db000483c05 req-380b3aa7-61f2-4339-bcad-4e18232ea5e6 service nova] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:08 user nova-compute[73484]: DEBUG nova.compute.manager [req-d243f111-e7b1-4872-a7df-0db000483c05 req-380b3aa7-61f2-4339-bcad-4e18232ea5e6 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] No waiting events found dispatching network-vif-plugged-ea301764-93d8-4c55-a51f-5e50918be405 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:52:08 user nova-compute[73484]: WARNING nova.compute.manager [req-d243f111-e7b1-4872-a7df-0db000483c05 req-380b3aa7-61f2-4339-bcad-4e18232ea5e6 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Received unexpected event network-vif-plugged-ea301764-93d8-4c55-a51f-5e50918be405 for instance with vm_state rescued and task_state unrescuing.
Aug 14 13:52:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Acquired lock "refresh_cache-a54902a5-df8a-473f-9cf1-a112528c3549" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:52:08 user nova-compute[73484]: DEBUG nova.network.neutron [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:52:08 user nova-compute[73484]: DEBUG nova.network.neutron [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Updating instance_info_cache with network_info: [{"id": "ef1b13c3-d3e6-492e-8082-b5939545f189", "address": "fa:16:3e:25:ba:8c", "network": {"id": "83e56acf-b902-47d4-8e67-89dd64cb110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773957043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844799698ad34e19ba511a302ffa57a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1b13c3-d3", "ovs_interfaceid": "ef1b13c3-d3e6-492e-8082-b5939545f189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:52:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Releasing lock "refresh_cache-a54902a5-df8a-473f-9cf1-a112528c3549" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Removed pending event for b43ccb18-6d2d-43f2-a185-bb558d5d6f45 due to event {{(pid=73484) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021129.2598588, b43ccb18-6d2d-43f2-a185-bb558d5d6f45 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:52:09 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] VM Resumed (Lifecycle Event)
Aug 14 13:52:09 user nova-compute[73484]: DEBUG nova.compute.manager [None req-73a462b4-0606-4cfc-89cc-388d0218d177 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:52:09 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 13:52:09 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021129.2634256, b43ccb18-6d2d-43f2-a185-bb558d5d6f45 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:52:09 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] VM Started (Lifecycle Event)
Aug 14 13:52:09 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG nova.compute.manager [req-e06fc633-54a7-4740-b6e6-16ee6ac820b9 req-11df1f8b-818c-48f9-a81a-bd8bc50c84c4 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Received event network-vif-plugged-ea301764-93d8-4c55-a51f-5e50918be405 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e06fc633-54a7-4740-b6e6-16ee6ac820b9 req-11df1f8b-818c-48f9-a81a-bd8bc50c84c4 service nova] Acquiring lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e06fc633-54a7-4740-b6e6-16ee6ac820b9 req-11df1f8b-818c-48f9-a81a-bd8bc50c84c4 service nova] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e06fc633-54a7-4740-b6e6-16ee6ac820b9 req-11df1f8b-818c-48f9-a81a-bd8bc50c84c4 service nova] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG nova.compute.manager [req-e06fc633-54a7-4740-b6e6-16ee6ac820b9 req-11df1f8b-818c-48f9-a81a-bd8bc50c84c4 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] No waiting events found dispatching network-vif-plugged-ea301764-93d8-4c55-a51f-5e50918be405 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:52:09 user nova-compute[73484]: WARNING nova.compute.manager [req-e06fc633-54a7-4740-b6e6-16ee6ac820b9 req-11df1f8b-818c-48f9-a81a-bd8bc50c84c4 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Received unexpected event network-vif-plugged-ea301764-93d8-4c55-a51f-5e50918be405 for instance with vm_state active and task_state None.
Aug 14 13:52:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:09 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Instance destroyed successfully.
Aug 14 13:52:09 user nova-compute[73484]: DEBUG nova.objects.instance [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lazy-loading 'resources' on Instance uuid a54902a5-df8a-473f-9cf1-a112528c3549 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:50:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1804131842',display_name='tempest-TestShelveInstance-server-1804131842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1804131842',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxsFZ8NKDri+73Tn1zh9Wr6BQVIfh4MxDYhjkRccl1yD5yV+qy8XZKjgzVijNxBrMINGQYKNmEBr2Jszg8sPGJk+mssBnBusEo19PhQ2+8ia4TUjqmwOa2btGBPkDkkNg==',key_name='tempest-TestShelveInstance-1649769704',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:50:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='844799698ad34e19ba511a302ffa57a4',ramdisk_id='',reservation_id='r-romjeqoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1441042020',owner_user_name='tempest-TestShelveInstance-1441042020-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:50:31Z,user_data=None,user_id='c8d4d6031b59481d93c22075f19559b6',uuid=a54902a5-df8a-473f-9cf1-a112528c3549,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef1b13c3-d3e6-492e-8082-b5939545f189", "address": "fa:16:3e:25:ba:8c", "network": {"id": "83e56acf-b902-47d4-8e67-89dd64cb110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773957043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844799698ad34e19ba511a302ffa57a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1b13c3-d3", "ovs_interfaceid": "ef1b13c3-d3e6-492e-8082-b5939545f189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Converting VIF {"id": "ef1b13c3-d3e6-492e-8082-b5939545f189", "address": "fa:16:3e:25:ba:8c", "network": {"id": "83e56acf-b902-47d4-8e67-89dd64cb110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773957043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844799698ad34e19ba511a302ffa57a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1b13c3-d3", "ovs_interfaceid": "ef1b13c3-d3e6-492e-8082-b5939545f189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:ba:8c,bridge_name='br-int',has_traffic_filtering=True,id=ef1b13c3-d3e6-492e-8082-b5939545f189,network=Network(83e56acf-b902-47d4-8e67-89dd64cb110e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1b13c3-d3') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG os_vif [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:ba:8c,bridge_name='br-int',has_traffic_filtering=True,id=ef1b13c3-d3e6-492e-8082-b5939545f189,network=Network(83e56acf-b902-47d4-8e67-89dd64cb110e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1b13c3-d3') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef1b13c3-d3, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:52:09 user nova-compute[73484]: INFO os_vif [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:ba:8c,bridge_name='br-int',has_traffic_filtering=True,id=ef1b13c3-d3e6-492e-8082-b5939545f189,network=Network(83e56acf-b902-47d4-8e67-89dd64cb110e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1b13c3-d3')
Aug 14 13:52:09 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VTMsgrjJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:52:09 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:52:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f104736a-e36d-4bfc-8d61-1bbc5317443e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[16824e72-94c1-4dad-aa71-7c2fcfab44c9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:52:09 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:52:09 user nova-compute[73484]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)
Aug 14 13:52:09 user nova-compute[73484]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)
Aug 14 13:52:09 user nova-compute[73484]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:52:09 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:52:09 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:52:09 user nova-compute[73484]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)
Aug 14 13:52:09 user nova-compute[73484]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)
Aug 14 13:52:09 user nova-compute[73484]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:52:09 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4785e9e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475'): ({'sdf'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Removing single pathed devices sdf {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f775594-fa8f-4c62-b8a1-0d1b97d6b222]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3617ae-b5f2-4454-96b8-030521d78975]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Flushing IO for device /dev/sdf {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1662d6f-25b3-41d4-9a0c-d4a9363c0b46]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[938256e9-0ccd-4870-ba4f-c799e82ba428]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] SCSI volumes sdf have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ec5ee1-c120-4b98-97ee-e611f4895207]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb8f682-9a69-4c8c-9265-45fb483ed92b]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475, portal: 172.16.0.220,3260]
Aug 14 13:52:09 user nova-compute[73484]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475, portal: 172.16.0.220,3260] successful.
Aug 14 13:52:09 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:52:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c74e02-b5d0-4d45-9c02-53089f2f204f]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:52:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:52:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:52:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] <== disconnect_volume: return (356ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:52:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:52:10 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Deleting instance files /opt/stack/data/nova/instances/a54902a5-df8a-473f-9cf1-a112528c3549_del
Aug 14 13:52:10 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Deletion of /opt/stack/data/nova/instances/a54902a5-df8a-473f-9cf1-a112528c3549_del complete
Aug 14 13:52:10 user nova-compute[73484]: DEBUG nova.compute.manager [req-442004bb-8c08-4d28-a005-52c227054070 req-751e3a2f-27d6-4c82-b0dd-ecb0a2a24897 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Received event network-vif-plugged-ef1b13c3-d3e6-492e-8082-b5939545f189 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:52:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-442004bb-8c08-4d28-a005-52c227054070 req-751e3a2f-27d6-4c82-b0dd-ecb0a2a24897 service nova] Acquiring lock "a54902a5-df8a-473f-9cf1-a112528c3549-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-442004bb-8c08-4d28-a005-52c227054070 req-751e3a2f-27d6-4c82-b0dd-ecb0a2a24897 service nova] Lock "a54902a5-df8a-473f-9cf1-a112528c3549-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-442004bb-8c08-4d28-a005-52c227054070 req-751e3a2f-27d6-4c82-b0dd-ecb0a2a24897 service nova] Lock "a54902a5-df8a-473f-9cf1-a112528c3549-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:10 user nova-compute[73484]: DEBUG nova.compute.manager [req-442004bb-8c08-4d28-a005-52c227054070 req-751e3a2f-27d6-4c82-b0dd-ecb0a2a24897 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] No waiting events found dispatching network-vif-plugged-ef1b13c3-d3e6-492e-8082-b5939545f189 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:52:10 user nova-compute[73484]: WARNING nova.compute.manager [req-442004bb-8c08-4d28-a005-52c227054070 req-751e3a2f-27d6-4c82-b0dd-ecb0a2a24897 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Received unexpected event network-vif-plugged-ef1b13c3-d3e6-492e-8082-b5939545f189 for instance with vm_state active and task_state shelving.
Aug 14 13:52:10 user nova-compute[73484]: DEBUG nova.compute.manager [req-442004bb-8c08-4d28-a005-52c227054070 req-751e3a2f-27d6-4c82-b0dd-ecb0a2a24897 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Received event network-changed-ef1b13c3-d3e6-492e-8082-b5939545f189 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:52:10 user nova-compute[73484]: DEBUG nova.compute.manager [req-442004bb-8c08-4d28-a005-52c227054070 req-751e3a2f-27d6-4c82-b0dd-ecb0a2a24897 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Refreshing instance network info cache due to event network-changed-ef1b13c3-d3e6-492e-8082-b5939545f189. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:52:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-442004bb-8c08-4d28-a005-52c227054070 req-751e3a2f-27d6-4c82-b0dd-ecb0a2a24897 service nova] Acquiring lock "refresh_cache-a54902a5-df8a-473f-9cf1-a112528c3549" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:52:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-442004bb-8c08-4d28-a005-52c227054070 req-751e3a2f-27d6-4c82-b0dd-ecb0a2a24897 service nova] Acquired lock "refresh_cache-a54902a5-df8a-473f-9cf1-a112528c3549" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:52:10 user nova-compute[73484]: DEBUG nova.network.neutron [req-442004bb-8c08-4d28-a005-52c227054070 req-751e3a2f-27d6-4c82-b0dd-ecb0a2a24897 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Refreshing network info cache for port ef1b13c3-d3e6-492e-8082-b5939545f189 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:52:10 user nova-compute[73484]: DEBUG nova.network.neutron [req-442004bb-8c08-4d28-a005-52c227054070 req-751e3a2f-27d6-4c82-b0dd-ecb0a2a24897 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Updated VIF entry in instance network info cache for port ef1b13c3-d3e6-492e-8082-b5939545f189. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:52:10 user nova-compute[73484]: DEBUG nova.network.neutron [req-442004bb-8c08-4d28-a005-52c227054070 req-751e3a2f-27d6-4c82-b0dd-ecb0a2a24897 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Updating instance_info_cache with network_info: [{"id": "ef1b13c3-d3e6-492e-8082-b5939545f189", "address": "fa:16:3e:25:ba:8c", "network": {"id": "83e56acf-b902-47d4-8e67-89dd64cb110e", "bridge": null, "label": "tempest-TestShelveInstance-1773957043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844799698ad34e19ba511a302ffa57a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapef1b13c3-d3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:52:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-442004bb-8c08-4d28-a005-52c227054070 req-751e3a2f-27d6-4c82-b0dd-ecb0a2a24897 service nova] Releasing lock "refresh_cache-a54902a5-df8a-473f-9cf1-a112528c3549" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:52:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:11 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Deleted allocations for instance a54902a5-df8a-473f-9cf1-a112528c3549
Aug 14 13:52:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:11 user nova-compute[73484]: DEBUG nova.objects.instance [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lazy-loading 'numa_topology' on Instance uuid a54902a5-df8a-473f-9cf1-a112528c3549 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:52:11 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:52:11 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:52:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3aac895a-c07d-4ae8-9185-d5389423f3e2 tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "a54902a5-df8a-473f-9cf1-a112528c3549" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.288s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e9450037-957c-4874-8784-300b829c0e0f tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "72f007af-a1e7-4a80-954c-ed12aaf129fd" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e9450037-957c-4874-8784-300b829c0e0f tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "72f007af-a1e7-4a80-954c-ed12aaf129fd" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:20 user nova-compute[73484]: DEBUG nova.compute.manager [None req-e9450037-957c-4874-8784-300b829c0e0f tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Going to confirm migration 2 {{(pid=73484) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 14 13:52:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e9450037-957c-4874-8784-300b829c0e0f tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "refresh_cache-72f007af-a1e7-4a80-954c-ed12aaf129fd" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:52:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e9450037-957c-4874-8784-300b829c0e0f tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquired lock "refresh_cache-72f007af-a1e7-4a80-954c-ed12aaf129fd" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:52:21 user nova-compute[73484]: DEBUG nova.network.neutron [None req-e9450037-957c-4874-8784-300b829c0e0f tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:52:21 user nova-compute[73484]: DEBUG nova.objects.instance [None req-e9450037-957c-4874-8784-300b829c0e0f tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lazy-loading 'info_cache' on Instance uuid 72f007af-a1e7-4a80-954c-ed12aaf129fd {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:52:22 user nova-compute[73484]: DEBUG nova.network.neutron [None req-e9450037-957c-4874-8784-300b829c0e0f tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Updating instance_info_cache with network_info: [{"id": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "address": "fa:16:3e:22:ea:2c", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f75cf0-c8", "ovs_interfaceid": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:52:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e9450037-957c-4874-8784-300b829c0e0f tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Releasing lock "refresh_cache-72f007af-a1e7-4a80-954c-ed12aaf129fd" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:52:22 user nova-compute[73484]: DEBUG nova.objects.instance [None req-e9450037-957c-4874-8784-300b829c0e0f tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lazy-loading 'migration_context' on Instance uuid 72f007af-a1e7-4a80-954c-ed12aaf129fd {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:52:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e9450037-957c-4874-8784-300b829c0e0f tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e9450037-957c-4874-8784-300b829c0e0f tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:22 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-e9450037-957c-4874-8784-300b829c0e0f tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:52:22 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-e9450037-957c-4874-8784-300b829c0e0f tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:52:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e9450037-957c-4874-8784-300b829c0e0f tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.418s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:22 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-e9450037-957c-4874-8784-300b829c0e0f tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Deleted allocation for migration 46f67f47-54df-4173-adbd-c3a2097e9347
Aug 14 13:52:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e9450037-957c-4874-8784-300b829c0e0f tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "72f007af-a1e7-4a80-954c-ed12aaf129fd" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 2.728s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:23 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692021128.3314562, a54902a5-df8a-473f-9cf1-a112528c3549 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:52:23 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] VM Stopped (Lifecycle Event)
Aug 14 13:52:23 user nova-compute[73484]: DEBUG nova.compute.manager [None req-50ce2533-74bb-47f2-93f9-265a63a0dd9d None None] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:52:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Acquiring lock "09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Lock "09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:24 user nova-compute[73484]: DEBUG nova.compute.manager [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:52:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:24 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:52:24 user nova-compute[73484]: INFO nova.compute.claims [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Claim successful on node user
Aug 14 13:52:25 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:52:25 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:52:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.459s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:25 user nova-compute[73484]: DEBUG nova.compute.manager [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:52:25 user nova-compute[73484]: DEBUG nova.compute.manager [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:52:25 user nova-compute[73484]: DEBUG nova.network.neutron [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:52:25 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:52:25 user nova-compute[73484]: DEBUG nova.compute.manager [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:52:25 user nova-compute[73484]: DEBUG nova.policy [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4437106ba3554827a237238635e1b17f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb15e3b8ebb4c1e879c30636d1a8e9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:52:25 user nova-compute[73484]: DEBUG nova.compute.manager [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:52:25 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:52:25 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Creating image(s)
Aug 14 13:52:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Acquiring lock "/opt/stack/data/nova/instances/09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Lock "/opt/stack/data/nova/instances/09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Lock "/opt/stack/data/nova/instances/09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.184s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.191s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa/disk 1073741824" returned: 0 in 0.055s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:26 user nova-compute[73484]: DEBUG nova.network.neutron [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Successfully created port: 55e364a6-7e8f-43c6-ab88-e4f31d106521 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:52:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.171s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:26 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Checking if we can resize image /opt/stack/data/nova/instances/09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:52:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:26 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Cannot resize image /opt/stack/data/nova/instances/09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:52:26 user nova-compute[73484]: DEBUG nova.objects.instance [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Lazy-loading 'migration_context' on Instance uuid 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:52:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:52:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Ensure instance console log exists: /opt/stack/data/nova/instances/09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:52:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:26 user nova-compute[73484]: DEBUG nova.network.neutron [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Successfully updated port: 55e364a6-7e8f-43c6-ab88-e4f31d106521 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:52:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Acquiring lock "refresh_cache-09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:52:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Acquired lock "refresh_cache-09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:52:26 user nova-compute[73484]: DEBUG nova.network.neutron [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:52:26 user nova-compute[73484]: DEBUG nova.compute.manager [req-d3aa90b4-7158-4a24-86f5-8d90472e01ca req-6de32efe-9434-477f-8bdf-ad284db89638 service nova] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Received event network-changed-55e364a6-7e8f-43c6-ab88-e4f31d106521 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:52:26 user nova-compute[73484]: DEBUG nova.compute.manager [req-d3aa90b4-7158-4a24-86f5-8d90472e01ca req-6de32efe-9434-477f-8bdf-ad284db89638 service nova] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Refreshing instance network info cache due to event network-changed-55e364a6-7e8f-43c6-ab88-e4f31d106521. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:52:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d3aa90b4-7158-4a24-86f5-8d90472e01ca req-6de32efe-9434-477f-8bdf-ad284db89638 service nova] Acquiring lock "refresh_cache-09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:52:26 user nova-compute[73484]: DEBUG nova.network.neutron [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.network.neutron [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Updating instance_info_cache with network_info: [{"id": "55e364a6-7e8f-43c6-ab88-e4f31d106521", "address": "fa:16:3e:82:b6:e3", "network": {"id": "2b684cc1-1035-4e4e-a6f4-89fd1ebc48f9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1257195589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cb15e3b8ebb4c1e879c30636d1a8e9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e364a6-7e", "ovs_interfaceid": "55e364a6-7e8f-43c6-ab88-e4f31d106521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Releasing lock "refresh_cache-09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.compute.manager [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Instance network_info: |[{"id": "55e364a6-7e8f-43c6-ab88-e4f31d106521", "address": "fa:16:3e:82:b6:e3", "network": {"id": "2b684cc1-1035-4e4e-a6f4-89fd1ebc48f9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1257195589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cb15e3b8ebb4c1e879c30636d1a8e9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e364a6-7e", "ovs_interfaceid": "55e364a6-7e8f-43c6-ab88-e4f31d106521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d3aa90b4-7158-4a24-86f5-8d90472e01ca req-6de32efe-9434-477f-8bdf-ad284db89638 service nova] Acquired lock "refresh_cache-09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.network.neutron [req-d3aa90b4-7158-4a24-86f5-8d90472e01ca req-6de32efe-9434-477f-8bdf-ad284db89638 service nova] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Refreshing network info cache for port 55e364a6-7e8f-43c6-ab88-e4f31d106521 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Start _get_guest_xml network_info=[{"id": "55e364a6-7e8f-43c6-ab88-e4f31d106521", "address": "fa:16:3e:82:b6:e3", "network": {"id": "2b684cc1-1035-4e4e-a6f4-89fd1ebc48f9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1257195589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cb15e3b8ebb4c1e879c30636d1a8e9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e364a6-7e", "ovs_interfaceid": "55e364a6-7e8f-43c6-ab88-e4f31d106521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:52:27 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:52:27 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:52:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-906238062',display_name='tempest-VolumesActionsTest-instance-906238062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-906238062',id=33,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cb15e3b8ebb4c1e879c30636d1a8e9b',ramdisk_id='',reservation_id='r-0cv5abtk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-331432369',owner_user_name='tempest-VolumesActionsTest-331432369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:52:25Z,user_data=None,user_id='4437106ba3554827a237238635e1b17f',uuid=09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55e364a6-7e8f-43c6-ab88-e4f31d106521", "address": "fa:16:3e:82:b6:e3", "network": {"id": "2b684cc1-1035-4e4e-a6f4-89fd1ebc48f9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1257195589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cb15e3b8ebb4c1e879c30636d1a8e9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e364a6-7e", "ovs_interfaceid": "55e364a6-7e8f-43c6-ab88-e4f31d106521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Converting VIF {"id": "55e364a6-7e8f-43c6-ab88-e4f31d106521", "address": "fa:16:3e:82:b6:e3", "network": {"id": "2b684cc1-1035-4e4e-a6f4-89fd1ebc48f9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1257195589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cb15e3b8ebb4c1e879c30636d1a8e9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e364a6-7e", "ovs_interfaceid": "55e364a6-7e8f-43c6-ab88-e4f31d106521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:b6:e3,bridge_name='br-int',has_traffic_filtering=True,id=55e364a6-7e8f-43c6-ab88-e4f31d106521,network=Network(2b684cc1-1035-4e4e-a6f4-89fd1ebc48f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e364a6-7e') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.objects.instance [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Lazy-loading 'pci_devices' on Instance uuid 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:52:27 user nova-compute[73484]:   <uuid>09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa</uuid>
Aug 14 13:52:27 user nova-compute[73484]:   <name>instance-00000021</name>
Aug 14 13:52:27 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:52:27 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:52:27 user nova-compute[73484]:   <metadata>
Aug 14 13:52:27 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:52:27 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:52:27 user nova-compute[73484]:       <nova:name>tempest-VolumesActionsTest-instance-906238062</nova:name>
Aug 14 13:52:27 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:52:27</nova:creationTime>
Aug 14 13:52:27 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:52:27 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:52:27 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:52:27 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:52:27 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:52:27 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:52:27 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:52:27 user nova-compute[73484]:       <nova:owner>
Aug 14 13:52:27 user nova-compute[73484]:         <nova:user uuid="4437106ba3554827a237238635e1b17f">tempest-VolumesActionsTest-331432369-project-member</nova:user>
Aug 14 13:52:27 user nova-compute[73484]:         <nova:project uuid="7cb15e3b8ebb4c1e879c30636d1a8e9b">tempest-VolumesActionsTest-331432369</nova:project>
Aug 14 13:52:27 user nova-compute[73484]:       </nova:owner>
Aug 14 13:52:27 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:52:27 user nova-compute[73484]:       <nova:ports>
Aug 14 13:52:27 user nova-compute[73484]:         <nova:port uuid="55e364a6-7e8f-43c6-ab88-e4f31d106521">
Aug 14 13:52:27 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 13:52:27 user nova-compute[73484]:         </nova:port>
Aug 14 13:52:27 user nova-compute[73484]:       </nova:ports>
Aug 14 13:52:27 user nova-compute[73484]:     </nova:instance>
Aug 14 13:52:27 user nova-compute[73484]:   </metadata>
Aug 14 13:52:27 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:52:27 user nova-compute[73484]:     <system>
Aug 14 13:52:27 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:52:27 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:52:27 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:52:27 user nova-compute[73484]:       <entry name="serial">09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa</entry>
Aug 14 13:52:27 user nova-compute[73484]:       <entry name="uuid">09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa</entry>
Aug 14 13:52:27 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:52:27 user nova-compute[73484]:     </system>
Aug 14 13:52:27 user nova-compute[73484]:   </sysinfo>
Aug 14 13:52:27 user nova-compute[73484]:   <os>
Aug 14 13:52:27 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:52:27 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:52:27 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:52:27 user nova-compute[73484]:   </os>
Aug 14 13:52:27 user nova-compute[73484]:   <features>
Aug 14 13:52:27 user nova-compute[73484]:     <acpi/>
Aug 14 13:52:27 user nova-compute[73484]:     <apic/>
Aug 14 13:52:27 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:52:27 user nova-compute[73484]:   </features>
Aug 14 13:52:27 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:52:27 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:52:27 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:52:27 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:52:27 user nova-compute[73484]:   </clock>
Aug 14 13:52:27 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:52:27 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:52:27 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:52:27 user nova-compute[73484]:   </cpu>
Aug 14 13:52:27 user nova-compute[73484]:   <devices>
Aug 14 13:52:27 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:52:27 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:52:27 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa/disk"/>
Aug 14 13:52:27 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:52:27 user nova-compute[73484]:     </disk>
Aug 14 13:52:27 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:52:27 user nova-compute[73484]:       <mac address="fa:16:3e:82:b6:e3"/>
Aug 14 13:52:27 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:52:27 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:52:27 user nova-compute[73484]:       <target dev="tap55e364a6-7e"/>
Aug 14 13:52:27 user nova-compute[73484]:     </interface>
Aug 14 13:52:27 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:52:27 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa/console.log" append="off"/>
Aug 14 13:52:27 user nova-compute[73484]:     </serial>
Aug 14 13:52:27 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:52:27 user nova-compute[73484]:     <video>
Aug 14 13:52:27 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:52:27 user nova-compute[73484]:     </video>
Aug 14 13:52:27 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:52:27 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:52:27 user nova-compute[73484]:     </rng>
Aug 14 13:52:27 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:52:27 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:52:27 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:52:27 user nova-compute[73484]:     </memballoon>
Aug 14 13:52:27 user nova-compute[73484]:   </devices>
Aug 14 13:52:27 user nova-compute[73484]: </domain>
Aug 14 13:52:27 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:52:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-906238062',display_name='tempest-VolumesActionsTest-instance-906238062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-906238062',id=33,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cb15e3b8ebb4c1e879c30636d1a8e9b',ramdisk_id='',reservation_id='r-0cv5abtk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-331432369',owner_user_name='tempest-VolumesActionsTest-331432369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:52:25Z,user_data=None,user_id='4437106ba3554827a237238635e1b17f',uuid=09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55e364a6-7e8f-43c6-ab88-e4f31d106521", "address": "fa:16:3e:82:b6:e3", "network": {"id": "2b684cc1-1035-4e4e-a6f4-89fd1ebc48f9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1257195589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cb15e3b8ebb4c1e879c30636d1a8e9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e364a6-7e", "ovs_interfaceid": "55e364a6-7e8f-43c6-ab88-e4f31d106521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Converting VIF {"id": "55e364a6-7e8f-43c6-ab88-e4f31d106521", "address": "fa:16:3e:82:b6:e3", "network": {"id": "2b684cc1-1035-4e4e-a6f4-89fd1ebc48f9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1257195589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cb15e3b8ebb4c1e879c30636d1a8e9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e364a6-7e", "ovs_interfaceid": "55e364a6-7e8f-43c6-ab88-e4f31d106521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:b6:e3,bridge_name='br-int',has_traffic_filtering=True,id=55e364a6-7e8f-43c6-ab88-e4f31d106521,network=Network(2b684cc1-1035-4e4e-a6f4-89fd1ebc48f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e364a6-7e') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG os_vif [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:b6:e3,bridge_name='br-int',has_traffic_filtering=True,id=55e364a6-7e8f-43c6-ab88-e4f31d106521,network=Network(2b684cc1-1035-4e4e-a6f4-89fd1ebc48f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e364a6-7e') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55e364a6-7e, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap55e364a6-7e, col_values=(('external_ids', {'iface-id': '55e364a6-7e8f-43c6-ab88-e4f31d106521', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:b6:e3', 'vm-uuid': '09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:27 user nova-compute[73484]: INFO os_vif [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:b6:e3,bridge_name='br-int',has_traffic_filtering=True,id=55e364a6-7e8f-43c6-ab88-e4f31d106521,network=Network(2b684cc1-1035-4e4e-a6f4-89fd1ebc48f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e364a6-7e')
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] No VIF found with MAC fa:16:3e:82:b6:e3, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.network.neutron [req-d3aa90b4-7158-4a24-86f5-8d90472e01ca req-6de32efe-9434-477f-8bdf-ad284db89638 service nova] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Updated VIF entry in instance network info cache for port 55e364a6-7e8f-43c6-ab88-e4f31d106521. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG nova.network.neutron [req-d3aa90b4-7158-4a24-86f5-8d90472e01ca req-6de32efe-9434-477f-8bdf-ad284db89638 service nova] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Updating instance_info_cache with network_info: [{"id": "55e364a6-7e8f-43c6-ab88-e4f31d106521", "address": "fa:16:3e:82:b6:e3", "network": {"id": "2b684cc1-1035-4e4e-a6f4-89fd1ebc48f9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1257195589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cb15e3b8ebb4c1e879c30636d1a8e9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e364a6-7e", "ovs_interfaceid": "55e364a6-7e8f-43c6-ab88-e4f31d106521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:52:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d3aa90b4-7158-4a24-86f5-8d90472e01ca req-6de32efe-9434-477f-8bdf-ad284db89638 service nova] Releasing lock "refresh_cache-09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:52:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "700e95c1-08b0-4613-992b-4314b127e14a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "700e95c1-08b0-4613-992b-4314b127e14a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:29 user nova-compute[73484]: INFO nova.compute.manager [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Detaching volume be929e7f-c83d-4847-9433-fb9bfafaf168
Aug 14 13:52:29 user nova-compute[73484]: INFO nova.virt.block_device [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Attempting to driver detach volume be929e7f-c83d-4847-9433-fb9bfafaf168 from mountpoint /dev/vdb
Aug 14 13:52:29 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Attempting to detach device vdb from instance 700e95c1-08b0-4613-992b-4314b127e14a from the persistent domain config. {{(pid=73484) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 13:52:29 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:52:29 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:52:29 user nova-compute[73484]:   <source dev="/dev/sdi"/>
Aug 14 13:52:29 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:52:29 user nova-compute[73484]:   <serial>be929e7f-c83d-4847-9433-fb9bfafaf168</serial>
Aug 14 13:52:29 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 13:52:29 user nova-compute[73484]: </disk>
Aug 14 13:52:29 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:52:29 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Successfully detached device vdb from instance 700e95c1-08b0-4613-992b-4314b127e14a from the persistent domain config.
Aug 14 13:52:29 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 700e95c1-08b0-4613-992b-4314b127e14a from the live domain config. {{(pid=73484) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 13:52:29 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:52:29 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:52:29 user nova-compute[73484]:   <source dev="/dev/sdi"/>
Aug 14 13:52:29 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:52:29 user nova-compute[73484]:   <serial>be929e7f-c83d-4847-9433-fb9bfafaf168</serial>
Aug 14 13:52:29 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 13:52:29 user nova-compute[73484]: </disk>
Aug 14 13:52:29 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:52:29 user nova-compute[73484]: DEBUG nova.compute.manager [req-add4af29-c07b-438b-ba84-3262fe0576c4 req-315cf8fb-bd30-4f39-90f3-35ead34b9868 service nova] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Received event network-vif-plugged-55e364a6-7e8f-43c6-ab88-e4f31d106521 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:52:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-add4af29-c07b-438b-ba84-3262fe0576c4 req-315cf8fb-bd30-4f39-90f3-35ead34b9868 service nova] Acquiring lock "09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-add4af29-c07b-438b-ba84-3262fe0576c4 req-315cf8fb-bd30-4f39-90f3-35ead34b9868 service nova] Lock "09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-add4af29-c07b-438b-ba84-3262fe0576c4 req-315cf8fb-bd30-4f39-90f3-35ead34b9868 service nova] Lock "09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:29 user nova-compute[73484]: DEBUG nova.compute.manager [req-add4af29-c07b-438b-ba84-3262fe0576c4 req-315cf8fb-bd30-4f39-90f3-35ead34b9868 service nova] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] No waiting events found dispatching network-vif-plugged-55e364a6-7e8f-43c6-ab88-e4f31d106521 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:52:29 user nova-compute[73484]: WARNING nova.compute.manager [req-add4af29-c07b-438b-ba84-3262fe0576c4 req-315cf8fb-bd30-4f39-90f3-35ead34b9868 service nova] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Received unexpected event network-vif-plugged-55e364a6-7e8f-43c6-ab88-e4f31d106521 for instance with vm_state building and task_state spawning.
Aug 14 13:52:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Received event <DeviceRemovedEvent: 1692021150.2057092, 700e95c1-08b0-4613-992b-4314b127e14a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73484) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 700e95c1-08b0-4613-992b-4314b127e14a {{(pid=73484) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 13:52:30 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Successfully detached device vdb from instance 700e95c1-08b0-4613-992b-4314b127e14a from the live domain config.
Aug 14 13:52:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuObsBKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:52:30 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:52:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1c83a8-3a0d-475f-8ede-412c07732500]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[849c5394-6fe9-479b-a4c2-f14e91825758]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:52:30 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:52:30 user nova-compute[73484]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)
Aug 14 13:52:30 user nova-compute[73484]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:52:30 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:52:30 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:52:30 user nova-compute[73484]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 (non-flash)
Aug 14 13:52:30 user nova-compute[73484]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:52:30 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4785e9ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168'): ({'sdi'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Removing single pathed devices sdi {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0d2eff-a5e5-4845-a514-b0c841966f6c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[859fcab8-7924-40d5-b899-af8a9372c764]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Flushing IO for device /dev/sdi {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7752a31c-104f-4eca-9d9a-45f93c92b3b0]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.047s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cfbf21-311b-4027-8552-35719dead04b]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] SCSI volumes sdi have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3196ee42-fdf9-4677-bab8-5158721dd402]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b01353-c79d-4afe-97e6-c024fee9c4ba]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168, portal: 172.16.0.220,3260]
Aug 14 13:52:30 user nova-compute[73484]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168, portal: 172.16.0.220,3260] successful.
Aug 14 13:52:30 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be929e7f-c83d-4847-9433-fb9bfafaf168 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ff17d2-9c61-43da-9d71-5e3739ab24c1]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] <== disconnect_volume: return (319ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021150.9666412, 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:52:30 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] VM Resumed (Lifecycle Event)
Aug 14 13:52:30 user nova-compute[73484]: DEBUG nova.compute.manager [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:52:30 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Instance spawned successfully.
Aug 14 13:52:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:52:30 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:52:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:52:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:52:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:52:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:52:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:52:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:52:31 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:52:31 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021150.9696045, 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:52:31 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] VM Started (Lifecycle Event)
Aug 14 13:52:31 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:52:31 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:52:31 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:52:31 user nova-compute[73484]: INFO nova.compute.manager [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Took 5.55 seconds to spawn the instance on the hypervisor.
Aug 14 13:52:31 user nova-compute[73484]: DEBUG nova.compute.manager [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:52:31 user nova-compute[73484]: INFO nova.compute.manager [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Took 6.33 seconds to build instance.
Aug 14 13:52:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-072c62fa-aa22-4e4e-8e27-0f60aab0969e tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Lock "09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.444s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:31 user nova-compute[73484]: DEBUG nova.objects.instance [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lazy-loading 'flavor' on Instance uuid 700e95c1-08b0-4613-992b-4314b127e14a {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:52:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6922317b-4c86-4cf9-8693-04bacd1a011b tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "700e95c1-08b0-4613-992b-4314b127e14a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.065s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:32 user nova-compute[73484]: DEBUG nova.compute.manager [req-bf81c5bf-650b-487b-b827-f484ab8ebdbf req-b023b7ad-bc81-4d20-82c7-4a343601a77e service nova] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Received event network-vif-plugged-55e364a6-7e8f-43c6-ab88-e4f31d106521 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:52:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-bf81c5bf-650b-487b-b827-f484ab8ebdbf req-b023b7ad-bc81-4d20-82c7-4a343601a77e service nova] Acquiring lock "09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-bf81c5bf-650b-487b-b827-f484ab8ebdbf req-b023b7ad-bc81-4d20-82c7-4a343601a77e service nova] Lock "09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-bf81c5bf-650b-487b-b827-f484ab8ebdbf req-b023b7ad-bc81-4d20-82c7-4a343601a77e service nova] Lock "09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:32 user nova-compute[73484]: DEBUG nova.compute.manager [req-bf81c5bf-650b-487b-b827-f484ab8ebdbf req-b023b7ad-bc81-4d20-82c7-4a343601a77e service nova] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] No waiting events found dispatching network-vif-plugged-55e364a6-7e8f-43c6-ab88-e4f31d106521 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:52:32 user nova-compute[73484]: WARNING nova.compute.manager [req-bf81c5bf-650b-487b-b827-f484ab8ebdbf req-b023b7ad-bc81-4d20-82c7-4a343601a77e service nova] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Received unexpected event network-vif-plugged-55e364a6-7e8f-43c6-ab88-e4f31d106521 for instance with vm_state active and task_state None.
Aug 14 13:52:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:42 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:42 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:52:43 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:52:43 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 13:52:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-c0994bac-3b43-414e-aa81-a9d7198775a6" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:52:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-c0994bac-3b43-414e-aa81-a9d7198775a6" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:52:44 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 13:52:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:44 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Updating instance_info_cache with network_info: [{"id": "67b5678c-ab81-4b84-86cc-c882ff19b949", "address": "fa:16:3e:f8:d1:e3", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b5678c-ab", "ovs_interfaceid": "67b5678c-ab81-4b84-86cc-c882ff19b949", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:52:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-c0994bac-3b43-414e-aa81-a9d7198775a6" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:52:44 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 13:52:44 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:52:44 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73484) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 13:52:44 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:52:44 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 13:52:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:46 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:52:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:46 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 13:52:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:52:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:47 user nova-compute[73484]: INFO nova.compute.manager [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Unshelving
Aug 14 13:52:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:47 user nova-compute[73484]: DEBUG nova.objects.instance [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lazy-loading 'pci_requests' on Instance uuid 86580f0d-dd88-48fb-bce8-dc6f5edc01c6 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:52:47 user nova-compute[73484]: DEBUG nova.objects.instance [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lazy-loading 'numa_topology' on Instance uuid 86580f0d-dd88-48fb-bce8-dc6f5edc01c6 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:52:47 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:52:47 user nova-compute[73484]: INFO nova.compute.claims [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Claim successful on node user
Aug 14 13:52:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:47 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:52:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:48 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:52:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:48 user nova-compute[73484]: INFO nova.network.neutron [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Updating port 8f0b7e99-89d1-4234-a552-e92df188cd4e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 14 13:52:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "refresh_cache-86580f0d-dd88-48fb-bce8-dc6f5edc01c6" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:52:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquired lock "refresh_cache-86580f0d-dd88-48fb-bce8-dc6f5edc01c6" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:52:48 user nova-compute[73484]: DEBUG nova.network.neutron [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:52:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:52:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:49 user nova-compute[73484]: DEBUG nova.compute.manager [req-1a44bbaa-3618-4304-8bf5-02d7d46403d3 req-5fa0b60e-3329-46ea-98a2-f3b262d9f3fe service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Received event network-changed-8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:52:49 user nova-compute[73484]: DEBUG nova.compute.manager [req-1a44bbaa-3618-4304-8bf5-02d7d46403d3 req-5fa0b60e-3329-46ea-98a2-f3b262d9f3fe service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Refreshing instance network info cache due to event network-changed-8f0b7e99-89d1-4234-a552-e92df188cd4e. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:52:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1a44bbaa-3618-4304-8bf5-02d7d46403d3 req-5fa0b60e-3329-46ea-98a2-f3b262d9f3fe service nova] Acquiring lock "refresh_cache-86580f0d-dd88-48fb-bce8-dc6f5edc01c6" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:52:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:52:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:49 user nova-compute[73484]: DEBUG nova.network.neutron [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Updating instance_info_cache with network_info: [{"id": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "address": "fa:16:3e:20:8b:68", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0b7e99-89", "ovs_interfaceid": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:52:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Releasing lock "refresh_cache-86580f0d-dd88-48fb-bce8-dc6f5edc01c6" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:52:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:52:49 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Creating image(s)
Aug 14 13:52:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "/opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "/opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "/opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:49 user nova-compute[73484]: DEBUG nova.objects.instance [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lazy-loading 'trusted_certs' on Instance uuid 86580f0d-dd88-48fb-bce8-dc6f5edc01c6 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:52:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1a44bbaa-3618-4304-8bf5-02d7d46403d3 req-5fa0b60e-3329-46ea-98a2-f3b262d9f3fe service nova] Acquired lock "refresh_cache-86580f0d-dd88-48fb-bce8-dc6f5edc01c6" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:52:49 user nova-compute[73484]: DEBUG nova.network.neutron [req-1a44bbaa-3618-4304-8bf5-02d7d46403d3 req-5fa0b60e-3329-46ea-98a2-f3b262d9f3fe service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Refreshing network info cache for port 8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:52:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "e94523494535035252278e76cc30c6c229813178" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "e94523494535035252278e76cc30c6c229813178" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e94523494535035252278e76cc30c6c229813178.part --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa/disk --force-share --output=json" returned: 0 in 1.079s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e94523494535035252278e76cc30c6c229813178.part --force-share --output=json" returned: 0 in 0.200s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:50 user nova-compute[73484]: DEBUG nova.virt.images [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] 4798089e-db5f-45e6-8a31-ecd7e9b1867f was qcow2, converting to raw {{(pid=73484) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 13:52:50 user nova-compute[73484]: DEBUG nova.privsep.utils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73484) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 13:52:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e94523494535035252278e76cc30c6c229813178.part /opt/stack/data/nova/instances/_base/e94523494535035252278e76cc30c6c229813178.converted {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:51 user nova-compute[73484]: DEBUG nova.network.neutron [req-1a44bbaa-3618-4304-8bf5-02d7d46403d3 req-5fa0b60e-3329-46ea-98a2-f3b262d9f3fe service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Updated VIF entry in instance network info cache for port 8f0b7e99-89d1-4234-a552-e92df188cd4e. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:52:51 user nova-compute[73484]: DEBUG nova.network.neutron [req-1a44bbaa-3618-4304-8bf5-02d7d46403d3 req-5fa0b60e-3329-46ea-98a2-f3b262d9f3fe service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Updating instance_info_cache with network_info: [{"id": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "address": "fa:16:3e:20:8b:68", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0b7e99-89", "ovs_interfaceid": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:52:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1a44bbaa-3618-4304-8bf5-02d7d46403d3 req-5fa0b60e-3329-46ea-98a2-f3b262d9f3fe service nova] Releasing lock "refresh_cache-86580f0d-dd88-48fb-bce8-dc6f5edc01c6" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:52:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e94523494535035252278e76cc30c6c229813178.part /opt/stack/data/nova/instances/_base/e94523494535035252278e76cc30c6c229813178.converted" returned: 0 in 0.714s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e94523494535035252278e76cc30c6c229813178.converted --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:51 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:52:51 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:52:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=7377MB free_disk=25.162464141845703GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 13:52:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance f4f7788c-fcca-47c1-b5b8-72892253982d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:52:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 07bac569-8b2c-4555-b4d5-a74f7384630b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:52:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance a9d4ec42-3db9-439b-87a7-02bcaab514a4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:52:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance c0994bac-3b43-414e-aa81-a9d7198775a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:52:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 782c6142-757a-49ae-9292-787a7f1e8a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:52:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 03255d24-b6fd-459c-8ac6-f9c4063b54b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:52:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 700e95c1-08b0-4613-992b-4314b127e14a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:52:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance b43ccb18-6d2d-43f2-a185-bb558d5d6f45 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:52:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 72f007af-a1e7-4a80-954c-ed12aaf129fd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:52:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:52:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (165d4635-93b4-49a6-879a-21c1324822ab): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Aug 14 13:52:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 13:52:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 13:52:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e94523494535035252278e76cc30c6c229813178.converted --force-share --output=json" returned: 0 in 0.213s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "e94523494535035252278e76cc30c6c229813178" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.310s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e94523494535035252278e76cc30c6c229813178 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:51 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Refreshing inventories for resource provider 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 13:52:51 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Updating ProviderTree inventory for provider 165d4635-93b4-49a6-879a-21c1324822ab from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 13:52:51 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Updating inventory in ProviderTree for provider 165d4635-93b4-49a6-879a-21c1324822ab with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 13:52:51 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Refreshing aggregate associations for resource provider 165d4635-93b4-49a6-879a-21c1324822ab, aggregates: None {{(pid=73484) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 13:52:51 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Refreshing trait associations for resource provider 165d4635-93b4-49a6-879a-21c1324822ab, traits: COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS {{(pid=73484) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 13:52:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e94523494535035252278e76cc30c6c229813178 --force-share --output=json" returned: 0 in 0.182s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "e94523494535035252278e76cc30c6c229813178" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "e94523494535035252278e76cc30c6c229813178" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e94523494535035252278e76cc30c6c229813178 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e94523494535035252278e76cc30c6c229813178 --force-share --output=json" returned: 0 in 0.186s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e94523494535035252278e76cc30c6c229813178,backing_fmt=raw /opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e94523494535035252278e76cc30c6c229813178,backing_fmt=raw /opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk 1073741824" returned: 0 in 0.070s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "e94523494535035252278e76cc30c6c229813178" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e94523494535035252278e76cc30c6c229813178 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:52 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:52 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:52:52 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:52:52 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 13:52:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.761s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e94523494535035252278e76cc30c6c229813178 --force-share --output=json" returned: 0 in 0.182s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:52 user nova-compute[73484]: DEBUG nova.objects.instance [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lazy-loading 'migration_context' on Instance uuid 86580f0d-dd88-48fb-bce8-dc6f5edc01c6 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:52:52 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Rebasing disk image.
Aug 14 13:52:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.187s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 -F raw /opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:52:52 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:53 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:52:53 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:52:53 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:52:53 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:52:53 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:52:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:54 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:52:54 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 -F raw /opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk" returned: 0 in 2.525s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Ensure instance console log exists: /opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Start _get_guest_xml network_info=[{"id": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "address": "fa:16:3e:20:8b:68", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0b7e99-89", "ovs_interfaceid": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='5824396649997ecf03ccec91d42e0260',container_format='bare',created_at=2023-08-14T13:50:54Z,direct_url=<?>,disk_format='qcow2',id=4798089e-db5f-45e6-8a31-ecd7e9b1867f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1425856117-shelved',owner='0c1ccc7c1aaf497da5f1d325d79e9301',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-14T13:50:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:52:55 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:52:55 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:52:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5824396649997ecf03ccec91d42e0260',container_format='bare',created_at=2023-08-14T13:50:54Z,direct_url=<?>,disk_format='qcow2',id=4798089e-db5f-45e6-8a31-ecd7e9b1867f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1425856117-shelved',owner='0c1ccc7c1aaf497da5f1d325d79e9301',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-14T13:50:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG nova.objects.instance [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lazy-loading 'vcpu_model' on Instance uuid 86580f0d-dd88-48fb-bce8-dc6f5edc01c6 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T13:48:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1425856117',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1425856117',id=30,image_ref='4798089e-db5f-45e6-8a31-ecd7e9b1867f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-396971079',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:49:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0c1ccc7c1aaf497da5f1d325d79e9301',ramdisk_id='',reservation_id='r-ypie00bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1730232968',owner_user_name='tempest-AttachVolumeShelveTestJSON-1730232968-project-member',shelved_at='2023-08-14T13:50:59.026192',shelved_host='user',shelved_image_id='4798089e-db5f-45e6-8a31-ecd7e9b1867f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:52:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bda36df8b1f64c7894bfee5da258c1e6',uuid=86580f0d-dd88-48fb-bce8-dc6f5edc01c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "address": "fa:16:3e:20:8b:68", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0b7e99-89", "ovs_interfaceid": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Converting VIF {"id": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "address": "fa:16:3e:20:8b:68", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0b7e99-89", "ovs_interfaceid": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:8b:68,bridge_name='br-int',has_traffic_filtering=True,id=8f0b7e99-89d1-4234-a552-e92df188cd4e,network=Network(cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f0b7e99-89') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG nova.objects.instance [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lazy-loading 'pci_devices' on Instance uuid 86580f0d-dd88-48fb-bce8-dc6f5edc01c6 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:52:55 user nova-compute[73484]:   <uuid>86580f0d-dd88-48fb-bce8-dc6f5edc01c6</uuid>
Aug 14 13:52:55 user nova-compute[73484]:   <name>instance-0000001e</name>
Aug 14 13:52:55 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:52:55 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:52:55 user nova-compute[73484]:   <metadata>
Aug 14 13:52:55 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:52:55 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:52:55 user nova-compute[73484]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1425856117</nova:name>
Aug 14 13:52:55 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:52:55</nova:creationTime>
Aug 14 13:52:55 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:52:55 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:52:55 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:52:55 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:52:55 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:52:55 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:52:55 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:52:55 user nova-compute[73484]:       <nova:owner>
Aug 14 13:52:55 user nova-compute[73484]:         <nova:user uuid="bda36df8b1f64c7894bfee5da258c1e6">tempest-AttachVolumeShelveTestJSON-1730232968-project-member</nova:user>
Aug 14 13:52:55 user nova-compute[73484]:         <nova:project uuid="0c1ccc7c1aaf497da5f1d325d79e9301">tempest-AttachVolumeShelveTestJSON-1730232968</nova:project>
Aug 14 13:52:55 user nova-compute[73484]:       </nova:owner>
Aug 14 13:52:55 user nova-compute[73484]:       <nova:root type="image" uuid="4798089e-db5f-45e6-8a31-ecd7e9b1867f"/>
Aug 14 13:52:55 user nova-compute[73484]:       <nova:ports>
Aug 14 13:52:55 user nova-compute[73484]:         <nova:port uuid="8f0b7e99-89d1-4234-a552-e92df188cd4e">
Aug 14 13:52:55 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 13:52:55 user nova-compute[73484]:         </nova:port>
Aug 14 13:52:55 user nova-compute[73484]:       </nova:ports>
Aug 14 13:52:55 user nova-compute[73484]:     </nova:instance>
Aug 14 13:52:55 user nova-compute[73484]:   </metadata>
Aug 14 13:52:55 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:52:55 user nova-compute[73484]:     <system>
Aug 14 13:52:55 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:52:55 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:52:55 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:52:55 user nova-compute[73484]:       <entry name="serial">86580f0d-dd88-48fb-bce8-dc6f5edc01c6</entry>
Aug 14 13:52:55 user nova-compute[73484]:       <entry name="uuid">86580f0d-dd88-48fb-bce8-dc6f5edc01c6</entry>
Aug 14 13:52:55 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:52:55 user nova-compute[73484]:     </system>
Aug 14 13:52:55 user nova-compute[73484]:   </sysinfo>
Aug 14 13:52:55 user nova-compute[73484]:   <os>
Aug 14 13:52:55 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:52:55 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:52:55 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:52:55 user nova-compute[73484]:   </os>
Aug 14 13:52:55 user nova-compute[73484]:   <features>
Aug 14 13:52:55 user nova-compute[73484]:     <acpi/>
Aug 14 13:52:55 user nova-compute[73484]:     <apic/>
Aug 14 13:52:55 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:52:55 user nova-compute[73484]:   </features>
Aug 14 13:52:55 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:52:55 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:52:55 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:52:55 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:52:55 user nova-compute[73484]:   </clock>
Aug 14 13:52:55 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:52:55 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:52:55 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:52:55 user nova-compute[73484]:   </cpu>
Aug 14 13:52:55 user nova-compute[73484]:   <devices>
Aug 14 13:52:55 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:52:55 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:52:55 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk"/>
Aug 14 13:52:55 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:52:55 user nova-compute[73484]:     </disk>
Aug 14 13:52:55 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:52:55 user nova-compute[73484]:       <mac address="fa:16:3e:20:8b:68"/>
Aug 14 13:52:55 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:52:55 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:52:55 user nova-compute[73484]:       <target dev="tap8f0b7e99-89"/>
Aug 14 13:52:55 user nova-compute[73484]:     </interface>
Aug 14 13:52:55 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:52:55 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/console.log" append="off"/>
Aug 14 13:52:55 user nova-compute[73484]:     </serial>
Aug 14 13:52:55 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:52:55 user nova-compute[73484]:     <video>
Aug 14 13:52:55 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:52:55 user nova-compute[73484]:     </video>
Aug 14 13:52:55 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:52:55 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:52:55 user nova-compute[73484]:     </rng>
Aug 14 13:52:55 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:52:55 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:52:55 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:52:55 user nova-compute[73484]:     </memballoon>
Aug 14 13:52:55 user nova-compute[73484]:   </devices>
Aug 14 13:52:55 user nova-compute[73484]: </domain>
Aug 14 13:52:55 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T13:48:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1425856117',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1425856117',id=30,image_ref='4798089e-db5f-45e6-8a31-ecd7e9b1867f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-396971079',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:49:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0c1ccc7c1aaf497da5f1d325d79e9301',ramdisk_id='',reservation_id='r-ypie00bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1730232968',owner_user_name='tempest-AttachVolumeShelveTestJSON-1730232968-project-member',shelved_at='2023-08-14T13:50:59.026192',shelved_host='user',shelved_image_id='4798089e-db5f-45e6-8a31-ecd7e9b1867f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:52:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bda36df8b1f64c7894bfee5da258c1e6',uuid=86580f0d-dd88-48fb-bce8-dc6f5edc01c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "address": "fa:16:3e:20:8b:68", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0b7e99-89", "ovs_interfaceid": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Converting VIF {"id": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "address": "fa:16:3e:20:8b:68", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0b7e99-89", "ovs_interfaceid": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:8b:68,bridge_name='br-int',has_traffic_filtering=True,id=8f0b7e99-89d1-4234-a552-e92df188cd4e,network=Network(cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f0b7e99-89') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG os_vif [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:8b:68,bridge_name='br-int',has_traffic_filtering=True,id=8f0b7e99-89d1-4234-a552-e92df188cd4e,network=Network(cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f0b7e99-89') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f0b7e99-89, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8f0b7e99-89, col_values=(('external_ids', {'iface-id': '8f0b7e99-89d1-4234-a552-e92df188cd4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:8b:68', 'vm-uuid': '86580f0d-dd88-48fb-bce8-dc6f5edc01c6'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:55 user nova-compute[73484]: INFO os_vif [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:8b:68,bridge_name='br-int',has_traffic_filtering=True,id=8f0b7e99-89d1-4234-a552-e92df188cd4e,network=Network(cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f0b7e99-89')
Aug 14 13:52:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] No VIF found with MAC fa:16:3e:20:8b:68, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:52:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:57 user nova-compute[73484]: DEBUG nova.compute.manager [req-deac8bd7-996b-4676-8ea6-465e73d392a0 req-6eeb1410-ebb0-4254-879d-b3dbf0093780 service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Received event network-vif-plugged-8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:52:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-deac8bd7-996b-4676-8ea6-465e73d392a0 req-6eeb1410-ebb0-4254-879d-b3dbf0093780 service nova] Acquiring lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-deac8bd7-996b-4676-8ea6-465e73d392a0 req-6eeb1410-ebb0-4254-879d-b3dbf0093780 service nova] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-deac8bd7-996b-4676-8ea6-465e73d392a0 req-6eeb1410-ebb0-4254-879d-b3dbf0093780 service nova] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:57 user nova-compute[73484]: DEBUG nova.compute.manager [req-deac8bd7-996b-4676-8ea6-465e73d392a0 req-6eeb1410-ebb0-4254-879d-b3dbf0093780 service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] No waiting events found dispatching network-vif-plugged-8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:52:57 user nova-compute[73484]: WARNING nova.compute.manager [req-deac8bd7-996b-4676-8ea6-465e73d392a0 req-6eeb1410-ebb0-4254-879d-b3dbf0093780 service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Received unexpected event network-vif-plugged-8f0b7e99-89d1-4234-a552-e92df188cd4e for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 13:52:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:59 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021179.3922584, 86580f0d-dd88-48fb-bce8-dc6f5edc01c6 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:52:59 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] VM Resumed (Lifecycle Event)
Aug 14 13:52:59 user nova-compute[73484]: DEBUG nova.compute.manager [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:52:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:52:59 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Instance spawned successfully.
Aug 14 13:52:59 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:52:59 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:52:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquiring lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:59 user nova-compute[73484]: DEBUG nova.compute.manager [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:52:59 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:52:59 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021179.3962898, 86580f0d-dd88-48fb-bce8-dc6f5edc01c6 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:52:59 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] VM Started (Lifecycle Event)
Aug 14 13:52:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:52:59 user nova-compute[73484]: DEBUG nova.compute.manager [req-8c44c73e-e0cc-4f05-87a2-18819e7f493c req-16f9aefc-bf5c-4a1f-a6f8-cb22c37d3737 service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Received event network-vif-plugged-8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:52:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8c44c73e-e0cc-4f05-87a2-18819e7f493c req-16f9aefc-bf5c-4a1f-a6f8-cb22c37d3737 service nova] Acquiring lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8c44c73e-e0cc-4f05-87a2-18819e7f493c req-16f9aefc-bf5c-4a1f-a6f8-cb22c37d3737 service nova] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8c44c73e-e0cc-4f05-87a2-18819e7f493c req-16f9aefc-bf5c-4a1f-a6f8-cb22c37d3737 service nova] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:59 user nova-compute[73484]: DEBUG nova.compute.manager [req-8c44c73e-e0cc-4f05-87a2-18819e7f493c req-16f9aefc-bf5c-4a1f-a6f8-cb22c37d3737 service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] No waiting events found dispatching network-vif-plugged-8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:52:59 user nova-compute[73484]: WARNING nova.compute.manager [req-8c44c73e-e0cc-4f05-87a2-18819e7f493c req-16f9aefc-bf5c-4a1f-a6f8-cb22c37d3737 service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Received unexpected event network-vif-plugged-8f0b7e99-89d1-4234-a552-e92df188cd4e for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 13:52:59 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:52:59 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:52:59 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:52:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:52:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:52:59 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:52:59 user nova-compute[73484]: INFO nova.compute.claims [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Claim successful on node user
Aug 14 13:52:59 user nova-compute[73484]: DEBUG nova.compute.manager [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:52:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-606aa818-5360-4ef2-b56c-e06f49b7ff26 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.479s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:52:59 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:53:00 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:53:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:00 user nova-compute[73484]: DEBUG nova.compute.manager [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:53:00 user nova-compute[73484]: DEBUG nova.compute.manager [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:53:00 user nova-compute[73484]: DEBUG nova.network.neutron [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:53:00 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:53:00 user nova-compute[73484]: DEBUG nova.compute.manager [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:53:00 user nova-compute[73484]: DEBUG nova.policy [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e9d4aa3f4ad04184bb6181332a6ef6e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a442b6e525b4ae9ba256aa1c71e1a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:53:00 user nova-compute[73484]: DEBUG nova.compute.manager [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:53:00 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:53:00 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Creating image(s)
Aug 14 13:53:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "/opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "/opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.190s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.199s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk 1073741824" returned: 0 in 0.068s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:00 user nova-compute[73484]: DEBUG nova.network.neutron [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Successfully created port: b5ceef09-ab2f-4db8-8c7b-c239fc361daf {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:53:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.223s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:00 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:53:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:01 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Cannot resize image /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:53:01 user nova-compute[73484]: DEBUG nova.objects.instance [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lazy-loading 'migration_context' on Instance uuid b8a790d0-e5d0-4b78-8de4-36a58290b4ee {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:53:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:53:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Ensure instance console log exists: /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:53:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:01 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:53:01 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Cleaning up deleted instances {{(pid=73484) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 13:53:01 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] There are 0 instances to clean {{(pid=73484) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.network.neutron [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Successfully updated port: b5ceef09-ab2f-4db8-8c7b-c239fc361daf {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquiring lock "refresh_cache-b8a790d0-e5d0-4b78-8de4-36a58290b4ee" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquired lock "refresh_cache-b8a790d0-e5d0-4b78-8de4-36a58290b4ee" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.network.neutron [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.compute.manager [req-2cdd7dd7-46b8-4867-82da-23d78afe22a5 req-1f3a200d-46a5-40b1-8571-2028b95f0223 service nova] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Received event network-changed-b5ceef09-ab2f-4db8-8c7b-c239fc361daf {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.compute.manager [req-2cdd7dd7-46b8-4867-82da-23d78afe22a5 req-1f3a200d-46a5-40b1-8571-2028b95f0223 service nova] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Refreshing instance network info cache due to event network-changed-b5ceef09-ab2f-4db8-8c7b-c239fc361daf. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2cdd7dd7-46b8-4867-82da-23d78afe22a5 req-1f3a200d-46a5-40b1-8571-2028b95f0223 service nova] Acquiring lock "refresh_cache-b8a790d0-e5d0-4b78-8de4-36a58290b4ee" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.network.neutron [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.network.neutron [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Updating instance_info_cache with network_info: [{"id": "b5ceef09-ab2f-4db8-8c7b-c239fc361daf", "address": "fa:16:3e:60:5a:aa", "network": {"id": "8f719ef2-7286-46f1-96e0-d08fd389db0e", "bridge": "br-int", "label": "tempest-TestStampPattern-1811054691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a442b6e525b4ae9ba256aa1c71e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ceef09-ab", "ovs_interfaceid": "b5ceef09-ab2f-4db8-8c7b-c239fc361daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Releasing lock "refresh_cache-b8a790d0-e5d0-4b78-8de4-36a58290b4ee" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.compute.manager [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Instance network_info: |[{"id": "b5ceef09-ab2f-4db8-8c7b-c239fc361daf", "address": "fa:16:3e:60:5a:aa", "network": {"id": "8f719ef2-7286-46f1-96e0-d08fd389db0e", "bridge": "br-int", "label": "tempest-TestStampPattern-1811054691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a442b6e525b4ae9ba256aa1c71e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ceef09-ab", "ovs_interfaceid": "b5ceef09-ab2f-4db8-8c7b-c239fc361daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2cdd7dd7-46b8-4867-82da-23d78afe22a5 req-1f3a200d-46a5-40b1-8571-2028b95f0223 service nova] Acquired lock "refresh_cache-b8a790d0-e5d0-4b78-8de4-36a58290b4ee" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.network.neutron [req-2cdd7dd7-46b8-4867-82da-23d78afe22a5 req-1f3a200d-46a5-40b1-8571-2028b95f0223 service nova] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Refreshing network info cache for port b5ceef09-ab2f-4db8-8c7b-c239fc361daf {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Start _get_guest_xml network_info=[{"id": "b5ceef09-ab2f-4db8-8c7b-c239fc361daf", "address": "fa:16:3e:60:5a:aa", "network": {"id": "8f719ef2-7286-46f1-96e0-d08fd389db0e", "bridge": "br-int", "label": "tempest-TestStampPattern-1811054691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a442b6e525b4ae9ba256aa1c71e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ceef09-ab", "ovs_interfaceid": "b5ceef09-ab2f-4db8-8c7b-c239fc361daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:53:02 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:53:02 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1407297266',display_name='tempest-TestStampPattern-server-1407297266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1407297266',id=34,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcHOndY4thu+Li/XG3hWqIOD4cGsaZ6per43xYR1P6MSwf1FXn+zuKlHDSmWjudBpUwpsq+XH3XDp8yg1o4KErin8MFeGY1rhZ0UCW+BGzI3wFo1KaDX12K6RUas0q53g==',key_name='tempest-TestStampPattern-1459796457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a442b6e525b4ae9ba256aa1c71e1a94',ramdisk_id='',reservation_id='r-fn3so310',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-678241444',owner_user_name='tempest-TestStampPattern-678241444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:53:00Z,user_data=None,user_id='e9d4aa3f4ad04184bb6181332a6ef6e1',uuid=b8a790d0-e5d0-4b78-8de4-36a58290b4ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5ceef09-ab2f-4db8-8c7b-c239fc361daf", "address": "fa:16:3e:60:5a:aa", "network": {"id": "8f719ef2-7286-46f1-96e0-d08fd389db0e", "bridge": "br-int", "label": "tempest-TestStampPattern-1811054691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a442b6e525b4ae9ba256aa1c71e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ceef09-ab", "ovs_interfaceid": "b5ceef09-ab2f-4db8-8c7b-c239fc361daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Converting VIF {"id": "b5ceef09-ab2f-4db8-8c7b-c239fc361daf", "address": "fa:16:3e:60:5a:aa", "network": {"id": "8f719ef2-7286-46f1-96e0-d08fd389db0e", "bridge": "br-int", "label": "tempest-TestStampPattern-1811054691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a442b6e525b4ae9ba256aa1c71e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ceef09-ab", "ovs_interfaceid": "b5ceef09-ab2f-4db8-8c7b-c239fc361daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:5a:aa,bridge_name='br-int',has_traffic_filtering=True,id=b5ceef09-ab2f-4db8-8c7b-c239fc361daf,network=Network(8f719ef2-7286-46f1-96e0-d08fd389db0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ceef09-ab') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.objects.instance [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lazy-loading 'pci_devices' on Instance uuid b8a790d0-e5d0-4b78-8de4-36a58290b4ee {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:53:02 user nova-compute[73484]:   <uuid>b8a790d0-e5d0-4b78-8de4-36a58290b4ee</uuid>
Aug 14 13:53:02 user nova-compute[73484]:   <name>instance-00000022</name>
Aug 14 13:53:02 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:53:02 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:53:02 user nova-compute[73484]:   <metadata>
Aug 14 13:53:02 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:53:02 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:53:02 user nova-compute[73484]:       <nova:name>tempest-TestStampPattern-server-1407297266</nova:name>
Aug 14 13:53:02 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:53:02</nova:creationTime>
Aug 14 13:53:02 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:53:02 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:53:02 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:53:02 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:53:02 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:53:02 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:53:02 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:53:02 user nova-compute[73484]:       <nova:owner>
Aug 14 13:53:02 user nova-compute[73484]:         <nova:user uuid="e9d4aa3f4ad04184bb6181332a6ef6e1">tempest-TestStampPattern-678241444-project-member</nova:user>
Aug 14 13:53:02 user nova-compute[73484]:         <nova:project uuid="5a442b6e525b4ae9ba256aa1c71e1a94">tempest-TestStampPattern-678241444</nova:project>
Aug 14 13:53:02 user nova-compute[73484]:       </nova:owner>
Aug 14 13:53:02 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:53:02 user nova-compute[73484]:       <nova:ports>
Aug 14 13:53:02 user nova-compute[73484]:         <nova:port uuid="b5ceef09-ab2f-4db8-8c7b-c239fc361daf">
Aug 14 13:53:02 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 13:53:02 user nova-compute[73484]:         </nova:port>
Aug 14 13:53:02 user nova-compute[73484]:       </nova:ports>
Aug 14 13:53:02 user nova-compute[73484]:     </nova:instance>
Aug 14 13:53:02 user nova-compute[73484]:   </metadata>
Aug 14 13:53:02 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:53:02 user nova-compute[73484]:     <system>
Aug 14 13:53:02 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:53:02 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:53:02 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:53:02 user nova-compute[73484]:       <entry name="serial">b8a790d0-e5d0-4b78-8de4-36a58290b4ee</entry>
Aug 14 13:53:02 user nova-compute[73484]:       <entry name="uuid">b8a790d0-e5d0-4b78-8de4-36a58290b4ee</entry>
Aug 14 13:53:02 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:53:02 user nova-compute[73484]:     </system>
Aug 14 13:53:02 user nova-compute[73484]:   </sysinfo>
Aug 14 13:53:02 user nova-compute[73484]:   <os>
Aug 14 13:53:02 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:53:02 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:53:02 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:53:02 user nova-compute[73484]:   </os>
Aug 14 13:53:02 user nova-compute[73484]:   <features>
Aug 14 13:53:02 user nova-compute[73484]:     <acpi/>
Aug 14 13:53:02 user nova-compute[73484]:     <apic/>
Aug 14 13:53:02 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:53:02 user nova-compute[73484]:   </features>
Aug 14 13:53:02 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:53:02 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:53:02 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:53:02 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:53:02 user nova-compute[73484]:   </clock>
Aug 14 13:53:02 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:53:02 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:53:02 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:53:02 user nova-compute[73484]:   </cpu>
Aug 14 13:53:02 user nova-compute[73484]:   <devices>
Aug 14 13:53:02 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:53:02 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:53:02 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk"/>
Aug 14 13:53:02 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:53:02 user nova-compute[73484]:     </disk>
Aug 14 13:53:02 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:53:02 user nova-compute[73484]:       <mac address="fa:16:3e:60:5a:aa"/>
Aug 14 13:53:02 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:53:02 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:53:02 user nova-compute[73484]:       <target dev="tapb5ceef09-ab"/>
Aug 14 13:53:02 user nova-compute[73484]:     </interface>
Aug 14 13:53:02 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:53:02 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/console.log" append="off"/>
Aug 14 13:53:02 user nova-compute[73484]:     </serial>
Aug 14 13:53:02 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:53:02 user nova-compute[73484]:     <video>
Aug 14 13:53:02 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:53:02 user nova-compute[73484]:     </video>
Aug 14 13:53:02 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:53:02 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:53:02 user nova-compute[73484]:     </rng>
Aug 14 13:53:02 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:53:02 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:53:02 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:53:02 user nova-compute[73484]:     </memballoon>
Aug 14 13:53:02 user nova-compute[73484]:   </devices>
Aug 14 13:53:02 user nova-compute[73484]: </domain>
Aug 14 13:53:02 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1407297266',display_name='tempest-TestStampPattern-server-1407297266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1407297266',id=34,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcHOndY4thu+Li/XG3hWqIOD4cGsaZ6per43xYR1P6MSwf1FXn+zuKlHDSmWjudBpUwpsq+XH3XDp8yg1o4KErin8MFeGY1rhZ0UCW+BGzI3wFo1KaDX12K6RUas0q53g==',key_name='tempest-TestStampPattern-1459796457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a442b6e525b4ae9ba256aa1c71e1a94',ramdisk_id='',reservation_id='r-fn3so310',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-678241444',owner_user_name='tempest-TestStampPattern-678241444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:53:00Z,user_data=None,user_id='e9d4aa3f4ad04184bb6181332a6ef6e1',uuid=b8a790d0-e5d0-4b78-8de4-36a58290b4ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5ceef09-ab2f-4db8-8c7b-c239fc361daf", "address": "fa:16:3e:60:5a:aa", "network": {"id": "8f719ef2-7286-46f1-96e0-d08fd389db0e", "bridge": "br-int", "label": "tempest-TestStampPattern-1811054691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a442b6e525b4ae9ba256aa1c71e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ceef09-ab", "ovs_interfaceid": "b5ceef09-ab2f-4db8-8c7b-c239fc361daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Converting VIF {"id": "b5ceef09-ab2f-4db8-8c7b-c239fc361daf", "address": "fa:16:3e:60:5a:aa", "network": {"id": "8f719ef2-7286-46f1-96e0-d08fd389db0e", "bridge": "br-int", "label": "tempest-TestStampPattern-1811054691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a442b6e525b4ae9ba256aa1c71e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ceef09-ab", "ovs_interfaceid": "b5ceef09-ab2f-4db8-8c7b-c239fc361daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:5a:aa,bridge_name='br-int',has_traffic_filtering=True,id=b5ceef09-ab2f-4db8-8c7b-c239fc361daf,network=Network(8f719ef2-7286-46f1-96e0-d08fd389db0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ceef09-ab') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG os_vif [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:5a:aa,bridge_name='br-int',has_traffic_filtering=True,id=b5ceef09-ab2f-4db8-8c7b-c239fc361daf,network=Network(8f719ef2-7286-46f1-96e0-d08fd389db0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ceef09-ab') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5ceef09-ab, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb5ceef09-ab, col_values=(('external_ids', {'iface-id': 'b5ceef09-ab2f-4db8-8c7b-c239fc361daf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:5a:aa', 'vm-uuid': 'b8a790d0-e5d0-4b78-8de4-36a58290b4ee'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:02 user nova-compute[73484]: INFO os_vif [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:5a:aa,bridge_name='br-int',has_traffic_filtering=True,id=b5ceef09-ab2f-4db8-8c7b-c239fc361daf,network=Network(8f719ef2-7286-46f1-96e0-d08fd389db0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ceef09-ab')
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] No VIF found with MAC fa:16:3e:60:5a:aa, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.network.neutron [req-2cdd7dd7-46b8-4867-82da-23d78afe22a5 req-1f3a200d-46a5-40b1-8571-2028b95f0223 service nova] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Updated VIF entry in instance network info cache for port b5ceef09-ab2f-4db8-8c7b-c239fc361daf. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG nova.network.neutron [req-2cdd7dd7-46b8-4867-82da-23d78afe22a5 req-1f3a200d-46a5-40b1-8571-2028b95f0223 service nova] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Updating instance_info_cache with network_info: [{"id": "b5ceef09-ab2f-4db8-8c7b-c239fc361daf", "address": "fa:16:3e:60:5a:aa", "network": {"id": "8f719ef2-7286-46f1-96e0-d08fd389db0e", "bridge": "br-int", "label": "tempest-TestStampPattern-1811054691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a442b6e525b4ae9ba256aa1c71e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ceef09-ab", "ovs_interfaceid": "b5ceef09-ab2f-4db8-8c7b-c239fc361daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:53:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2cdd7dd7-46b8-4867-82da-23d78afe22a5 req-1f3a200d-46a5-40b1-8571-2028b95f0223 service nova] Releasing lock "refresh_cache-b8a790d0-e5d0-4b78-8de4-36a58290b4ee" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:53:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:04 user nova-compute[73484]: DEBUG nova.compute.manager [req-0ae029e4-5613-4613-bfa7-385a12bcdd66 req-f89724eb-fa0a-43d7-8f41-bb97b9146336 service nova] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Received event network-vif-plugged-b5ceef09-ab2f-4db8-8c7b-c239fc361daf {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:53:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0ae029e4-5613-4613-bfa7-385a12bcdd66 req-f89724eb-fa0a-43d7-8f41-bb97b9146336 service nova] Acquiring lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0ae029e4-5613-4613-bfa7-385a12bcdd66 req-f89724eb-fa0a-43d7-8f41-bb97b9146336 service nova] Lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0ae029e4-5613-4613-bfa7-385a12bcdd66 req-f89724eb-fa0a-43d7-8f41-bb97b9146336 service nova] Lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:04 user nova-compute[73484]: DEBUG nova.compute.manager [req-0ae029e4-5613-4613-bfa7-385a12bcdd66 req-f89724eb-fa0a-43d7-8f41-bb97b9146336 service nova] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] No waiting events found dispatching network-vif-plugged-b5ceef09-ab2f-4db8-8c7b-c239fc361daf {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:53:04 user nova-compute[73484]: WARNING nova.compute.manager [req-0ae029e4-5613-4613-bfa7-385a12bcdd66 req-f89724eb-fa0a-43d7-8f41-bb97b9146336 service nova] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Received unexpected event network-vif-plugged-b5ceef09-ab2f-4db8-8c7b-c239fc361daf for instance with vm_state building and task_state spawning.
Aug 14 13:53:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:06 user nova-compute[73484]: DEBUG nova.compute.manager [req-2280f117-28d5-4a36-8ca1-8c62ec67690e req-39b90b83-24a9-4130-bb04-a48dcba7a917 service nova] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Received event network-vif-plugged-b5ceef09-ab2f-4db8-8c7b-c239fc361daf {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:53:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2280f117-28d5-4a36-8ca1-8c62ec67690e req-39b90b83-24a9-4130-bb04-a48dcba7a917 service nova] Acquiring lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2280f117-28d5-4a36-8ca1-8c62ec67690e req-39b90b83-24a9-4130-bb04-a48dcba7a917 service nova] Lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2280f117-28d5-4a36-8ca1-8c62ec67690e req-39b90b83-24a9-4130-bb04-a48dcba7a917 service nova] Lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:06 user nova-compute[73484]: DEBUG nova.compute.manager [req-2280f117-28d5-4a36-8ca1-8c62ec67690e req-39b90b83-24a9-4130-bb04-a48dcba7a917 service nova] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] No waiting events found dispatching network-vif-plugged-b5ceef09-ab2f-4db8-8c7b-c239fc361daf {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:53:06 user nova-compute[73484]: WARNING nova.compute.manager [req-2280f117-28d5-4a36-8ca1-8c62ec67690e req-39b90b83-24a9-4130-bb04-a48dcba7a917 service nova] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Received unexpected event network-vif-plugged-b5ceef09-ab2f-4db8-8c7b-c239fc361daf for instance with vm_state building and task_state spawning.
Aug 14 13:53:06 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021186.6731348, b8a790d0-e5d0-4b78-8de4-36a58290b4ee => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:53:06 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] VM Resumed (Lifecycle Event)
Aug 14 13:53:06 user nova-compute[73484]: DEBUG nova.compute.manager [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:53:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:53:06 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Instance spawned successfully.
Aug 14 13:53:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:53:06 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:53:06 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:53:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:53:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:53:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:53:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:53:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:53:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:53:06 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:53:06 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021186.6804962, b8a790d0-e5d0-4b78-8de4-36a58290b4ee => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:53:06 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] VM Started (Lifecycle Event)
Aug 14 13:53:06 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:53:06 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:53:06 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:53:06 user nova-compute[73484]: INFO nova.compute.manager [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Took 6.55 seconds to spawn the instance on the hypervisor.
Aug 14 13:53:06 user nova-compute[73484]: DEBUG nova.compute.manager [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:53:06 user nova-compute[73484]: INFO nova.compute.manager [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Took 7.38 seconds to build instance.
Aug 14 13:53:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-71b52101-2e1b-468a-a84f-0adf51fbebce tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.503s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:07 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-28840770-c928-4ff4-8fae-72bdbc3bbb17 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "700e95c1-08b0-4613-992b-4314b127e14a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-28840770-c928-4ff4-8fae-72bdbc3bbb17 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "700e95c1-08b0-4613-992b-4314b127e14a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-28840770-c928-4ff4-8fae-72bdbc3bbb17 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "700e95c1-08b0-4613-992b-4314b127e14a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-28840770-c928-4ff4-8fae-72bdbc3bbb17 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "700e95c1-08b0-4613-992b-4314b127e14a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-28840770-c928-4ff4-8fae-72bdbc3bbb17 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "700e95c1-08b0-4613-992b-4314b127e14a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:19 user nova-compute[73484]: INFO nova.compute.manager [None req-28840770-c928-4ff4-8fae-72bdbc3bbb17 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Terminating instance
Aug 14 13:53:19 user nova-compute[73484]: DEBUG nova.compute.manager [None req-28840770-c928-4ff4-8fae-72bdbc3bbb17 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:53:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:20 user nova-compute[73484]: DEBUG nova.compute.manager [req-83a2730d-107f-4246-aada-fc3aed573a11 req-a7f61247-28da-4a27-8988-b5b058797617 service nova] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Received event network-vif-unplugged-28b48249-b438-4d6d-9432-5c94ed450cb8 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:53:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-83a2730d-107f-4246-aada-fc3aed573a11 req-a7f61247-28da-4a27-8988-b5b058797617 service nova] Acquiring lock "700e95c1-08b0-4613-992b-4314b127e14a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-83a2730d-107f-4246-aada-fc3aed573a11 req-a7f61247-28da-4a27-8988-b5b058797617 service nova] Lock "700e95c1-08b0-4613-992b-4314b127e14a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-83a2730d-107f-4246-aada-fc3aed573a11 req-a7f61247-28da-4a27-8988-b5b058797617 service nova] Lock "700e95c1-08b0-4613-992b-4314b127e14a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:20 user nova-compute[73484]: DEBUG nova.compute.manager [req-83a2730d-107f-4246-aada-fc3aed573a11 req-a7f61247-28da-4a27-8988-b5b058797617 service nova] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] No waiting events found dispatching network-vif-unplugged-28b48249-b438-4d6d-9432-5c94ed450cb8 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:53:20 user nova-compute[73484]: DEBUG nova.compute.manager [req-83a2730d-107f-4246-aada-fc3aed573a11 req-a7f61247-28da-4a27-8988-b5b058797617 service nova] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Received event network-vif-unplugged-28b48249-b438-4d6d-9432-5c94ed450cb8 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:53:20 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Instance destroyed successfully.
Aug 14 13:53:20 user nova-compute[73484]: DEBUG nova.objects.instance [None req-28840770-c928-4ff4-8fae-72bdbc3bbb17 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lazy-loading 'resources' on Instance uuid 700e95c1-08b0-4613-992b-4314b127e14a {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:53:20 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-28840770-c928-4ff4-8fae-72bdbc3bbb17 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:47:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-194305929',display_name='tempest-AttachVolumeNegativeTest-server-194305929',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-194305929',id=27,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVbeOMkzNy4KywIABE4JYqFIsKwL5gTYLpbYaCSwgSKGhAo4pPw9TNkh9zlQWNjXPpRLd1xhqQ2SFWL/sowgtIZeGLRZfjVsOHBgRJtGuYihTUoU25sAs4K4TpK2Nyukw==',key_name='tempest-keypair-511691696',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:47:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f404795fcace4922a10abdb33740e87d',ramdisk_id='',reservation_id='r-fl0nb06j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1043074889',owner_user_name='tempest-AttachVolumeNegativeTest-1043074889-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:47:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3ccc9cc867644d9bc040e9dfd4eb231',uuid=700e95c1-08b0-4613-992b-4314b127e14a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28b48249-b438-4d6d-9432-5c94ed450cb8", "address": "fa:16:3e:bb:3e:ce", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b48249-b4", "ovs_interfaceid": "28b48249-b438-4d6d-9432-5c94ed450cb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:53:20 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-28840770-c928-4ff4-8fae-72bdbc3bbb17 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Converting VIF {"id": "28b48249-b438-4d6d-9432-5c94ed450cb8", "address": "fa:16:3e:bb:3e:ce", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b48249-b4", "ovs_interfaceid": "28b48249-b438-4d6d-9432-5c94ed450cb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:53:20 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-28840770-c928-4ff4-8fae-72bdbc3bbb17 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:3e:ce,bridge_name='br-int',has_traffic_filtering=True,id=28b48249-b438-4d6d-9432-5c94ed450cb8,network=Network(10d4738f-25c6-4995-a4b7-6fbee86f070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b48249-b4') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:53:20 user nova-compute[73484]: DEBUG os_vif [None req-28840770-c928-4ff4-8fae-72bdbc3bbb17 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:3e:ce,bridge_name='br-int',has_traffic_filtering=True,id=28b48249-b438-4d6d-9432-5c94ed450cb8,network=Network(10d4738f-25c6-4995-a4b7-6fbee86f070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b48249-b4') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:53:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28b48249-b4, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:53:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:53:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:20 user nova-compute[73484]: INFO os_vif [None req-28840770-c928-4ff4-8fae-72bdbc3bbb17 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:3e:ce,bridge_name='br-int',has_traffic_filtering=True,id=28b48249-b438-4d6d-9432-5c94ed450cb8,network=Network(10d4738f-25c6-4995-a4b7-6fbee86f070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b48249-b4')
Aug 14 13:53:20 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-28840770-c928-4ff4-8fae-72bdbc3bbb17 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Deleting instance files /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a_del
Aug 14 13:53:20 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-28840770-c928-4ff4-8fae-72bdbc3bbb17 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Deletion of /opt/stack/data/nova/instances/700e95c1-08b0-4613-992b-4314b127e14a_del complete
Aug 14 13:53:20 user nova-compute[73484]: INFO nova.compute.manager [None req-28840770-c928-4ff4-8fae-72bdbc3bbb17 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 14 13:53:20 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-28840770-c928-4ff4-8fae-72bdbc3bbb17 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:53:20 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:53:20 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:53:21 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:53:21 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Took 0.91 seconds to deallocate network for instance.
Aug 14 13:53:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-28840770-c928-4ff4-8fae-72bdbc3bbb17 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-28840770-c928-4ff4-8fae-72bdbc3bbb17 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:22 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-28840770-c928-4ff4-8fae-72bdbc3bbb17 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:53:22 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-28840770-c928-4ff4-8fae-72bdbc3bbb17 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:53:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-28840770-c928-4ff4-8fae-72bdbc3bbb17 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:22 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-28840770-c928-4ff4-8fae-72bdbc3bbb17 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Deleted allocations for instance 700e95c1-08b0-4613-992b-4314b127e14a
Aug 14 13:53:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-28840770-c928-4ff4-8fae-72bdbc3bbb17 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "700e95c1-08b0-4613-992b-4314b127e14a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.306s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:22 user nova-compute[73484]: DEBUG nova.compute.manager [req-c017a3a4-30d9-41a9-bb14-2d983aabdc48 req-44b4099e-d594-48ca-af83-52c9145f200e service nova] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Received event network-vif-plugged-28b48249-b438-4d6d-9432-5c94ed450cb8 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:53:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c017a3a4-30d9-41a9-bb14-2d983aabdc48 req-44b4099e-d594-48ca-af83-52c9145f200e service nova] Acquiring lock "700e95c1-08b0-4613-992b-4314b127e14a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c017a3a4-30d9-41a9-bb14-2d983aabdc48 req-44b4099e-d594-48ca-af83-52c9145f200e service nova] Lock "700e95c1-08b0-4613-992b-4314b127e14a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c017a3a4-30d9-41a9-bb14-2d983aabdc48 req-44b4099e-d594-48ca-af83-52c9145f200e service nova] Lock "700e95c1-08b0-4613-992b-4314b127e14a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:22 user nova-compute[73484]: DEBUG nova.compute.manager [req-c017a3a4-30d9-41a9-bb14-2d983aabdc48 req-44b4099e-d594-48ca-af83-52c9145f200e service nova] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] No waiting events found dispatching network-vif-plugged-28b48249-b438-4d6d-9432-5c94ed450cb8 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:53:22 user nova-compute[73484]: WARNING nova.compute.manager [req-c017a3a4-30d9-41a9-bb14-2d983aabdc48 req-44b4099e-d594-48ca-af83-52c9145f200e service nova] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Received unexpected event network-vif-plugged-28b48249-b438-4d6d-9432-5c94ed450cb8 for instance with vm_state deleted and task_state None.
Aug 14 13:53:22 user nova-compute[73484]: DEBUG nova.compute.manager [req-c017a3a4-30d9-41a9-bb14-2d983aabdc48 req-44b4099e-d594-48ca-af83-52c9145f200e service nova] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Received event network-vif-deleted-28b48249-b438-4d6d-9432-5c94ed450cb8 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:53:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Triggering sync for uuid f4f7788c-fcca-47c1-b5b8-72892253982d {{(pid=73484) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Triggering sync for uuid 07bac569-8b2c-4555-b4d5-a74f7384630b {{(pid=73484) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Triggering sync for uuid a9d4ec42-3db9-439b-87a7-02bcaab514a4 {{(pid=73484) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Triggering sync for uuid c0994bac-3b43-414e-aa81-a9d7198775a6 {{(pid=73484) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Triggering sync for uuid 782c6142-757a-49ae-9292-787a7f1e8a23 {{(pid=73484) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Triggering sync for uuid 03255d24-b6fd-459c-8ac6-f9c4063b54b2 {{(pid=73484) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Triggering sync for uuid b43ccb18-6d2d-43f2-a185-bb558d5d6f45 {{(pid=73484) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Triggering sync for uuid 72f007af-a1e7-4a80-954c-ed12aaf129fd {{(pid=73484) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Triggering sync for uuid 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa {{(pid=73484) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Triggering sync for uuid b8a790d0-e5d0-4b78-8de4-36a58290b4ee {{(pid=73484) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Triggering sync for uuid 86580f0d-dd88-48fb-bce8-dc6f5edc01c6 {{(pid=73484) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "f4f7788c-fcca-47c1-b5b8-72892253982d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "f4f7788c-fcca-47c1-b5b8-72892253982d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "07bac569-8b2c-4555-b4d5-a74f7384630b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "07bac569-8b2c-4555-b4d5-a74f7384630b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "c0994bac-3b43-414e-aa81-a9d7198775a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "c0994bac-3b43-414e-aa81-a9d7198775a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "782c6142-757a-49ae-9292-787a7f1e8a23" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "782c6142-757a-49ae-9292-787a7f1e8a23" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "72f007af-a1e7-4a80-954c-ed12aaf129fd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "72f007af-a1e7-4a80-954c-ed12aaf129fd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "07bac569-8b2c-4555-b4d5-a74f7384630b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "f4f7788c-fcca-47c1-b5b8-72892253982d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "782c6142-757a-49ae-9292-787a7f1e8a23" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "c0994bac-3b43-414e-aa81-a9d7198775a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "72f007af-a1e7-4a80-954c-ed12aaf129fd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:35 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692021200.74423, 700e95c1-08b0-4613-992b-4314b127e14a => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:53:35 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] VM Stopped (Lifecycle Event)
Aug 14 13:53:35 user nova-compute[73484]: DEBUG nova.compute.manager [None req-ded817b8-57fc-42ae-b795-cdf79d9877ad None None] [instance: 700e95c1-08b0-4613-992b-4314b127e14a] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:53:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:43 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:53:44 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:53:44 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 13:53:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-782c6142-757a-49ae-9292-787a7f1e8a23" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:53:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-782c6142-757a-49ae-9292-787a7f1e8a23" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:53:44 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 13:53:45 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Updating instance_info_cache with network_info: [{"id": "2246e004-4f6b-449d-91b2-8e67b4f51006", "address": "fa:16:3e:31:2a:06", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2246e004-4f", "ovs_interfaceid": "2246e004-4f6b-449d-91b2-8e67b4f51006", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:53:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-782c6142-757a-49ae-9292-787a7f1e8a23" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:53:45 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 13:53:45 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:53:45 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 13:53:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:53:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 13:53:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:53:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:53:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:47 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:53:47 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:53:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:47 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 13:53:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:53:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:48 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:53:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:53:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:51 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:53:51 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:53:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=7233MB free_disk=25.124797821044922GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 13:53:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance f4f7788c-fcca-47c1-b5b8-72892253982d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:53:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 07bac569-8b2c-4555-b4d5-a74f7384630b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:53:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance a9d4ec42-3db9-439b-87a7-02bcaab514a4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:53:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance c0994bac-3b43-414e-aa81-a9d7198775a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:53:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 782c6142-757a-49ae-9292-787a7f1e8a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:53:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 03255d24-b6fd-459c-8ac6-f9c4063b54b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:53:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance b43ccb18-6d2d-43f2-a185-bb558d5d6f45 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:53:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 72f007af-a1e7-4a80-954c-ed12aaf129fd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:53:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:53:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 86580f0d-dd88-48fb-bce8-dc6f5edc01c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:53:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance b8a790d0-e5d0-4b78-8de4-36a58290b4ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:53:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 13:53:51 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 13:53:52 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:53:52 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:53:52 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 13:53:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.500s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:53 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:53:53 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:53:53 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:53:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:54 user nova-compute[73484]: INFO nova.compute.manager [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Terminating instance
Aug 14 13:53:54 user nova-compute[73484]: DEBUG nova.compute.manager [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:53:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG nova.compute.manager [req-6eae295b-69d8-464c-a6ed-2dd529d03c84 req-f40b07e0-2dcc-49c3-835b-73924a07121e service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Received event network-vif-unplugged-ea301764-93d8-4c55-a51f-5e50918be405 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6eae295b-69d8-464c-a6ed-2dd529d03c84 req-f40b07e0-2dcc-49c3-835b-73924a07121e service nova] Acquiring lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6eae295b-69d8-464c-a6ed-2dd529d03c84 req-f40b07e0-2dcc-49c3-835b-73924a07121e service nova] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6eae295b-69d8-464c-a6ed-2dd529d03c84 req-f40b07e0-2dcc-49c3-835b-73924a07121e service nova] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG nova.compute.manager [req-6eae295b-69d8-464c-a6ed-2dd529d03c84 req-f40b07e0-2dcc-49c3-835b-73924a07121e service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] No waiting events found dispatching network-vif-unplugged-ea301764-93d8-4c55-a51f-5e50918be405 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG nova.compute.manager [req-6eae295b-69d8-464c-a6ed-2dd529d03c84 req-f40b07e0-2dcc-49c3-835b-73924a07121e service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Received event network-vif-unplugged-ea301764-93d8-4c55-a51f-5e50918be405 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:55 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Instance destroyed successfully.
Aug 14 13:53:55 user nova-compute[73484]: DEBUG nova.objects.instance [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lazy-loading 'resources' on Instance uuid b43ccb18-6d2d-43f2-a185-bb558d5d6f45 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:48:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1059435803',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1059435803',id=28,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:50:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c7f2c51c0f84bf1aedcf493a9ff860f',ramdisk_id='',reservation_id='r-0us4hfk6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-830908511',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:52:09Z,user_data=None,user_id='5a0f55ad018d4c0ca587d8bdd40df4c8',uuid=b43ccb18-6d2d-43f2-a185-bb558d5d6f45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea301764-93d8-4c55-a51f-5e50918be405", "address": "fa:16:3e:ff:7c:5c", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea301764-93", "ovs_interfaceid": "ea301764-93d8-4c55-a51f-5e50918be405", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Converting VIF {"id": "ea301764-93d8-4c55-a51f-5e50918be405", "address": "fa:16:3e:ff:7c:5c", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea301764-93", "ovs_interfaceid": "ea301764-93d8-4c55-a51f-5e50918be405", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:7c:5c,bridge_name='br-int',has_traffic_filtering=True,id=ea301764-93d8-4c55-a51f-5e50918be405,network=Network(4ec437fc-4371-48d6-8026-b64423fbc0ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea301764-93') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG os_vif [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:7c:5c,bridge_name='br-int',has_traffic_filtering=True,id=ea301764-93d8-4c55-a51f-5e50918be405,network=Network(4ec437fc-4371-48d6-8026-b64423fbc0ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea301764-93') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea301764-93, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:53:55 user nova-compute[73484]: INFO os_vif [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:7c:5c,bridge_name='br-int',has_traffic_filtering=True,id=ea301764-93d8-4c55-a51f-5e50918be405,network=Network(4ec437fc-4371-48d6-8026-b64423fbc0ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea301764-93')
Aug 14 13:53:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikJcqojh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:53:55 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:53:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9ceaf0-ace0-4797-a683-14e17a0f1649]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27c2a95-311e-4040-b67d-457058d6ce75]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:53:55 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:53:55 user nova-compute[73484]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:53:55 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:53:55 user nova-compute[73484]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 (non-flash)
Aug 14 13:53:55 user nova-compute[73484]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:53:55 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc458334f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158'): ({'sdc'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Removing single pathed devices sdc {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04bc4ea-7cd6-4abb-bfb0-4e52ce43926d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[542e8146-b38d-442b-9730-c33233bd1f71]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Flushing IO for device /dev/sdc {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[53679489-1aca-42a7-9e37-67e322cca303]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e1ee70-8871-4cda-8829-a4a81d46efd1]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b9752dfd', '/dev/disk/by-id/scsi-26335356533383435', '/dev/disk/by-id/scsi-1SCST_BIOb9752dfd-c55e3845482f6cb8') {{(pid=84315) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bbd9a0-317a-4a69-95d1-4d549dad8993]: (4, None) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edfb216-941a-4936-a70e-9a5092d76c44]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e878e51-3a2e-488a-ae96-ebc5e733959b]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158, portal: 172.16.0.220,3260]
Aug 14 13:53:55 user nova-compute[73484]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158, portal: 172.16.0.220,3260] successful.
Aug 14 13:53:55 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15530639-5fd1-464f-895c-1db1b454c158 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[73705092-01a4-41b4-a413-5d821e9a7eeb]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] <== disconnect_volume: return (312ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:53:55 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Deleting instance files /opt/stack/data/nova/instances/b43ccb18-6d2d-43f2-a185-bb558d5d6f45_del
Aug 14 13:53:55 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Deletion of /opt/stack/data/nova/instances/b43ccb18-6d2d-43f2-a185-bb558d5d6f45_del complete
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:53:55 user nova-compute[73484]: INFO nova.compute.manager [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 14 13:53:55 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:53:55 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:53:56 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:53:56 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Took 0.52 seconds to deallocate network for instance.
Aug 14 13:53:56 user nova-compute[73484]: DEBUG nova.compute.manager [req-9dd31137-e84d-4ddc-bb97-db5178ced1c7 req-1a75d26d-dad6-4bf1-84e5-857efbb019c6 service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Received event network-vif-deleted-ea301764-93d8-4c55-a51f-5e50918be405 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:53:57 user nova-compute[73484]: DEBUG nova.compute.manager [req-e5d19d9e-f3a3-4865-9704-43a98e02b6d9 req-514c08a9-8e51-42bb-a4ea-0ee3867d1d2a service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Received event network-vif-plugged-ea301764-93d8-4c55-a51f-5e50918be405 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:53:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e5d19d9e-f3a3-4865-9704-43a98e02b6d9 req-514c08a9-8e51-42bb-a4ea-0ee3867d1d2a service nova] Acquiring lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e5d19d9e-f3a3-4865-9704-43a98e02b6d9 req-514c08a9-8e51-42bb-a4ea-0ee3867d1d2a service nova] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e5d19d9e-f3a3-4865-9704-43a98e02b6d9 req-514c08a9-8e51-42bb-a4ea-0ee3867d1d2a service nova] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:57 user nova-compute[73484]: DEBUG nova.compute.manager [req-e5d19d9e-f3a3-4865-9704-43a98e02b6d9 req-514c08a9-8e51-42bb-a4ea-0ee3867d1d2a service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] No waiting events found dispatching network-vif-plugged-ea301764-93d8-4c55-a51f-5e50918be405 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:53:57 user nova-compute[73484]: WARNING nova.compute.manager [req-e5d19d9e-f3a3-4865-9704-43a98e02b6d9 req-514c08a9-8e51-42bb-a4ea-0ee3867d1d2a service nova] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Received unexpected event network-vif-plugged-ea301764-93d8-4c55-a51f-5e50918be405 for instance with vm_state active and task_state deleting.
Aug 14 13:53:57 user nova-compute[73484]: INFO nova.compute.manager [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Took 0.76 seconds to detach 1 volumes for instance.
Aug 14 13:53:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:57 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:53:57 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:53:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:57 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Deleted allocations for instance b43ccb18-6d2d-43f2-a185-bb558d5d6f45
Aug 14 13:53:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e931b308-1950-488d-95a7-af46b6f3b6ef tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "b43ccb18-6d2d-43f2-a185-bb558d5d6f45" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.004s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "14999671-dcc7-43fa-85ec-21cbcf12d21e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:53:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:57 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:53:57 user nova-compute[73484]: INFO nova.compute.claims [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Claim successful on node user
Aug 14 13:53:58 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:53:58 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:53:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:58 user nova-compute[73484]: DEBUG nova.compute.manager [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:53:58 user nova-compute[73484]: DEBUG nova.compute.manager [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:53:58 user nova-compute[73484]: DEBUG nova.network.neutron [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:53:58 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:53:58 user nova-compute[73484]: DEBUG nova.compute.manager [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:53:58 user nova-compute[73484]: DEBUG nova.policy [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '45d86b9371024e3d95ece74ccb2c37d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4df46bcfb843b7ac6c17d106703950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:53:58 user nova-compute[73484]: DEBUG nova.compute.manager [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:53:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:53:58 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Creating image(s)
Aug 14 13:53:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "/opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "/opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "/opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Acquiring lock "a54902a5-df8a-473f-9cf1-a112528c3549" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "a54902a5-df8a-473f-9cf1-a112528c3549" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:58 user nova-compute[73484]: INFO nova.compute.manager [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Unshelving
Aug 14 13:53:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.180s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:58 user nova-compute[73484]: INFO nova.virt.block_device [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Booting with volume 5e55bf6f-36bb-45c9-84fe-491435460475 at /dev/vda
Aug 14 13:53:58 user nova-compute[73484]: DEBUG os_brick.utils [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:53:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:58 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cf62e5-aff7-4e75-81f5-7e3bac97e535]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:53:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:58 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9aa4fc7-91b3-4849-a0a3-1af8c852dabb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:53:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c680392-02dd-4d0e-82a9-b5b8c1e137bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:53:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.180s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d15a40f-e536-4b8b-b400-f317fb0d1eac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:53:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:53:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:53:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk 1073741824" returned: 0 in 0.085s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:53:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:53:59 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:53:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ee09b4-c988-4614-987f-418025c5c6dc]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:53:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:53:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:53:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:53:59 user nova-compute[73484]: DEBUG os_brick.utils [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] <== get_connector_properties: return (203ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:53:59 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Updating existing volume attachment record: 7f92aa44-01bf-4e69-a680-2767a7bf01ae {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:53:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.178s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:59 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Checking if we can resize image /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:53:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:53:59 user nova-compute[73484]: DEBUG nova.network.neutron [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Successfully created port: 0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:53:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:53:59 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Cannot resize image /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:53:59 user nova-compute[73484]: DEBUG nova.objects.instance [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'migration_context' on Instance uuid 14999671-dcc7-43fa-85ec-21cbcf12d21e {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:53:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:53:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Ensure instance console log exists: /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:53:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:53:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:53:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:00 user nova-compute[73484]: DEBUG nova.network.neutron [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Successfully updated port: 0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:54:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "refresh_cache-14999671-dcc7-43fa-85ec-21cbcf12d21e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:54:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquired lock "refresh_cache-14999671-dcc7-43fa-85ec-21cbcf12d21e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:54:00 user nova-compute[73484]: DEBUG nova.network.neutron [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:54:00 user nova-compute[73484]: DEBUG nova.compute.manager [req-cd9b9937-83f6-4628-888b-b395c120cf4c req-81a4730d-1e8e-4e80-8954-c8fe6b262d4b service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Received event network-changed-0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:54:00 user nova-compute[73484]: DEBUG nova.compute.manager [req-cd9b9937-83f6-4628-888b-b395c120cf4c req-81a4730d-1e8e-4e80-8954-c8fe6b262d4b service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Refreshing instance network info cache due to event network-changed-0259d05a-9595-41f7-839d-28df692755fb. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:54:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-cd9b9937-83f6-4628-888b-b395c120cf4c req-81a4730d-1e8e-4e80-8954-c8fe6b262d4b service nova] Acquiring lock "refresh_cache-14999671-dcc7-43fa-85ec-21cbcf12d21e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:54:00 user nova-compute[73484]: DEBUG nova.network.neutron [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.network.neutron [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Updating instance_info_cache with network_info: [{"id": "0259d05a-9595-41f7-839d-28df692755fb", "address": "fa:16:3e:d5:7f:13", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0259d05a-95", "ovs_interfaceid": "0259d05a-9595-41f7-839d-28df692755fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Releasing lock "refresh_cache-14999671-dcc7-43fa-85ec-21cbcf12d21e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.compute.manager [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Instance network_info: |[{"id": "0259d05a-9595-41f7-839d-28df692755fb", "address": "fa:16:3e:d5:7f:13", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0259d05a-95", "ovs_interfaceid": "0259d05a-9595-41f7-839d-28df692755fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-cd9b9937-83f6-4628-888b-b395c120cf4c req-81a4730d-1e8e-4e80-8954-c8fe6b262d4b service nova] Acquired lock "refresh_cache-14999671-dcc7-43fa-85ec-21cbcf12d21e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.network.neutron [req-cd9b9937-83f6-4628-888b-b395c120cf4c req-81a4730d-1e8e-4e80-8954-c8fe6b262d4b service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Refreshing network info cache for port 0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Start _get_guest_xml network_info=[{"id": "0259d05a-9595-41f7-839d-28df692755fb", "address": "fa:16:3e:d5:7f:13", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0259d05a-95", "ovs_interfaceid": "0259d05a-9595-41f7-839d-28df692755fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:54:01 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:54:01 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:53:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1791866722',display_name='tempest-ServerRescueNegativeTestJSON-server-1791866722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1791866722',id=35,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3FYahLoEeUzNQJsn+wqCzTl530H2uPDPATXW4sHxE7PqRzLmegfqzUhGXPfxcf8H5RdoHzVzXWdXYqXzLUllkhrrm06OkmmRQEVmYHqQEwUs5b1Jjk2rMUzKxmZrvCqg==',key_name='tempest-keypair-476477973',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f4df46bcfb843b7ac6c17d106703950',ramdisk_id='',reservation_id='r-zkhhqpeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-496474583',owner_user_name='tempest-ServerRescueNegativeTestJSON-496474583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:53:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45d86b9371024e3d95ece74ccb2c37d9',uuid=14999671-dcc7-43fa-85ec-21cbcf12d21e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0259d05a-9595-41f7-839d-28df692755fb", "address": "fa:16:3e:d5:7f:13", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0259d05a-95", "ovs_interfaceid": "0259d05a-9595-41f7-839d-28df692755fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Converting VIF {"id": "0259d05a-9595-41f7-839d-28df692755fb", "address": "fa:16:3e:d5:7f:13", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0259d05a-95", "ovs_interfaceid": "0259d05a-9595-41f7-839d-28df692755fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:7f:13,bridge_name='br-int',has_traffic_filtering=True,id=0259d05a-9595-41f7-839d-28df692755fb,network=Network(cad53782-5ecf-4140-b113-62e807bf87df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0259d05a-95') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.objects.instance [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'pci_devices' on Instance uuid 14999671-dcc7-43fa-85ec-21cbcf12d21e {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:54:01 user nova-compute[73484]:   <uuid>14999671-dcc7-43fa-85ec-21cbcf12d21e</uuid>
Aug 14 13:54:01 user nova-compute[73484]:   <name>instance-00000023</name>
Aug 14 13:54:01 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:54:01 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:54:01 user nova-compute[73484]:   <metadata>
Aug 14 13:54:01 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:54:01 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:54:01 user nova-compute[73484]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1791866722</nova:name>
Aug 14 13:54:01 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:54:01</nova:creationTime>
Aug 14 13:54:01 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:54:01 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:54:01 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:54:01 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:54:01 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:54:01 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:54:01 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:54:01 user nova-compute[73484]:       <nova:owner>
Aug 14 13:54:01 user nova-compute[73484]:         <nova:user uuid="45d86b9371024e3d95ece74ccb2c37d9">tempest-ServerRescueNegativeTestJSON-496474583-project-member</nova:user>
Aug 14 13:54:01 user nova-compute[73484]:         <nova:project uuid="0f4df46bcfb843b7ac6c17d106703950">tempest-ServerRescueNegativeTestJSON-496474583</nova:project>
Aug 14 13:54:01 user nova-compute[73484]:       </nova:owner>
Aug 14 13:54:01 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:54:01 user nova-compute[73484]:       <nova:ports>
Aug 14 13:54:01 user nova-compute[73484]:         <nova:port uuid="0259d05a-9595-41f7-839d-28df692755fb">
Aug 14 13:54:01 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 13:54:01 user nova-compute[73484]:         </nova:port>
Aug 14 13:54:01 user nova-compute[73484]:       </nova:ports>
Aug 14 13:54:01 user nova-compute[73484]:     </nova:instance>
Aug 14 13:54:01 user nova-compute[73484]:   </metadata>
Aug 14 13:54:01 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:54:01 user nova-compute[73484]:     <system>
Aug 14 13:54:01 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:54:01 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:54:01 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:54:01 user nova-compute[73484]:       <entry name="serial">14999671-dcc7-43fa-85ec-21cbcf12d21e</entry>
Aug 14 13:54:01 user nova-compute[73484]:       <entry name="uuid">14999671-dcc7-43fa-85ec-21cbcf12d21e</entry>
Aug 14 13:54:01 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:54:01 user nova-compute[73484]:     </system>
Aug 14 13:54:01 user nova-compute[73484]:   </sysinfo>
Aug 14 13:54:01 user nova-compute[73484]:   <os>
Aug 14 13:54:01 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:54:01 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:54:01 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:54:01 user nova-compute[73484]:   </os>
Aug 14 13:54:01 user nova-compute[73484]:   <features>
Aug 14 13:54:01 user nova-compute[73484]:     <acpi/>
Aug 14 13:54:01 user nova-compute[73484]:     <apic/>
Aug 14 13:54:01 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:54:01 user nova-compute[73484]:   </features>
Aug 14 13:54:01 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:54:01 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:54:01 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:54:01 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:54:01 user nova-compute[73484]:   </clock>
Aug 14 13:54:01 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:54:01 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:54:01 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:54:01 user nova-compute[73484]:   </cpu>
Aug 14 13:54:01 user nova-compute[73484]:   <devices>
Aug 14 13:54:01 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:54:01 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:54:01 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk"/>
Aug 14 13:54:01 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:54:01 user nova-compute[73484]:     </disk>
Aug 14 13:54:01 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:54:01 user nova-compute[73484]:       <mac address="fa:16:3e:d5:7f:13"/>
Aug 14 13:54:01 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:54:01 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:54:01 user nova-compute[73484]:       <target dev="tap0259d05a-95"/>
Aug 14 13:54:01 user nova-compute[73484]:     </interface>
Aug 14 13:54:01 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:54:01 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/console.log" append="off"/>
Aug 14 13:54:01 user nova-compute[73484]:     </serial>
Aug 14 13:54:01 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:54:01 user nova-compute[73484]:     <video>
Aug 14 13:54:01 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:54:01 user nova-compute[73484]:     </video>
Aug 14 13:54:01 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:54:01 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:54:01 user nova-compute[73484]:     </rng>
Aug 14 13:54:01 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:54:01 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:54:01 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:54:01 user nova-compute[73484]:     </memballoon>
Aug 14 13:54:01 user nova-compute[73484]:   </devices>
Aug 14 13:54:01 user nova-compute[73484]: </domain>
Aug 14 13:54:01 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:53:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1791866722',display_name='tempest-ServerRescueNegativeTestJSON-server-1791866722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1791866722',id=35,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3FYahLoEeUzNQJsn+wqCzTl530H2uPDPATXW4sHxE7PqRzLmegfqzUhGXPfxcf8H5RdoHzVzXWdXYqXzLUllkhrrm06OkmmRQEVmYHqQEwUs5b1Jjk2rMUzKxmZrvCqg==',key_name='tempest-keypair-476477973',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f4df46bcfb843b7ac6c17d106703950',ramdisk_id='',reservation_id='r-zkhhqpeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-496474583',owner_user_name='tempest-ServerRescueNegativeTestJSON-496474583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:53:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45d86b9371024e3d95ece74ccb2c37d9',uuid=14999671-dcc7-43fa-85ec-21cbcf12d21e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0259d05a-9595-41f7-839d-28df692755fb", "address": "fa:16:3e:d5:7f:13", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0259d05a-95", "ovs_interfaceid": "0259d05a-9595-41f7-839d-28df692755fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Converting VIF {"id": "0259d05a-9595-41f7-839d-28df692755fb", "address": "fa:16:3e:d5:7f:13", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0259d05a-95", "ovs_interfaceid": "0259d05a-9595-41f7-839d-28df692755fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:7f:13,bridge_name='br-int',has_traffic_filtering=True,id=0259d05a-9595-41f7-839d-28df692755fb,network=Network(cad53782-5ecf-4140-b113-62e807bf87df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0259d05a-95') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG os_vif [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:7f:13,bridge_name='br-int',has_traffic_filtering=True,id=0259d05a-9595-41f7-839d-28df692755fb,network=Network(cad53782-5ecf-4140-b113-62e807bf87df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0259d05a-95') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0259d05a-95, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0259d05a-95, col_values=(('external_ids', {'iface-id': '0259d05a-9595-41f7-839d-28df692755fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:7f:13', 'vm-uuid': '14999671-dcc7-43fa-85ec-21cbcf12d21e'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:01 user nova-compute[73484]: INFO os_vif [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:7f:13,bridge_name='br-int',has_traffic_filtering=True,id=0259d05a-9595-41f7-839d-28df692755fb,network=Network(cad53782-5ecf-4140-b113-62e807bf87df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0259d05a-95')
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] No VIF found with MAC fa:16:3e:d5:7f:13, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.network.neutron [req-cd9b9937-83f6-4628-888b-b395c120cf4c req-81a4730d-1e8e-4e80-8954-c8fe6b262d4b service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Updated VIF entry in instance network info cache for port 0259d05a-9595-41f7-839d-28df692755fb. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG nova.network.neutron [req-cd9b9937-83f6-4628-888b-b395c120cf4c req-81a4730d-1e8e-4e80-8954-c8fe6b262d4b service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Updating instance_info_cache with network_info: [{"id": "0259d05a-9595-41f7-839d-28df692755fb", "address": "fa:16:3e:d5:7f:13", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0259d05a-95", "ovs_interfaceid": "0259d05a-9595-41f7-839d-28df692755fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:54:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-cd9b9937-83f6-4628-888b-b395c120cf4c req-81a4730d-1e8e-4e80-8954-c8fe6b262d4b service nova] Releasing lock "refresh_cache-14999671-dcc7-43fa-85ec-21cbcf12d21e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:54:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:02 user nova-compute[73484]: DEBUG nova.compute.manager [req-6c0185f4-b319-4019-9998-c39bcce9bfe1 req-65dfb544-662a-425b-8dbb-c0e196b1d623 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Received event network-vif-plugged-0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:54:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6c0185f4-b319-4019-9998-c39bcce9bfe1 req-65dfb544-662a-425b-8dbb-c0e196b1d623 service nova] Acquiring lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6c0185f4-b319-4019-9998-c39bcce9bfe1 req-65dfb544-662a-425b-8dbb-c0e196b1d623 service nova] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6c0185f4-b319-4019-9998-c39bcce9bfe1 req-65dfb544-662a-425b-8dbb-c0e196b1d623 service nova] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:02 user nova-compute[73484]: DEBUG nova.compute.manager [req-6c0185f4-b319-4019-9998-c39bcce9bfe1 req-65dfb544-662a-425b-8dbb-c0e196b1d623 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] No waiting events found dispatching network-vif-plugged-0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:54:02 user nova-compute[73484]: WARNING nova.compute.manager [req-6c0185f4-b319-4019-9998-c39bcce9bfe1 req-65dfb544-662a-425b-8dbb-c0e196b1d623 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Received unexpected event network-vif-plugged-0259d05a-9595-41f7-839d-28df692755fb for instance with vm_state building and task_state spawning.
Aug 14 13:54:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:04 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021244.8850443, 14999671-dcc7-43fa-85ec-21cbcf12d21e => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:54:04 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] VM Resumed (Lifecycle Event)
Aug 14 13:54:04 user nova-compute[73484]: DEBUG nova.compute.manager [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:54:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:54:04 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Instance spawned successfully.
Aug 14 13:54:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:54:04 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:54:04 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:54:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:54:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:54:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:54:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:54:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:54:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:54:04 user nova-compute[73484]: DEBUG nova.compute.manager [req-b3021452-3df5-4405-9f24-fb9c03e374b8 req-5a6f913b-ca6e-4b3e-9293-c6466602a888 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Received event network-vif-plugged-0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:54:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b3021452-3df5-4405-9f24-fb9c03e374b8 req-5a6f913b-ca6e-4b3e-9293-c6466602a888 service nova] Acquiring lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b3021452-3df5-4405-9f24-fb9c03e374b8 req-5a6f913b-ca6e-4b3e-9293-c6466602a888 service nova] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b3021452-3df5-4405-9f24-fb9c03e374b8 req-5a6f913b-ca6e-4b3e-9293-c6466602a888 service nova] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:04 user nova-compute[73484]: DEBUG nova.compute.manager [req-b3021452-3df5-4405-9f24-fb9c03e374b8 req-5a6f913b-ca6e-4b3e-9293-c6466602a888 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] No waiting events found dispatching network-vif-plugged-0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:54:04 user nova-compute[73484]: WARNING nova.compute.manager [req-b3021452-3df5-4405-9f24-fb9c03e374b8 req-5a6f913b-ca6e-4b3e-9293-c6466602a888 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Received unexpected event network-vif-plugged-0259d05a-9595-41f7-839d-28df692755fb for instance with vm_state building and task_state spawning.
Aug 14 13:54:04 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:54:04 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021244.886622, 14999671-dcc7-43fa-85ec-21cbcf12d21e => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:54:04 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] VM Started (Lifecycle Event)
Aug 14 13:54:04 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:54:04 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:54:05 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:54:05 user nova-compute[73484]: INFO nova.compute.manager [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Took 6.37 seconds to spawn the instance on the hypervisor.
Aug 14 13:54:05 user nova-compute[73484]: DEBUG nova.compute.manager [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:54:05 user nova-compute[73484]: INFO nova.compute.manager [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Took 7.15 seconds to build instance.
Aug 14 13:54:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-31822068-00bc-4359-bbc5-dc464aa3589a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.249s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:08 user nova-compute[73484]: DEBUG nova.objects.instance [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lazy-loading 'pci_requests' on Instance uuid a54902a5-df8a-473f-9cf1-a112528c3549 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:54:08 user nova-compute[73484]: DEBUG nova.objects.instance [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lazy-loading 'numa_topology' on Instance uuid a54902a5-df8a-473f-9cf1-a112528c3549 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:54:08 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:54:08 user nova-compute[73484]: INFO nova.compute.claims [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Claim successful on node user
Aug 14 13:54:09 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:54:09 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:54:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:09 user nova-compute[73484]: INFO nova.network.neutron [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Updating port ef1b13c3-d3e6-492e-8082-b5939545f189 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Acquiring lock "refresh_cache-a54902a5-df8a-473f-9cf1-a112528c3549" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Acquired lock "refresh_cache-a54902a5-df8a-473f-9cf1-a112528c3549" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG nova.network.neutron [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG nova.compute.manager [req-11635247-7a36-4d0a-ada9-f2344eac7648 req-b1395c9a-947c-424b-a1f1-49fce4d3ebb9 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Received event network-changed-ef1b13c3-d3e6-492e-8082-b5939545f189 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG nova.compute.manager [req-11635247-7a36-4d0a-ada9-f2344eac7648 req-b1395c9a-947c-424b-a1f1-49fce4d3ebb9 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Refreshing instance network info cache due to event network-changed-ef1b13c3-d3e6-492e-8082-b5939545f189. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-11635247-7a36-4d0a-ada9-f2344eac7648 req-b1395c9a-947c-424b-a1f1-49fce4d3ebb9 service nova] Acquiring lock "refresh_cache-a54902a5-df8a-473f-9cf1-a112528c3549" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692021235.4148347, b43ccb18-6d2d-43f2-a185-bb558d5d6f45 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:54:10 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] VM Stopped (Lifecycle Event)
Aug 14 13:54:10 user nova-compute[73484]: DEBUG nova.compute.manager [None req-f00ee1e7-3af9-4dc0-bb53-ec6635f6a394 None None] [instance: b43ccb18-6d2d-43f2-a185-bb558d5d6f45] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG nova.network.neutron [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Updating instance_info_cache with network_info: [{"id": "ef1b13c3-d3e6-492e-8082-b5939545f189", "address": "fa:16:3e:25:ba:8c", "network": {"id": "83e56acf-b902-47d4-8e67-89dd64cb110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773957043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844799698ad34e19ba511a302ffa57a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1b13c3-d3", "ovs_interfaceid": "ef1b13c3-d3e6-492e-8082-b5939545f189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Releasing lock "refresh_cache-a54902a5-df8a-473f-9cf1-a112528c3549" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:54:10 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Creating image(s)
Aug 14 13:54:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Did not create local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Ensure instance console log exists: /opt/stack/data/nova/instances/a54902a5-df8a-473f-9cf1-a112528c3549/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Start _get_guest_xml network_info=[{"id": "ef1b13c3-d3e6-492e-8082-b5939545f189", "address": "fa:16:3e:25:ba:8c", "network": {"id": "83e56acf-b902-47d4-8e67-89dd64cb110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773957043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844799698ad34e19ba511a302ffa57a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1b13c3-d3", "ovs_interfaceid": "ef1b13c3-d3e6-492e-8082-b5939545f189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '7f92aa44-01bf-4e69-a680-2767a7bf01ae', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VTMsgrjJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a54902a5-df8a-473f-9cf1-a112528c3549', 'attached_at': '', 'detached_at': '', 'volume_id': '5e55bf6f-36bb-45c9-84fe-491435460475', 'serial': '5e55bf6f-36bb-45c9-84fe-491435460475'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-11635247-7a36-4d0a-ada9-f2344eac7648 req-b1395c9a-947c-424b-a1f1-49fce4d3ebb9 service nova] Acquired lock "refresh_cache-a54902a5-df8a-473f-9cf1-a112528c3549" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG nova.network.neutron [req-11635247-7a36-4d0a-ada9-f2344eac7648 req-b1395c9a-947c-424b-a1f1-49fce4d3ebb9 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Refreshing network info cache for port ef1b13c3-d3e6-492e-8082-b5939545f189 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:54:10 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:54:10 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:54:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG nova.objects.instance [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lazy-loading 'vcpu_model' on Instance uuid a54902a5-df8a-473f-9cf1-a112528c3549 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VTMsgrjJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:54:10 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:54:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:54:10 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:54:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:54:10 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e2c12f-dd28-4bcc-9849-e173be31d56d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:54:10 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea40e3ce-d39e-4a26-96ca-d8222caaad4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475] added
Aug 14 13:54:10 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce6239d-f112-42ce-a2a6-2145bc14eb56]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a764366c-df0d-4e8d-a4cb-aab36f5cbbba]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VTMsgrjJ {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VTMsgrjJ" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d143f1-ca4d-4c08-875b-c1e813e321c6]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VTMsgrjJ'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e678312-e23c-49e3-b2f0-f9d657f32236]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[484f6f76-c624-4370-a7e8-c66b581dc5eb]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:54:10 user nova-compute[73484]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:54:10 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:54:10 user nova-compute[73484]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:54:10 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f9f30e-6f7d-43e0-975b-19e370b7d4ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475, portal: 172.16.0.220,3260]
Aug 14 13:54:10 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475, portal: 172.16.0.220,3260] successful.
Aug 14 13:54:10 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[df438a1c-ac13-4282-bd9d-92c7af2c795b]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4673058-0ccc-4ca7-8b55-036023d94096]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:54:10 user nova-compute[73484]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:54:10 user nova-compute[73484]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)
Aug 14 13:54:10 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:54:10 user nova-compute[73484]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:54:10 user nova-compute[73484]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)
Aug 14 13:54:10 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e73766-92e1-45b3-919e-26b0686e2d92]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VTMsgrjJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG nova.network.neutron [req-11635247-7a36-4d0a-ada9-f2344eac7648 req-b1395c9a-947c-424b-a1f1-49fce4d3ebb9 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Updated VIF entry in instance network info cache for port ef1b13c3-d3e6-492e-8082-b5939545f189. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:54:10 user nova-compute[73484]: DEBUG nova.network.neutron [req-11635247-7a36-4d0a-ada9-f2344eac7648 req-b1395c9a-947c-424b-a1f1-49fce4d3ebb9 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Updating instance_info_cache with network_info: [{"id": "ef1b13c3-d3e6-492e-8082-b5939545f189", "address": "fa:16:3e:25:ba:8c", "network": {"id": "83e56acf-b902-47d4-8e67-89dd64cb110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773957043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844799698ad34e19ba511a302ffa57a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1b13c3-d3", "ovs_interfaceid": "ef1b13c3-d3e6-492e-8082-b5939545f189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:54:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-11635247-7a36-4d0a-ada9-f2344eac7648 req-b1395c9a-947c-424b-a1f1-49fce4d3ebb9 service nova] Releasing lock "refresh_cache-a54902a5-df8a-473f-9cf1-a112528c3549" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:54:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:54:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 13:54:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:54:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:54:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:11 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:54:11 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23039363337323634', 'path': '/dev/sdc'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:54:11 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039363337323634', 'path': '/dev/sdc'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:54:11 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T13:50:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1804131842',display_name='tempest-TestShelveInstance-server-1804131842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1804131842',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1649769704',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:50:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='844799698ad34e19ba511a302ffa57a4',ramdisk_id='',reservation_id='r-romjeqoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1441042020',owner_user_name='tempest-TestShelveInstance-1441042020-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:53:59Z,user_data=None,user_id='c8d4d6031b59481d93c22075f19559b6',uuid=a54902a5-df8a-473f-9cf1-a112528c3549,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ef1b13c3-d3e6-492e-8082-b5939545f189", "address": "fa:16:3e:25:ba:8c", "network": {"id": "83e56acf-b902-47d4-8e67-89dd64cb110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773957043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844799698ad34e19ba511a302ffa57a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1b13c3-d3", "ovs_interfaceid": "ef1b13c3-d3e6-492e-8082-b5939545f189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:54:11 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Converting VIF {"id": "ef1b13c3-d3e6-492e-8082-b5939545f189", "address": "fa:16:3e:25:ba:8c", "network": {"id": "83e56acf-b902-47d4-8e67-89dd64cb110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773957043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844799698ad34e19ba511a302ffa57a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1b13c3-d3", "ovs_interfaceid": "ef1b13c3-d3e6-492e-8082-b5939545f189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:54:11 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:ba:8c,bridge_name='br-int',has_traffic_filtering=True,id=ef1b13c3-d3e6-492e-8082-b5939545f189,network=Network(83e56acf-b902-47d4-8e67-89dd64cb110e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1b13c3-d3') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:54:11 user nova-compute[73484]: DEBUG nova.objects.instance [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lazy-loading 'pci_devices' on Instance uuid a54902a5-df8a-473f-9cf1-a112528c3549 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:54:11 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:54:11 user nova-compute[73484]:   <uuid>a54902a5-df8a-473f-9cf1-a112528c3549</uuid>
Aug 14 13:54:11 user nova-compute[73484]:   <name>instance-00000020</name>
Aug 14 13:54:11 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:54:11 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:54:11 user nova-compute[73484]:   <metadata>
Aug 14 13:54:11 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:54:11 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:54:11 user nova-compute[73484]:       <nova:name>tempest-TestShelveInstance-server-1804131842</nova:name>
Aug 14 13:54:11 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:54:10</nova:creationTime>
Aug 14 13:54:11 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:54:11 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:54:11 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:54:11 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:54:11 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:54:11 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:54:11 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:54:11 user nova-compute[73484]:       <nova:owner>
Aug 14 13:54:11 user nova-compute[73484]:         <nova:user uuid="c8d4d6031b59481d93c22075f19559b6">tempest-TestShelveInstance-1441042020-project-member</nova:user>
Aug 14 13:54:11 user nova-compute[73484]:         <nova:project uuid="844799698ad34e19ba511a302ffa57a4">tempest-TestShelveInstance-1441042020</nova:project>
Aug 14 13:54:11 user nova-compute[73484]:       </nova:owner>
Aug 14 13:54:11 user nova-compute[73484]:       <nova:ports>
Aug 14 13:54:11 user nova-compute[73484]:         <nova:port uuid="ef1b13c3-d3e6-492e-8082-b5939545f189">
Aug 14 13:54:11 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 13:54:11 user nova-compute[73484]:         </nova:port>
Aug 14 13:54:11 user nova-compute[73484]:       </nova:ports>
Aug 14 13:54:11 user nova-compute[73484]:     </nova:instance>
Aug 14 13:54:11 user nova-compute[73484]:   </metadata>
Aug 14 13:54:11 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:54:11 user nova-compute[73484]:     <system>
Aug 14 13:54:11 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:54:11 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:54:11 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:54:11 user nova-compute[73484]:       <entry name="serial">a54902a5-df8a-473f-9cf1-a112528c3549</entry>
Aug 14 13:54:11 user nova-compute[73484]:       <entry name="uuid">a54902a5-df8a-473f-9cf1-a112528c3549</entry>
Aug 14 13:54:11 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:54:11 user nova-compute[73484]:     </system>
Aug 14 13:54:11 user nova-compute[73484]:   </sysinfo>
Aug 14 13:54:11 user nova-compute[73484]:   <os>
Aug 14 13:54:11 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:54:11 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:54:11 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:54:11 user nova-compute[73484]:   </os>
Aug 14 13:54:11 user nova-compute[73484]:   <features>
Aug 14 13:54:11 user nova-compute[73484]:     <acpi/>
Aug 14 13:54:11 user nova-compute[73484]:     <apic/>
Aug 14 13:54:11 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:54:11 user nova-compute[73484]:   </features>
Aug 14 13:54:11 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:54:11 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:54:11 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:54:11 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:54:11 user nova-compute[73484]:   </clock>
Aug 14 13:54:11 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:54:11 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:54:11 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:54:11 user nova-compute[73484]:   </cpu>
Aug 14 13:54:11 user nova-compute[73484]:   <devices>
Aug 14 13:54:11 user nova-compute[73484]:     <disk type="block" device="disk">
Aug 14 13:54:11 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:54:11 user nova-compute[73484]:       <source dev="/dev/sdc"/>
Aug 14 13:54:11 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:54:11 user nova-compute[73484]:       <serial>5e55bf6f-36bb-45c9-84fe-491435460475</serial>
Aug 14 13:54:11 user nova-compute[73484]:     </disk>
Aug 14 13:54:11 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:54:11 user nova-compute[73484]:       <mac address="fa:16:3e:25:ba:8c"/>
Aug 14 13:54:11 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:54:11 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:54:11 user nova-compute[73484]:       <target dev="tapef1b13c3-d3"/>
Aug 14 13:54:11 user nova-compute[73484]:     </interface>
Aug 14 13:54:11 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:54:11 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/a54902a5-df8a-473f-9cf1-a112528c3549/console.log" append="off"/>
Aug 14 13:54:11 user nova-compute[73484]:     </serial>
Aug 14 13:54:11 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:54:11 user nova-compute[73484]:     <video>
Aug 14 13:54:11 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:54:11 user nova-compute[73484]:     </video>
Aug 14 13:54:11 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:54:11 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:54:11 user nova-compute[73484]:     </rng>
Aug 14 13:54:11 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:54:11 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:54:11 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:54:11 user nova-compute[73484]:     </memballoon>
Aug 14 13:54:11 user nova-compute[73484]:   </devices>
Aug 14 13:54:11 user nova-compute[73484]: </domain>
Aug 14 13:54:11 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:54:11 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T13:50:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1804131842',display_name='tempest-TestShelveInstance-server-1804131842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1804131842',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1649769704',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:50:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='844799698ad34e19ba511a302ffa57a4',ramdisk_id='',reservation_id='r-romjeqoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1441042020',owner_user_name='tempest-TestShelveInstance-1441042020-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:53:59Z,user_data=None,user_id='c8d4d6031b59481d93c22075f19559b6',uuid=a54902a5-df8a-473f-9cf1-a112528c3549,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ef1b13c3-d3e6-492e-8082-b5939545f189", "address": "fa:16:3e:25:ba:8c", "network": {"id": "83e56acf-b902-47d4-8e67-89dd64cb110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773957043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844799698ad34e19ba511a302ffa57a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1b13c3-d3", "ovs_interfaceid": "ef1b13c3-d3e6-492e-8082-b5939545f189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:54:11 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Converting VIF {"id": "ef1b13c3-d3e6-492e-8082-b5939545f189", "address": "fa:16:3e:25:ba:8c", "network": {"id": "83e56acf-b902-47d4-8e67-89dd64cb110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773957043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844799698ad34e19ba511a302ffa57a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1b13c3-d3", "ovs_interfaceid": "ef1b13c3-d3e6-492e-8082-b5939545f189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:54:11 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:ba:8c,bridge_name='br-int',has_traffic_filtering=True,id=ef1b13c3-d3e6-492e-8082-b5939545f189,network=Network(83e56acf-b902-47d4-8e67-89dd64cb110e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1b13c3-d3') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:54:11 user nova-compute[73484]: DEBUG os_vif [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:ba:8c,bridge_name='br-int',has_traffic_filtering=True,id=ef1b13c3-d3e6-492e-8082-b5939545f189,network=Network(83e56acf-b902-47d4-8e67-89dd64cb110e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1b13c3-d3') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:54:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:54:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:54:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef1b13c3-d3, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:54:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapef1b13c3-d3, col_values=(('external_ids', {'iface-id': 'ef1b13c3-d3e6-492e-8082-b5939545f189', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:ba:8c', 'vm-uuid': 'a54902a5-df8a-473f-9cf1-a112528c3549'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:54:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:54:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:11 user nova-compute[73484]: INFO os_vif [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:ba:8c,bridge_name='br-int',has_traffic_filtering=True,id=ef1b13c3-d3e6-492e-8082-b5939545f189,network=Network(83e56acf-b902-47d4-8e67-89dd64cb110e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1b13c3-d3')
Aug 14 13:54:12 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:54:12 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] No VIF found with MAC fa:16:3e:25:ba:8c, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:54:12 user nova-compute[73484]: INFO nova.compute.manager [None req-1f627730-b15e-430c-bf35-19d5fe5d07da tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Get console output
Aug 14 13:54:12 user nova-compute[73484]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 14 13:54:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:13 user nova-compute[73484]: DEBUG nova.compute.manager [req-3e89a278-65f7-4600-b38c-c3bdd6e038aa req-3cd9e25d-f463-410d-8eff-ceef378aaed8 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Received event network-vif-plugged-ef1b13c3-d3e6-492e-8082-b5939545f189 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:54:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3e89a278-65f7-4600-b38c-c3bdd6e038aa req-3cd9e25d-f463-410d-8eff-ceef378aaed8 service nova] Acquiring lock "a54902a5-df8a-473f-9cf1-a112528c3549-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3e89a278-65f7-4600-b38c-c3bdd6e038aa req-3cd9e25d-f463-410d-8eff-ceef378aaed8 service nova] Lock "a54902a5-df8a-473f-9cf1-a112528c3549-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3e89a278-65f7-4600-b38c-c3bdd6e038aa req-3cd9e25d-f463-410d-8eff-ceef378aaed8 service nova] Lock "a54902a5-df8a-473f-9cf1-a112528c3549-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:13 user nova-compute[73484]: DEBUG nova.compute.manager [req-3e89a278-65f7-4600-b38c-c3bdd6e038aa req-3cd9e25d-f463-410d-8eff-ceef378aaed8 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] No waiting events found dispatching network-vif-plugged-ef1b13c3-d3e6-492e-8082-b5939545f189 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:54:13 user nova-compute[73484]: WARNING nova.compute.manager [req-3e89a278-65f7-4600-b38c-c3bdd6e038aa req-3cd9e25d-f463-410d-8eff-ceef378aaed8 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Received unexpected event network-vif-plugged-ef1b13c3-d3e6-492e-8082-b5939545f189 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 13:54:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "42273739-c086-4cc7-a6c8-10710b16f794" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "42273739-c086-4cc7-a6c8-10710b16f794" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:54:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:14 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:54:14 user nova-compute[73484]: INFO nova.compute.claims [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Claim successful on node user
Aug 14 13:54:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:14 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:54:14 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:54:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.502s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:54:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:54:14 user nova-compute[73484]: DEBUG nova.network.neutron [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:54:14 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:54:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:54:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:54:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:54:15 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Creating image(s)
Aug 14 13:54:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "/opt/stack/data/nova/instances/42273739-c086-4cc7-a6c8-10710b16f794/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "/opt/stack/data/nova/instances/42273739-c086-4cc7-a6c8-10710b16f794/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "/opt/stack/data/nova/instances/42273739-c086-4cc7-a6c8-10710b16f794/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:15 user nova-compute[73484]: DEBUG nova.policy [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3ccc9cc867644d9bc040e9dfd4eb231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404795fcace4922a10abdb33740e87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:54:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.191s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.190s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/42273739-c086-4cc7-a6c8-10710b16f794/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:15 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021255.5226855, a54902a5-df8a-473f-9cf1-a112528c3549 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:54:15 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] VM Resumed (Lifecycle Event)
Aug 14 13:54:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:54:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:54:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/42273739-c086-4cc7-a6c8-10710b16f794/disk 1073741824" returned: 0 in 0.054s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:15 user nova-compute[73484]: DEBUG nova.compute.manager [req-22efb6e4-6e12-434d-a6c1-d7e15af43df5 req-28d15a02-ee10-4db6-aff9-a765316cd3ca service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Received event network-vif-plugged-ef1b13c3-d3e6-492e-8082-b5939545f189 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:54:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-22efb6e4-6e12-434d-a6c1-d7e15af43df5 req-28d15a02-ee10-4db6-aff9-a765316cd3ca service nova] Acquiring lock "a54902a5-df8a-473f-9cf1-a112528c3549-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-22efb6e4-6e12-434d-a6c1-d7e15af43df5 req-28d15a02-ee10-4db6-aff9-a765316cd3ca service nova] Lock "a54902a5-df8a-473f-9cf1-a112528c3549-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-22efb6e4-6e12-434d-a6c1-d7e15af43df5 req-28d15a02-ee10-4db6-aff9-a765316cd3ca service nova] Lock "a54902a5-df8a-473f-9cf1-a112528c3549-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:15 user nova-compute[73484]: DEBUG nova.compute.manager [req-22efb6e4-6e12-434d-a6c1-d7e15af43df5 req-28d15a02-ee10-4db6-aff9-a765316cd3ca service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] No waiting events found dispatching network-vif-plugged-ef1b13c3-d3e6-492e-8082-b5939545f189 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:54:15 user nova-compute[73484]: WARNING nova.compute.manager [req-22efb6e4-6e12-434d-a6c1-d7e15af43df5 req-28d15a02-ee10-4db6-aff9-a765316cd3ca service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Received unexpected event network-vif-plugged-ef1b13c3-d3e6-492e-8082-b5939545f189 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 13:54:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:54:15 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Instance spawned successfully.
Aug 14 13:54:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:54:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:54:15 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:54:15 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021255.5236733, a54902a5-df8a-473f-9cf1-a112528c3549 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:54:15 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] VM Started (Lifecycle Event)
Aug 14 13:54:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:54:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:54:15 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:54:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-4ca49df4-f254-4c24-be53-26d4e00cc03d tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "a54902a5-df8a-473f-9cf1-a112528c3549" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.202s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:15 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42273739-c086-4cc7-a6c8-10710b16f794/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:54:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42273739-c086-4cc7-a6c8-10710b16f794/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:15 user nova-compute[73484]: DEBUG nova.network.neutron [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Successfully created port: e74d5355-d919-48fe-9355-918c02f38dd8 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:54:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42273739-c086-4cc7-a6c8-10710b16f794/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:15 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Cannot resize image /opt/stack/data/nova/instances/42273739-c086-4cc7-a6c8-10710b16f794/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:54:15 user nova-compute[73484]: DEBUG nova.objects.instance [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lazy-loading 'migration_context' on Instance uuid 42273739-c086-4cc7-a6c8-10710b16f794 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:54:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:54:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Ensure instance console log exists: /opt/stack/data/nova/instances/42273739-c086-4cc7-a6c8-10710b16f794/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:54:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:16 user nova-compute[73484]: DEBUG nova.network.neutron [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Successfully updated port: e74d5355-d919-48fe-9355-918c02f38dd8 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:54:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "refresh_cache-42273739-c086-4cc7-a6c8-10710b16f794" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:54:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquired lock "refresh_cache-42273739-c086-4cc7-a6c8-10710b16f794" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:54:16 user nova-compute[73484]: DEBUG nova.network.neutron [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:54:16 user nova-compute[73484]: DEBUG nova.network.neutron [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:54:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.network.neutron [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Updating instance_info_cache with network_info: [{"id": "e74d5355-d919-48fe-9355-918c02f38dd8", "address": "fa:16:3e:fd:d0:83", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape74d5355-d9", "ovs_interfaceid": "e74d5355-d919-48fe-9355-918c02f38dd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Releasing lock "refresh_cache-42273739-c086-4cc7-a6c8-10710b16f794" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.compute.manager [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Instance network_info: |[{"id": "e74d5355-d919-48fe-9355-918c02f38dd8", "address": "fa:16:3e:fd:d0:83", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape74d5355-d9", "ovs_interfaceid": "e74d5355-d919-48fe-9355-918c02f38dd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Start _get_guest_xml network_info=[{"id": "e74d5355-d919-48fe-9355-918c02f38dd8", "address": "fa:16:3e:fd:d0:83", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape74d5355-d9", "ovs_interfaceid": "e74d5355-d919-48fe-9355-918c02f38dd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:54:17 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:54:17 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-453751482',display_name='tempest-AttachVolumeNegativeTest-server-453751482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-453751482',id=36,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcedXJDha79sUX6ccwZgCYbf70iiVn05qrZpDAtndKACMVHvJcmBrhdHhLFaaD971eVkQP/udRhiGMKgqjuzhmsjKaB4MsvdeEYg8/jNQHKwz2YxRDGSsZPJ5UhI6SoTQ==',key_name='tempest-keypair-694000823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f404795fcace4922a10abdb33740e87d',ramdisk_id='',reservation_id='r-uaftuxg6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1043074889',owner_user_name='tempest-AttachVolumeNegativeTest-1043074889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:54:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3ccc9cc867644d9bc040e9dfd4eb231',uuid=42273739-c086-4cc7-a6c8-10710b16f794,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e74d5355-d919-48fe-9355-918c02f38dd8", "address": "fa:16:3e:fd:d0:83", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape74d5355-d9", "ovs_interfaceid": "e74d5355-d919-48fe-9355-918c02f38dd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Converting VIF {"id": "e74d5355-d919-48fe-9355-918c02f38dd8", "address": "fa:16:3e:fd:d0:83", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape74d5355-d9", "ovs_interfaceid": "e74d5355-d919-48fe-9355-918c02f38dd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:d0:83,bridge_name='br-int',has_traffic_filtering=True,id=e74d5355-d919-48fe-9355-918c02f38dd8,network=Network(10d4738f-25c6-4995-a4b7-6fbee86f070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape74d5355-d9') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.objects.instance [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lazy-loading 'pci_devices' on Instance uuid 42273739-c086-4cc7-a6c8-10710b16f794 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:54:17 user nova-compute[73484]:   <uuid>42273739-c086-4cc7-a6c8-10710b16f794</uuid>
Aug 14 13:54:17 user nova-compute[73484]:   <name>instance-00000024</name>
Aug 14 13:54:17 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:54:17 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:54:17 user nova-compute[73484]:   <metadata>
Aug 14 13:54:17 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:54:17 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:54:17 user nova-compute[73484]:       <nova:name>tempest-AttachVolumeNegativeTest-server-453751482</nova:name>
Aug 14 13:54:17 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:54:17</nova:creationTime>
Aug 14 13:54:17 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:54:17 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:54:17 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:54:17 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:54:17 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:54:17 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:54:17 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:54:17 user nova-compute[73484]:       <nova:owner>
Aug 14 13:54:17 user nova-compute[73484]:         <nova:user uuid="b3ccc9cc867644d9bc040e9dfd4eb231">tempest-AttachVolumeNegativeTest-1043074889-project-member</nova:user>
Aug 14 13:54:17 user nova-compute[73484]:         <nova:project uuid="f404795fcace4922a10abdb33740e87d">tempest-AttachVolumeNegativeTest-1043074889</nova:project>
Aug 14 13:54:17 user nova-compute[73484]:       </nova:owner>
Aug 14 13:54:17 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:54:17 user nova-compute[73484]:       <nova:ports>
Aug 14 13:54:17 user nova-compute[73484]:         <nova:port uuid="e74d5355-d919-48fe-9355-918c02f38dd8">
Aug 14 13:54:17 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 13:54:17 user nova-compute[73484]:         </nova:port>
Aug 14 13:54:17 user nova-compute[73484]:       </nova:ports>
Aug 14 13:54:17 user nova-compute[73484]:     </nova:instance>
Aug 14 13:54:17 user nova-compute[73484]:   </metadata>
Aug 14 13:54:17 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:54:17 user nova-compute[73484]:     <system>
Aug 14 13:54:17 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:54:17 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:54:17 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:54:17 user nova-compute[73484]:       <entry name="serial">42273739-c086-4cc7-a6c8-10710b16f794</entry>
Aug 14 13:54:17 user nova-compute[73484]:       <entry name="uuid">42273739-c086-4cc7-a6c8-10710b16f794</entry>
Aug 14 13:54:17 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:54:17 user nova-compute[73484]:     </system>
Aug 14 13:54:17 user nova-compute[73484]:   </sysinfo>
Aug 14 13:54:17 user nova-compute[73484]:   <os>
Aug 14 13:54:17 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:54:17 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:54:17 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:54:17 user nova-compute[73484]:   </os>
Aug 14 13:54:17 user nova-compute[73484]:   <features>
Aug 14 13:54:17 user nova-compute[73484]:     <acpi/>
Aug 14 13:54:17 user nova-compute[73484]:     <apic/>
Aug 14 13:54:17 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:54:17 user nova-compute[73484]:   </features>
Aug 14 13:54:17 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:54:17 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:54:17 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:54:17 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:54:17 user nova-compute[73484]:   </clock>
Aug 14 13:54:17 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:54:17 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:54:17 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:54:17 user nova-compute[73484]:   </cpu>
Aug 14 13:54:17 user nova-compute[73484]:   <devices>
Aug 14 13:54:17 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:54:17 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:54:17 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/42273739-c086-4cc7-a6c8-10710b16f794/disk"/>
Aug 14 13:54:17 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:54:17 user nova-compute[73484]:     </disk>
Aug 14 13:54:17 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:54:17 user nova-compute[73484]:       <mac address="fa:16:3e:fd:d0:83"/>
Aug 14 13:54:17 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:54:17 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:54:17 user nova-compute[73484]:       <target dev="tape74d5355-d9"/>
Aug 14 13:54:17 user nova-compute[73484]:     </interface>
Aug 14 13:54:17 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:54:17 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/42273739-c086-4cc7-a6c8-10710b16f794/console.log" append="off"/>
Aug 14 13:54:17 user nova-compute[73484]:     </serial>
Aug 14 13:54:17 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:54:17 user nova-compute[73484]:     <video>
Aug 14 13:54:17 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:54:17 user nova-compute[73484]:     </video>
Aug 14 13:54:17 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:54:17 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:54:17 user nova-compute[73484]:     </rng>
Aug 14 13:54:17 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:54:17 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:54:17 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:54:17 user nova-compute[73484]:     </memballoon>
Aug 14 13:54:17 user nova-compute[73484]:   </devices>
Aug 14 13:54:17 user nova-compute[73484]: </domain>
Aug 14 13:54:17 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-453751482',display_name='tempest-AttachVolumeNegativeTest-server-453751482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-453751482',id=36,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcedXJDha79sUX6ccwZgCYbf70iiVn05qrZpDAtndKACMVHvJcmBrhdHhLFaaD971eVkQP/udRhiGMKgqjuzhmsjKaB4MsvdeEYg8/jNQHKwz2YxRDGSsZPJ5UhI6SoTQ==',key_name='tempest-keypair-694000823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f404795fcace4922a10abdb33740e87d',ramdisk_id='',reservation_id='r-uaftuxg6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1043074889',owner_user_name='tempest-AttachVolumeNegativeTest-1043074889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:54:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3ccc9cc867644d9bc040e9dfd4eb231',uuid=42273739-c086-4cc7-a6c8-10710b16f794,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e74d5355-d919-48fe-9355-918c02f38dd8", "address": "fa:16:3e:fd:d0:83", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape74d5355-d9", "ovs_interfaceid": "e74d5355-d919-48fe-9355-918c02f38dd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Converting VIF {"id": "e74d5355-d919-48fe-9355-918c02f38dd8", "address": "fa:16:3e:fd:d0:83", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape74d5355-d9", "ovs_interfaceid": "e74d5355-d919-48fe-9355-918c02f38dd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:d0:83,bridge_name='br-int',has_traffic_filtering=True,id=e74d5355-d919-48fe-9355-918c02f38dd8,network=Network(10d4738f-25c6-4995-a4b7-6fbee86f070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape74d5355-d9') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG os_vif [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:d0:83,bridge_name='br-int',has_traffic_filtering=True,id=e74d5355-d919-48fe-9355-918c02f38dd8,network=Network(10d4738f-25c6-4995-a4b7-6fbee86f070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape74d5355-d9') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape74d5355-d9, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape74d5355-d9, col_values=(('external_ids', {'iface-id': 'e74d5355-d919-48fe-9355-918c02f38dd8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:d0:83', 'vm-uuid': '42273739-c086-4cc7-a6c8-10710b16f794'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:17 user nova-compute[73484]: INFO os_vif [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:d0:83,bridge_name='br-int',has_traffic_filtering=True,id=e74d5355-d919-48fe-9355-918c02f38dd8,network=Network(10d4738f-25c6-4995-a4b7-6fbee86f070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape74d5355-d9')
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] No VIF found with MAC fa:16:3e:fd:d0:83, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.compute.manager [req-19ad1cc7-a1ae-4d39-9f8f-825ba734d70a req-99659fab-745b-4d31-96dd-26fb2ac1fd23 service nova] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Received event network-changed-e74d5355-d919-48fe-9355-918c02f38dd8 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.compute.manager [req-19ad1cc7-a1ae-4d39-9f8f-825ba734d70a req-99659fab-745b-4d31-96dd-26fb2ac1fd23 service nova] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Refreshing instance network info cache due to event network-changed-e74d5355-d919-48fe-9355-918c02f38dd8. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-19ad1cc7-a1ae-4d39-9f8f-825ba734d70a req-99659fab-745b-4d31-96dd-26fb2ac1fd23 service nova] Acquiring lock "refresh_cache-42273739-c086-4cc7-a6c8-10710b16f794" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-19ad1cc7-a1ae-4d39-9f8f-825ba734d70a req-99659fab-745b-4d31-96dd-26fb2ac1fd23 service nova] Acquired lock "refresh_cache-42273739-c086-4cc7-a6c8-10710b16f794" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:54:17 user nova-compute[73484]: DEBUG nova.network.neutron [req-19ad1cc7-a1ae-4d39-9f8f-825ba734d70a req-99659fab-745b-4d31-96dd-26fb2ac1fd23 service nova] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Refreshing network info cache for port e74d5355-d919-48fe-9355-918c02f38dd8 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:54:18 user nova-compute[73484]: DEBUG nova.network.neutron [req-19ad1cc7-a1ae-4d39-9f8f-825ba734d70a req-99659fab-745b-4d31-96dd-26fb2ac1fd23 service nova] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Updated VIF entry in instance network info cache for port e74d5355-d919-48fe-9355-918c02f38dd8. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:54:18 user nova-compute[73484]: DEBUG nova.network.neutron [req-19ad1cc7-a1ae-4d39-9f8f-825ba734d70a req-99659fab-745b-4d31-96dd-26fb2ac1fd23 service nova] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Updating instance_info_cache with network_info: [{"id": "e74d5355-d919-48fe-9355-918c02f38dd8", "address": "fa:16:3e:fd:d0:83", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape74d5355-d9", "ovs_interfaceid": "e74d5355-d919-48fe-9355-918c02f38dd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:54:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-19ad1cc7-a1ae-4d39-9f8f-825ba734d70a req-99659fab-745b-4d31-96dd-26fb2ac1fd23 service nova] Releasing lock "refresh_cache-42273739-c086-4cc7-a6c8-10710b16f794" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:54:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:19 user nova-compute[73484]: DEBUG nova.compute.manager [req-b0d4d44d-5b02-42f0-907d-53cb0765af5e req-cd2f2981-cf7d-4ef1-9c56-52158ca2ea8c service nova] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Received event network-vif-plugged-e74d5355-d919-48fe-9355-918c02f38dd8 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:54:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b0d4d44d-5b02-42f0-907d-53cb0765af5e req-cd2f2981-cf7d-4ef1-9c56-52158ca2ea8c service nova] Acquiring lock "42273739-c086-4cc7-a6c8-10710b16f794-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b0d4d44d-5b02-42f0-907d-53cb0765af5e req-cd2f2981-cf7d-4ef1-9c56-52158ca2ea8c service nova] Lock "42273739-c086-4cc7-a6c8-10710b16f794-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b0d4d44d-5b02-42f0-907d-53cb0765af5e req-cd2f2981-cf7d-4ef1-9c56-52158ca2ea8c service nova] Lock "42273739-c086-4cc7-a6c8-10710b16f794-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:19 user nova-compute[73484]: DEBUG nova.compute.manager [req-b0d4d44d-5b02-42f0-907d-53cb0765af5e req-cd2f2981-cf7d-4ef1-9c56-52158ca2ea8c service nova] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] No waiting events found dispatching network-vif-plugged-e74d5355-d919-48fe-9355-918c02f38dd8 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:54:19 user nova-compute[73484]: WARNING nova.compute.manager [req-b0d4d44d-5b02-42f0-907d-53cb0765af5e req-cd2f2981-cf7d-4ef1-9c56-52158ca2ea8c service nova] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Received unexpected event network-vif-plugged-e74d5355-d919-48fe-9355-918c02f38dd8 for instance with vm_state building and task_state spawning.
Aug 14 13:54:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:21 user nova-compute[73484]: DEBUG nova.compute.manager [req-2b476e33-941b-4bbd-a23b-e918903097c8 req-b0103e10-92e8-4488-ad7e-4b0bd975a285 service nova] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Received event network-vif-plugged-e74d5355-d919-48fe-9355-918c02f38dd8 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:54:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2b476e33-941b-4bbd-a23b-e918903097c8 req-b0103e10-92e8-4488-ad7e-4b0bd975a285 service nova] Acquiring lock "42273739-c086-4cc7-a6c8-10710b16f794-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2b476e33-941b-4bbd-a23b-e918903097c8 req-b0103e10-92e8-4488-ad7e-4b0bd975a285 service nova] Lock "42273739-c086-4cc7-a6c8-10710b16f794-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2b476e33-941b-4bbd-a23b-e918903097c8 req-b0103e10-92e8-4488-ad7e-4b0bd975a285 service nova] Lock "42273739-c086-4cc7-a6c8-10710b16f794-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:21 user nova-compute[73484]: DEBUG nova.compute.manager [req-2b476e33-941b-4bbd-a23b-e918903097c8 req-b0103e10-92e8-4488-ad7e-4b0bd975a285 service nova] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] No waiting events found dispatching network-vif-plugged-e74d5355-d919-48fe-9355-918c02f38dd8 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:54:21 user nova-compute[73484]: WARNING nova.compute.manager [req-2b476e33-941b-4bbd-a23b-e918903097c8 req-b0103e10-92e8-4488-ad7e-4b0bd975a285 service nova] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Received unexpected event network-vif-plugged-e74d5355-d919-48fe-9355-918c02f38dd8 for instance with vm_state building and task_state spawning.
Aug 14 13:54:21 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021261.3898768, 42273739-c086-4cc7-a6c8-10710b16f794 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:54:21 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] VM Resumed (Lifecycle Event)
Aug 14 13:54:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:54:21 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:54:21 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Instance spawned successfully.
Aug 14 13:54:21 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:54:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:54:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:54:21 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:54:21 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:54:21 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:54:21 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:54:21 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:54:21 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:54:21 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:54:21 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021261.3914022, 42273739-c086-4cc7-a6c8-10710b16f794 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:54:21 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] VM Started (Lifecycle Event)
Aug 14 13:54:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:54:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:54:21 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:54:21 user nova-compute[73484]: INFO nova.compute.manager [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Took 6.40 seconds to spawn the instance on the hypervisor.
Aug 14 13:54:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:54:21 user nova-compute[73484]: INFO nova.compute.manager [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Took 7.31 seconds to build instance.
Aug 14 13:54:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7773e97b-9f71-4264-9239-fd7bd9bff11f tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "42273739-c086-4cc7-a6c8-10710b16f794" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.447s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:22 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5dc9709a-7203-44f3-8944-f1d0c0db9a1a tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Acquiring lock "09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5dc9709a-7203-44f3-8944-f1d0c0db9a1a tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Lock "09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5dc9709a-7203-44f3-8944-f1d0c0db9a1a tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Acquiring lock "09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5dc9709a-7203-44f3-8944-f1d0c0db9a1a tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Lock "09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5dc9709a-7203-44f3-8944-f1d0c0db9a1a tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Lock "09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:25 user nova-compute[73484]: INFO nova.compute.manager [None req-5dc9709a-7203-44f3-8944-f1d0c0db9a1a tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Terminating instance
Aug 14 13:54:25 user nova-compute[73484]: DEBUG nova.compute.manager [None req-5dc9709a-7203-44f3-8944-f1d0c0db9a1a tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:54:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:26 user nova-compute[73484]: DEBUG nova.compute.manager [req-8d356bed-fd9e-4986-9df1-695e5dffa69e req-b170c6d3-a2b4-4dd7-ab34-8d3b14cb9ad6 service nova] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Received event network-vif-unplugged-55e364a6-7e8f-43c6-ab88-e4f31d106521 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:54:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8d356bed-fd9e-4986-9df1-695e5dffa69e req-b170c6d3-a2b4-4dd7-ab34-8d3b14cb9ad6 service nova] Acquiring lock "09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8d356bed-fd9e-4986-9df1-695e5dffa69e req-b170c6d3-a2b4-4dd7-ab34-8d3b14cb9ad6 service nova] Lock "09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8d356bed-fd9e-4986-9df1-695e5dffa69e req-b170c6d3-a2b4-4dd7-ab34-8d3b14cb9ad6 service nova] Lock "09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:26 user nova-compute[73484]: DEBUG nova.compute.manager [req-8d356bed-fd9e-4986-9df1-695e5dffa69e req-b170c6d3-a2b4-4dd7-ab34-8d3b14cb9ad6 service nova] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] No waiting events found dispatching network-vif-unplugged-55e364a6-7e8f-43c6-ab88-e4f31d106521 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:54:26 user nova-compute[73484]: DEBUG nova.compute.manager [req-8d356bed-fd9e-4986-9df1-695e5dffa69e req-b170c6d3-a2b4-4dd7-ab34-8d3b14cb9ad6 service nova] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Received event network-vif-unplugged-55e364a6-7e8f-43c6-ab88-e4f31d106521 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:54:26 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Instance destroyed successfully.
Aug 14 13:54:26 user nova-compute[73484]: DEBUG nova.objects.instance [None req-5dc9709a-7203-44f3-8944-f1d0c0db9a1a tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Lazy-loading 'resources' on Instance uuid 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:54:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-5dc9709a-7203-44f3-8944-f1d0c0db9a1a tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:52:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-906238062',display_name='tempest-VolumesActionsTest-instance-906238062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-906238062',id=33,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:52:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7cb15e3b8ebb4c1e879c30636d1a8e9b',ramdisk_id='',reservation_id='r-0cv5abtk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-331432369',owner_user_name='tempest-VolumesActionsTest-331432369-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:52:31Z,user_data=None,user_id='4437106ba3554827a237238635e1b17f',uuid=09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55e364a6-7e8f-43c6-ab88-e4f31d106521", "address": "fa:16:3e:82:b6:e3", "network": {"id": "2b684cc1-1035-4e4e-a6f4-89fd1ebc48f9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1257195589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cb15e3b8ebb4c1e879c30636d1a8e9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e364a6-7e", "ovs_interfaceid": "55e364a6-7e8f-43c6-ab88-e4f31d106521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:54:26 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-5dc9709a-7203-44f3-8944-f1d0c0db9a1a tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Converting VIF {"id": "55e364a6-7e8f-43c6-ab88-e4f31d106521", "address": "fa:16:3e:82:b6:e3", "network": {"id": "2b684cc1-1035-4e4e-a6f4-89fd1ebc48f9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1257195589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cb15e3b8ebb4c1e879c30636d1a8e9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e364a6-7e", "ovs_interfaceid": "55e364a6-7e8f-43c6-ab88-e4f31d106521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:54:26 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-5dc9709a-7203-44f3-8944-f1d0c0db9a1a tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:b6:e3,bridge_name='br-int',has_traffic_filtering=True,id=55e364a6-7e8f-43c6-ab88-e4f31d106521,network=Network(2b684cc1-1035-4e4e-a6f4-89fd1ebc48f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e364a6-7e') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:54:26 user nova-compute[73484]: DEBUG os_vif [None req-5dc9709a-7203-44f3-8944-f1d0c0db9a1a tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:b6:e3,bridge_name='br-int',has_traffic_filtering=True,id=55e364a6-7e8f-43c6-ab88-e4f31d106521,network=Network(2b684cc1-1035-4e4e-a6f4-89fd1ebc48f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e364a6-7e') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:54:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55e364a6-7e, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:54:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:26 user nova-compute[73484]: INFO os_vif [None req-5dc9709a-7203-44f3-8944-f1d0c0db9a1a tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:b6:e3,bridge_name='br-int',has_traffic_filtering=True,id=55e364a6-7e8f-43c6-ab88-e4f31d106521,network=Network(2b684cc1-1035-4e4e-a6f4-89fd1ebc48f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e364a6-7e')
Aug 14 13:54:26 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-5dc9709a-7203-44f3-8944-f1d0c0db9a1a tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Deleting instance files /opt/stack/data/nova/instances/09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa_del
Aug 14 13:54:26 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-5dc9709a-7203-44f3-8944-f1d0c0db9a1a tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Deletion of /opt/stack/data/nova/instances/09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa_del complete
Aug 14 13:54:26 user nova-compute[73484]: INFO nova.compute.manager [None req-5dc9709a-7203-44f3-8944-f1d0c0db9a1a tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 14 13:54:26 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-5dc9709a-7203-44f3-8944-f1d0c0db9a1a tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:54:26 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:54:26 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:54:27 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:54:27 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Took 0.75 seconds to deallocate network for instance.
Aug 14 13:54:27 user nova-compute[73484]: DEBUG nova.compute.manager [req-26643888-1793-48a4-b026-a9f512a52158 req-c06f83e4-bb60-426e-8f98-aacc7d5da2f3 service nova] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Received event network-vif-deleted-55e364a6-7e8f-43c6-ab88-e4f31d106521 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:54:27 user nova-compute[73484]: INFO nova.compute.manager [req-26643888-1793-48a4-b026-a9f512a52158 req-c06f83e4-bb60-426e-8f98-aacc7d5da2f3 service nova] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Neutron deleted interface 55e364a6-7e8f-43c6-ab88-e4f31d106521; detaching it from the instance and deleting it from the info cache
Aug 14 13:54:27 user nova-compute[73484]: DEBUG nova.network.neutron [req-26643888-1793-48a4-b026-a9f512a52158 req-c06f83e4-bb60-426e-8f98-aacc7d5da2f3 service nova] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:54:27 user nova-compute[73484]: DEBUG nova.compute.manager [req-26643888-1793-48a4-b026-a9f512a52158 req-c06f83e4-bb60-426e-8f98-aacc7d5da2f3 service nova] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Detach interface failed, port_id=55e364a6-7e8f-43c6-ab88-e4f31d106521, reason: Instance 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa could not be found. {{(pid=73484) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 13:54:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5dc9709a-7203-44f3-8944-f1d0c0db9a1a tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5dc9709a-7203-44f3-8944-f1d0c0db9a1a tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:27 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-5dc9709a-7203-44f3-8944-f1d0c0db9a1a tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:54:27 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-5dc9709a-7203-44f3-8944-f1d0c0db9a1a tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:54:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5dc9709a-7203-44f3-8944-f1d0c0db9a1a tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:27 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-5dc9709a-7203-44f3-8944-f1d0c0db9a1a tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Deleted allocations for instance 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa
Aug 14 13:54:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-5dc9709a-7203-44f3-8944-f1d0c0db9a1a tempest-VolumesActionsTest-331432369 tempest-VolumesActionsTest-331432369-project-member] Lock "09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.360s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:28 user nova-compute[73484]: DEBUG nova.compute.manager [req-8eacef75-f569-4129-a25d-330f82be79a8 req-d89bf163-9991-4a1b-87c5-3d7b09517653 service nova] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Received event network-vif-plugged-55e364a6-7e8f-43c6-ab88-e4f31d106521 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:54:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8eacef75-f569-4129-a25d-330f82be79a8 req-d89bf163-9991-4a1b-87c5-3d7b09517653 service nova] Acquiring lock "09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8eacef75-f569-4129-a25d-330f82be79a8 req-d89bf163-9991-4a1b-87c5-3d7b09517653 service nova] Lock "09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8eacef75-f569-4129-a25d-330f82be79a8 req-d89bf163-9991-4a1b-87c5-3d7b09517653 service nova] Lock "09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:28 user nova-compute[73484]: DEBUG nova.compute.manager [req-8eacef75-f569-4129-a25d-330f82be79a8 req-d89bf163-9991-4a1b-87c5-3d7b09517653 service nova] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] No waiting events found dispatching network-vif-plugged-55e364a6-7e8f-43c6-ab88-e4f31d106521 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:54:28 user nova-compute[73484]: WARNING nova.compute.manager [req-8eacef75-f569-4129-a25d-330f82be79a8 req-d89bf163-9991-4a1b-87c5-3d7b09517653 service nova] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Received unexpected event network-vif-plugged-55e364a6-7e8f-43c6-ab88-e4f31d106521 for instance with vm_state deleted and task_state None.
Aug 14 13:54:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-617b8508-afed-4044-8aae-ac3c8da5b389 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-617b8508-afed-4044-8aae-ac3c8da5b389 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-617b8508-afed-4044-8aae-ac3c8da5b389 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-617b8508-afed-4044-8aae-ac3c8da5b389 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-617b8508-afed-4044-8aae-ac3c8da5b389 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:37 user nova-compute[73484]: INFO nova.compute.manager [None req-617b8508-afed-4044-8aae-ac3c8da5b389 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Terminating instance
Aug 14 13:54:37 user nova-compute[73484]: DEBUG nova.compute.manager [None req-617b8508-afed-4044-8aae-ac3c8da5b389 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:54:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:37 user nova-compute[73484]: DEBUG nova.compute.manager [req-63a80081-03f2-4394-a13b-a2043e18bb61 req-6098610b-49cf-4f29-b5b6-f51885656631 service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Received event network-vif-unplugged-8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:54:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-63a80081-03f2-4394-a13b-a2043e18bb61 req-6098610b-49cf-4f29-b5b6-f51885656631 service nova] Acquiring lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-63a80081-03f2-4394-a13b-a2043e18bb61 req-6098610b-49cf-4f29-b5b6-f51885656631 service nova] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-63a80081-03f2-4394-a13b-a2043e18bb61 req-6098610b-49cf-4f29-b5b6-f51885656631 service nova] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:37 user nova-compute[73484]: DEBUG nova.compute.manager [req-63a80081-03f2-4394-a13b-a2043e18bb61 req-6098610b-49cf-4f29-b5b6-f51885656631 service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] No waiting events found dispatching network-vif-unplugged-8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:54:37 user nova-compute[73484]: DEBUG nova.compute.manager [req-63a80081-03f2-4394-a13b-a2043e18bb61 req-6098610b-49cf-4f29-b5b6-f51885656631 service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Received event network-vif-unplugged-8f0b7e99-89d1-4234-a552-e92df188cd4e for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:54:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:37 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Instance destroyed successfully.
Aug 14 13:54:37 user nova-compute[73484]: DEBUG nova.objects.instance [None req-617b8508-afed-4044-8aae-ac3c8da5b389 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lazy-loading 'resources' on Instance uuid 86580f0d-dd88-48fb-bce8-dc6f5edc01c6 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:54:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-617b8508-afed-4044-8aae-ac3c8da5b389 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T13:48:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1425856117',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1425856117',id=30,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbnYbAG6NpHt2DOEAzWMWcC4//dmDDjdoohHJ9Fhcgro4zefbJFRczoX4bLxibnHjgSCxNgQI7+hK/klX7r00Q0wzHK+QIzN2xNAdcO22IDBNUHlOwSiIg074+PXIFxAg==',key_name='tempest-keypair-396971079',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:52:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c1ccc7c1aaf497da5f1d325d79e9301',ramdisk_id='',reservation_id='r-ypie00bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1730232968',owner_user_name='tempest-AttachVolumeShelveTestJSON-1730232968-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:53:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bda36df8b1f64c7894bfee5da258c1e6',uuid=86580f0d-dd88-48fb-bce8-dc6f5edc01c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "address": "fa:16:3e:20:8b:68", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0b7e99-89", "ovs_interfaceid": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:54:37 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-617b8508-afed-4044-8aae-ac3c8da5b389 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Converting VIF {"id": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "address": "fa:16:3e:20:8b:68", "network": {"id": "cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-687909640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c1ccc7c1aaf497da5f1d325d79e9301", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0b7e99-89", "ovs_interfaceid": "8f0b7e99-89d1-4234-a552-e92df188cd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:54:37 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-617b8508-afed-4044-8aae-ac3c8da5b389 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:8b:68,bridge_name='br-int',has_traffic_filtering=True,id=8f0b7e99-89d1-4234-a552-e92df188cd4e,network=Network(cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f0b7e99-89') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:54:37 user nova-compute[73484]: DEBUG os_vif [None req-617b8508-afed-4044-8aae-ac3c8da5b389 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:8b:68,bridge_name='br-int',has_traffic_filtering=True,id=8f0b7e99-89d1-4234-a552-e92df188cd4e,network=Network(cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f0b7e99-89') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:54:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f0b7e99-89, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:54:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:37 user nova-compute[73484]: INFO os_vif [None req-617b8508-afed-4044-8aae-ac3c8da5b389 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:8b:68,bridge_name='br-int',has_traffic_filtering=True,id=8f0b7e99-89d1-4234-a552-e92df188cd4e,network=Network(cceb7d6c-d3ad-4f2f-96a7-8ef693183e7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f0b7e99-89')
Aug 14 13:54:37 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-617b8508-afed-4044-8aae-ac3c8da5b389 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Deleting instance files /opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6_del
Aug 14 13:54:38 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-617b8508-afed-4044-8aae-ac3c8da5b389 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Deletion of /opt/stack/data/nova/instances/86580f0d-dd88-48fb-bce8-dc6f5edc01c6_del complete
Aug 14 13:54:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:38 user nova-compute[73484]: INFO nova.compute.manager [None req-617b8508-afed-4044-8aae-ac3c8da5b389 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Took 0.70 seconds to destroy the instance on the hypervisor.
Aug 14 13:54:38 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-617b8508-afed-4044-8aae-ac3c8da5b389 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:54:38 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:54:38 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:54:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:39 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:54:39 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Took 1.53 seconds to deallocate network for instance.
Aug 14 13:54:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-b99e8914-f701-42e7-bc25-76c2c92b9aff req-f9c9d9e7-8cde-4f5f-b271-55c581d04ebf service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Received event network-vif-deleted-8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:54:39 user nova-compute[73484]: INFO nova.compute.manager [req-b99e8914-f701-42e7-bc25-76c2c92b9aff req-f9c9d9e7-8cde-4f5f-b271-55c581d04ebf service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Neutron deleted interface 8f0b7e99-89d1-4234-a552-e92df188cd4e; detaching it from the instance and deleting it from the info cache
Aug 14 13:54:39 user nova-compute[73484]: DEBUG nova.network.neutron [req-b99e8914-f701-42e7-bc25-76c2c92b9aff req-f9c9d9e7-8cde-4f5f-b271-55c581d04ebf service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:54:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-b99e8914-f701-42e7-bc25-76c2c92b9aff req-f9c9d9e7-8cde-4f5f-b271-55c581d04ebf service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Detach interface failed, port_id=8f0b7e99-89d1-4234-a552-e92df188cd4e, reason: Instance 86580f0d-dd88-48fb-bce8-dc6f5edc01c6 could not be found. {{(pid=73484) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 13:54:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-617b8508-afed-4044-8aae-ac3c8da5b389 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-617b8508-afed-4044-8aae-ac3c8da5b389 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-4db42683-e950-4a82-8882-714035b92cc3 req-723326c4-78c8-4b72-8717-b2213aec6d0c service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Received event network-vif-plugged-8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:54:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4db42683-e950-4a82-8882-714035b92cc3 req-723326c4-78c8-4b72-8717-b2213aec6d0c service nova] Acquiring lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4db42683-e950-4a82-8882-714035b92cc3 req-723326c4-78c8-4b72-8717-b2213aec6d0c service nova] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4db42683-e950-4a82-8882-714035b92cc3 req-723326c4-78c8-4b72-8717-b2213aec6d0c service nova] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-4db42683-e950-4a82-8882-714035b92cc3 req-723326c4-78c8-4b72-8717-b2213aec6d0c service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] No waiting events found dispatching network-vif-plugged-8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:54:39 user nova-compute[73484]: WARNING nova.compute.manager [req-4db42683-e950-4a82-8882-714035b92cc3 req-723326c4-78c8-4b72-8717-b2213aec6d0c service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Received unexpected event network-vif-plugged-8f0b7e99-89d1-4234-a552-e92df188cd4e for instance with vm_state deleted and task_state None.
Aug 14 13:54:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-4db42683-e950-4a82-8882-714035b92cc3 req-723326c4-78c8-4b72-8717-b2213aec6d0c service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Received event network-vif-plugged-8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:54:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4db42683-e950-4a82-8882-714035b92cc3 req-723326c4-78c8-4b72-8717-b2213aec6d0c service nova] Acquiring lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4db42683-e950-4a82-8882-714035b92cc3 req-723326c4-78c8-4b72-8717-b2213aec6d0c service nova] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4db42683-e950-4a82-8882-714035b92cc3 req-723326c4-78c8-4b72-8717-b2213aec6d0c service nova] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-4db42683-e950-4a82-8882-714035b92cc3 req-723326c4-78c8-4b72-8717-b2213aec6d0c service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] No waiting events found dispatching network-vif-plugged-8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:54:39 user nova-compute[73484]: WARNING nova.compute.manager [req-4db42683-e950-4a82-8882-714035b92cc3 req-723326c4-78c8-4b72-8717-b2213aec6d0c service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Received unexpected event network-vif-plugged-8f0b7e99-89d1-4234-a552-e92df188cd4e for instance with vm_state deleted and task_state None.
Aug 14 13:54:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-4db42683-e950-4a82-8882-714035b92cc3 req-723326c4-78c8-4b72-8717-b2213aec6d0c service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Received event network-vif-plugged-8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:54:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4db42683-e950-4a82-8882-714035b92cc3 req-723326c4-78c8-4b72-8717-b2213aec6d0c service nova] Acquiring lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4db42683-e950-4a82-8882-714035b92cc3 req-723326c4-78c8-4b72-8717-b2213aec6d0c service nova] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4db42683-e950-4a82-8882-714035b92cc3 req-723326c4-78c8-4b72-8717-b2213aec6d0c service nova] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-4db42683-e950-4a82-8882-714035b92cc3 req-723326c4-78c8-4b72-8717-b2213aec6d0c service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] No waiting events found dispatching network-vif-plugged-8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:54:39 user nova-compute[73484]: WARNING nova.compute.manager [req-4db42683-e950-4a82-8882-714035b92cc3 req-723326c4-78c8-4b72-8717-b2213aec6d0c service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Received unexpected event network-vif-plugged-8f0b7e99-89d1-4234-a552-e92df188cd4e for instance with vm_state deleted and task_state None.
Aug 14 13:54:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-4db42683-e950-4a82-8882-714035b92cc3 req-723326c4-78c8-4b72-8717-b2213aec6d0c service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Received event network-vif-unplugged-8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:54:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4db42683-e950-4a82-8882-714035b92cc3 req-723326c4-78c8-4b72-8717-b2213aec6d0c service nova] Acquiring lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4db42683-e950-4a82-8882-714035b92cc3 req-723326c4-78c8-4b72-8717-b2213aec6d0c service nova] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4db42683-e950-4a82-8882-714035b92cc3 req-723326c4-78c8-4b72-8717-b2213aec6d0c service nova] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-4db42683-e950-4a82-8882-714035b92cc3 req-723326c4-78c8-4b72-8717-b2213aec6d0c service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] No waiting events found dispatching network-vif-unplugged-8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:54:39 user nova-compute[73484]: WARNING nova.compute.manager [req-4db42683-e950-4a82-8882-714035b92cc3 req-723326c4-78c8-4b72-8717-b2213aec6d0c service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Received unexpected event network-vif-unplugged-8f0b7e99-89d1-4234-a552-e92df188cd4e for instance with vm_state deleted and task_state None.
Aug 14 13:54:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-4db42683-e950-4a82-8882-714035b92cc3 req-723326c4-78c8-4b72-8717-b2213aec6d0c service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Received event network-vif-plugged-8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:54:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4db42683-e950-4a82-8882-714035b92cc3 req-723326c4-78c8-4b72-8717-b2213aec6d0c service nova] Acquiring lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4db42683-e950-4a82-8882-714035b92cc3 req-723326c4-78c8-4b72-8717-b2213aec6d0c service nova] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4db42683-e950-4a82-8882-714035b92cc3 req-723326c4-78c8-4b72-8717-b2213aec6d0c service nova] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-4db42683-e950-4a82-8882-714035b92cc3 req-723326c4-78c8-4b72-8717-b2213aec6d0c service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] No waiting events found dispatching network-vif-plugged-8f0b7e99-89d1-4234-a552-e92df188cd4e {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:54:39 user nova-compute[73484]: WARNING nova.compute.manager [req-4db42683-e950-4a82-8882-714035b92cc3 req-723326c4-78c8-4b72-8717-b2213aec6d0c service nova] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Received unexpected event network-vif-plugged-8f0b7e99-89d1-4234-a552-e92df188cd4e for instance with vm_state deleted and task_state None.
Aug 14 13:54:39 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-617b8508-afed-4044-8aae-ac3c8da5b389 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:54:40 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-617b8508-afed-4044-8aae-ac3c8da5b389 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:54:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-617b8508-afed-4044-8aae-ac3c8da5b389 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:40 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-617b8508-afed-4044-8aae-ac3c8da5b389 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Deleted allocations for instance 86580f0d-dd88-48fb-bce8-dc6f5edc01c6
Aug 14 13:54:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-617b8508-afed-4044-8aae-ac3c8da5b389 tempest-AttachVolumeShelveTestJSON-1730232968 tempest-AttachVolumeShelveTestJSON-1730232968-project-member] Lock "86580f0d-dd88-48fb-bce8-dc6f5edc01c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.759s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:41 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692021266.5878365, 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:54:41 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] VM Stopped (Lifecycle Event)
Aug 14 13:54:41 user nova-compute[73484]: DEBUG nova.compute.manager [None req-31733715-e655-4fde-a1fe-e7db4fd30f20 None None] [instance: 09ef5791-eeb0-4a90-9c1c-2dd3ded9f2fa] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:54:42 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:44 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:54:44 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 13:54:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-03255d24-b6fd-459c-8ac6-f9c4063b54b2" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:54:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-03255d24-b6fd-459c-8ac6-f9c4063b54b2" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:54:44 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 13:54:45 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Updating instance_info_cache with network_info: [{"id": "be08ca28-6a00-468c-9988-87185f498ca3", "address": "fa:16:3e:66:27:2e", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe08ca28-6a", "ovs_interfaceid": "be08ca28-6a00-468c-9988-87185f498ca3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:54:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-03255d24-b6fd-459c-8ac6-f9c4063b54b2" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:54:45 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 13:54:45 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:54:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1cb2b994-3e4d-408b-997d-8d0e39d0df2f tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "c0994bac-3b43-414e-aa81-a9d7198775a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1cb2b994-3e4d-408b-997d-8d0e39d0df2f tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "c0994bac-3b43-414e-aa81-a9d7198775a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1cb2b994-3e4d-408b-997d-8d0e39d0df2f tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "c0994bac-3b43-414e-aa81-a9d7198775a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1cb2b994-3e4d-408b-997d-8d0e39d0df2f tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "c0994bac-3b43-414e-aa81-a9d7198775a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1cb2b994-3e4d-408b-997d-8d0e39d0df2f tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "c0994bac-3b43-414e-aa81-a9d7198775a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:45 user nova-compute[73484]: INFO nova.compute.manager [None req-1cb2b994-3e4d-408b-997d-8d0e39d0df2f tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Terminating instance
Aug 14 13:54:45 user nova-compute[73484]: DEBUG nova.compute.manager [None req-1cb2b994-3e4d-408b-997d-8d0e39d0df2f tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:54:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:45 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:54:45 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 13:54:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:45 user nova-compute[73484]: DEBUG nova.compute.manager [req-8e9b6dbc-0fb7-4a9a-9f2d-dc32bcd75bbf req-f80a250a-a86e-4e42-8428-8a6e80bff746 service nova] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Received event network-vif-unplugged-67b5678c-ab81-4b84-86cc-c882ff19b949 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:54:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8e9b6dbc-0fb7-4a9a-9f2d-dc32bcd75bbf req-f80a250a-a86e-4e42-8428-8a6e80bff746 service nova] Acquiring lock "c0994bac-3b43-414e-aa81-a9d7198775a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8e9b6dbc-0fb7-4a9a-9f2d-dc32bcd75bbf req-f80a250a-a86e-4e42-8428-8a6e80bff746 service nova] Lock "c0994bac-3b43-414e-aa81-a9d7198775a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8e9b6dbc-0fb7-4a9a-9f2d-dc32bcd75bbf req-f80a250a-a86e-4e42-8428-8a6e80bff746 service nova] Lock "c0994bac-3b43-414e-aa81-a9d7198775a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:45 user nova-compute[73484]: DEBUG nova.compute.manager [req-8e9b6dbc-0fb7-4a9a-9f2d-dc32bcd75bbf req-f80a250a-a86e-4e42-8428-8a6e80bff746 service nova] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] No waiting events found dispatching network-vif-unplugged-67b5678c-ab81-4b84-86cc-c882ff19b949 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:54:45 user nova-compute[73484]: DEBUG nova.compute.manager [req-8e9b6dbc-0fb7-4a9a-9f2d-dc32bcd75bbf req-f80a250a-a86e-4e42-8428-8a6e80bff746 service nova] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Received event network-vif-unplugged-67b5678c-ab81-4b84-86cc-c882ff19b949 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:54:46 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Instance destroyed successfully.
Aug 14 13:54:46 user nova-compute[73484]: DEBUG nova.objects.instance [None req-1cb2b994-3e4d-408b-997d-8d0e39d0df2f tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lazy-loading 'resources' on Instance uuid c0994bac-3b43-414e-aa81-a9d7198775a6 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:54:46 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-1cb2b994-3e4d-408b-997d-8d0e39d0df2f tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:45:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1086915947',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1086915947',id=23,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:45:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c7f2c51c0f84bf1aedcf493a9ff860f',ramdisk_id='',reservation_id='r-zxtjs5zf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-830908511',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:47:19Z,user_data=None,user_id='5a0f55ad018d4c0ca587d8bdd40df4c8',uuid=c0994bac-3b43-414e-aa81-a9d7198775a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67b5678c-ab81-4b84-86cc-c882ff19b949", "address": "fa:16:3e:f8:d1:e3", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b5678c-ab", "ovs_interfaceid": "67b5678c-ab81-4b84-86cc-c882ff19b949", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:54:46 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-1cb2b994-3e4d-408b-997d-8d0e39d0df2f tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Converting VIF {"id": "67b5678c-ab81-4b84-86cc-c882ff19b949", "address": "fa:16:3e:f8:d1:e3", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67b5678c-ab", "ovs_interfaceid": "67b5678c-ab81-4b84-86cc-c882ff19b949", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:54:46 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-1cb2b994-3e4d-408b-997d-8d0e39d0df2f tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:d1:e3,bridge_name='br-int',has_traffic_filtering=True,id=67b5678c-ab81-4b84-86cc-c882ff19b949,network=Network(4ec437fc-4371-48d6-8026-b64423fbc0ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b5678c-ab') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:54:46 user nova-compute[73484]: DEBUG os_vif [None req-1cb2b994-3e4d-408b-997d-8d0e39d0df2f tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:d1:e3,bridge_name='br-int',has_traffic_filtering=True,id=67b5678c-ab81-4b84-86cc-c882ff19b949,network=Network(4ec437fc-4371-48d6-8026-b64423fbc0ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b5678c-ab') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:54:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67b5678c-ab, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:54:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:54:46 user nova-compute[73484]: INFO os_vif [None req-1cb2b994-3e4d-408b-997d-8d0e39d0df2f tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:d1:e3,bridge_name='br-int',has_traffic_filtering=True,id=67b5678c-ab81-4b84-86cc-c882ff19b949,network=Network(4ec437fc-4371-48d6-8026-b64423fbc0ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67b5678c-ab')
Aug 14 13:54:46 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-1cb2b994-3e4d-408b-997d-8d0e39d0df2f tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Deleting instance files /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6_del
Aug 14 13:54:46 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-1cb2b994-3e4d-408b-997d-8d0e39d0df2f tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Deletion of /opt/stack/data/nova/instances/c0994bac-3b43-414e-aa81-a9d7198775a6_del complete
Aug 14 13:54:46 user nova-compute[73484]: INFO nova.compute.manager [None req-1cb2b994-3e4d-408b-997d-8d0e39d0df2f tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Took 0.64 seconds to destroy the instance on the hypervisor.
Aug 14 13:54:46 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-1cb2b994-3e4d-408b-997d-8d0e39d0df2f tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:54:46 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:54:46 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:54:46 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:54:46 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Took 0.49 seconds to deallocate network for instance.
Aug 14 13:54:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1cb2b994-3e4d-408b-997d-8d0e39d0df2f tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1cb2b994-3e4d-408b-997d-8d0e39d0df2f tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:47 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-1cb2b994-3e4d-408b-997d-8d0e39d0df2f tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:54:47 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-1cb2b994-3e4d-408b-997d-8d0e39d0df2f tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:54:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1cb2b994-3e4d-408b-997d-8d0e39d0df2f tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:47 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-1cb2b994-3e4d-408b-997d-8d0e39d0df2f tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Deleted allocations for instance c0994bac-3b43-414e-aa81-a9d7198775a6
Aug 14 13:54:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1cb2b994-3e4d-408b-997d-8d0e39d0df2f tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "c0994bac-3b43-414e-aa81-a9d7198775a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.660s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:48 user nova-compute[73484]: DEBUG nova.compute.manager [req-149cb2d1-43d4-499e-a819-3b269f8914a5 req-e07d8830-2028-4602-b4fd-36b1d8167e22 service nova] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Received event network-vif-plugged-67b5678c-ab81-4b84-86cc-c882ff19b949 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:54:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-149cb2d1-43d4-499e-a819-3b269f8914a5 req-e07d8830-2028-4602-b4fd-36b1d8167e22 service nova] Acquiring lock "c0994bac-3b43-414e-aa81-a9d7198775a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-149cb2d1-43d4-499e-a819-3b269f8914a5 req-e07d8830-2028-4602-b4fd-36b1d8167e22 service nova] Lock "c0994bac-3b43-414e-aa81-a9d7198775a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-149cb2d1-43d4-499e-a819-3b269f8914a5 req-e07d8830-2028-4602-b4fd-36b1d8167e22 service nova] Lock "c0994bac-3b43-414e-aa81-a9d7198775a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:48 user nova-compute[73484]: DEBUG nova.compute.manager [req-149cb2d1-43d4-499e-a819-3b269f8914a5 req-e07d8830-2028-4602-b4fd-36b1d8167e22 service nova] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] No waiting events found dispatching network-vif-plugged-67b5678c-ab81-4b84-86cc-c882ff19b949 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:54:48 user nova-compute[73484]: WARNING nova.compute.manager [req-149cb2d1-43d4-499e-a819-3b269f8914a5 req-e07d8830-2028-4602-b4fd-36b1d8167e22 service nova] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Received unexpected event network-vif-plugged-67b5678c-ab81-4b84-86cc-c882ff19b949 for instance with vm_state deleted and task_state None.
Aug 14 13:54:48 user nova-compute[73484]: DEBUG nova.compute.manager [req-149cb2d1-43d4-499e-a819-3b269f8914a5 req-e07d8830-2028-4602-b4fd-36b1d8167e22 service nova] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Received event network-vif-deleted-67b5678c-ab81-4b84-86cc-c882ff19b949 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:54:48 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:54:48 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:54:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:48 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 13:54:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:54:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:54:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json" returned: 0 in 0.244s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:51 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:54:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42273739-c086-4cc7-a6c8-10710b16f794/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:51 user nova-compute[73484]: DEBUG nova.compute.manager [req-5124485b-3747-4732-ab19-83116416fdd0 req-da6bf71e-c10f-43ff-8d20-8a2466e1c7de service nova] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Received event network-changed-b5ceef09-ab2f-4db8-8c7b-c239fc361daf {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:54:51 user nova-compute[73484]: DEBUG nova.compute.manager [req-5124485b-3747-4732-ab19-83116416fdd0 req-da6bf71e-c10f-43ff-8d20-8a2466e1c7de service nova] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Refreshing instance network info cache due to event network-changed-b5ceef09-ab2f-4db8-8c7b-c239fc361daf. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:54:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5124485b-3747-4732-ab19-83116416fdd0 req-da6bf71e-c10f-43ff-8d20-8a2466e1c7de service nova] Acquiring lock "refresh_cache-b8a790d0-e5d0-4b78-8de4-36a58290b4ee" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:54:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5124485b-3747-4732-ab19-83116416fdd0 req-da6bf71e-c10f-43ff-8d20-8a2466e1c7de service nova] Acquired lock "refresh_cache-b8a790d0-e5d0-4b78-8de4-36a58290b4ee" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:54:51 user nova-compute[73484]: DEBUG nova.network.neutron [req-5124485b-3747-4732-ab19-83116416fdd0 req-da6bf71e-c10f-43ff-8d20-8a2466e1c7de service nova] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Refreshing network info cache for port b5ceef09-ab2f-4db8-8c7b-c239fc361daf {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:54:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42273739-c086-4cc7-a6c8-10710b16f794/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42273739-c086-4cc7-a6c8-10710b16f794/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42273739-c086-4cc7-a6c8-10710b16f794/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:51 user nova-compute[73484]: DEBUG nova.network.neutron [req-5124485b-3747-4732-ab19-83116416fdd0 req-da6bf71e-c10f-43ff-8d20-8a2466e1c7de service nova] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Updated VIF entry in instance network info cache for port b5ceef09-ab2f-4db8-8c7b-c239fc361daf. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:54:51 user nova-compute[73484]: DEBUG nova.network.neutron [req-5124485b-3747-4732-ab19-83116416fdd0 req-da6bf71e-c10f-43ff-8d20-8a2466e1c7de service nova] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Updating instance_info_cache with network_info: [{"id": "b5ceef09-ab2f-4db8-8c7b-c239fc361daf", "address": "fa:16:3e:60:5a:aa", "network": {"id": "8f719ef2-7286-46f1-96e0-d08fd389db0e", "bridge": "br-int", "label": "tempest-TestStampPattern-1811054691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a442b6e525b4ae9ba256aa1c71e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ceef09-ab", "ovs_interfaceid": "b5ceef09-ab2f-4db8-8c7b-c239fc361daf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:54:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5124485b-3747-4732-ab19-83116416fdd0 req-da6bf71e-c10f-43ff-8d20-8a2466e1c7de service nova] Releasing lock "refresh_cache-b8a790d0-e5d0-4b78-8de4-36a58290b4ee" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:54:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:52 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:54:52 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:54:52 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=7315MB free_disk=25.245197296142578GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 13:54:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:52 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance f4f7788c-fcca-47c1-b5b8-72892253982d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:54:52 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 07bac569-8b2c-4555-b4d5-a74f7384630b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:54:52 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance a9d4ec42-3db9-439b-87a7-02bcaab514a4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:54:52 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 782c6142-757a-49ae-9292-787a7f1e8a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:54:52 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 03255d24-b6fd-459c-8ac6-f9c4063b54b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:54:52 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 72f007af-a1e7-4a80-954c-ed12aaf129fd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:54:52 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance b8a790d0-e5d0-4b78-8de4-36a58290b4ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:54:52 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 14999671-dcc7-43fa-85ec-21cbcf12d21e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:54:52 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance a54902a5-df8a-473f-9cf1-a112528c3549 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:54:52 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 42273739-c086-4cc7-a6c8-10710b16f794 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:54:52 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 13:54:52 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 13:54:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquiring lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:52 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692021277.959048, 86580f0d-dd88-48fb-bce8-dc6f5edc01c6 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:54:52 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] VM Stopped (Lifecycle Event)
Aug 14 13:54:52 user nova-compute[73484]: DEBUG nova.objects.instance [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lazy-loading 'flavor' on Instance uuid b8a790d0-e5d0-4b78-8de4-36a58290b4ee {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:54:52 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:54:52 user nova-compute[73484]: DEBUG nova.compute.manager [None req-fbb59a51-a85b-4e2e-b9cc-1e6889d7c2f0 None None] [instance: 86580f0d-dd88-48fb-bce8-dc6f5edc01c6] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:54:52 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:54:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:53 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 13:54:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.420s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:54:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquiring lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:54:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:54:53 user nova-compute[73484]: INFO nova.compute.manager [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Attaching volume 9cfdd7f0-b366-4984-99f3-0b55514e2385 to /dev/vdb
Aug 14 13:54:53 user nova-compute[73484]: DEBUG os_brick.utils [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:54:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:53 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[774db530-09a9-463d-b13f-f1e79bb3be05]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:54:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:53 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfaa2ae-5b05-4b56-8b4d-407506755531]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:54:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:54:53 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[345af29e-8799-4170-b6aa-04a560095880]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:54:53 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd2a97e-cecf-4b3a-9b39-a5b86b930e93]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:54:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:54:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:54:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:54:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:54:53 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:54:53 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ef73bb-a2e2-44dc-a64a-9be80900837d]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:54:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:54:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:54:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:54:53 user nova-compute[73484]: DEBUG os_brick.utils [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:54:53 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Updating existing volume attachment record: 58750ff1-01ad-4708-b37e-509b9685a5f0 {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:54:54 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:54:54 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:54:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:54 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:54:55 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:54:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:54:57 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:54:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:01 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692021286.1407056, c0994bac-3b43-414e-aa81-a9d7198775a6 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:55:01 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] VM Stopped (Lifecycle Event)
Aug 14 13:55:01 user nova-compute[73484]: DEBUG nova.compute.manager [None req-24f6fc7e-31ed-4714-a75d-ce5a3c32d9c8 None None] [instance: c0994bac-3b43-414e-aa81-a9d7198775a6] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:55:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qlpzHTVK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:55:02 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:55:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:55:02 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:55:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:55:02 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[47133354-ec44-4157-a5d8-47421617dd36]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:55:02 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385 -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adfe81e-6426-4559-83dd-7889adc3b7dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385] added
Aug 14 13:55:02 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b3aff9-976c-4254-9900-93fa8d84d8d2]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[836e95c8-0a1d-42b2-b6e6-1289508cef2a]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qlpzHTVK {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qlpzHTVK" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7056b6a8-010e-423f-859c-25724ea7b415]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qlpzHTVK'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72bf94e-7b19-4fa6-8659-2229184bf452]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ade6e29-5a15-4575-995c-4017dccc019e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:55:02 user nova-compute[73484]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:55:02 user nova-compute[73484]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)
Aug 14 13:55:02 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:55:02 user nova-compute[73484]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:55:02 user nova-compute[73484]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)
Aug 14 13:55:02 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385 -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[455a3d79-d6e0-4289-9b61-ecd9dae0f505]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385, portal: 172.16.0.220,3260]
Aug 14 13:55:02 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385, portal: 172.16.0.220,3260] successful.
Aug 14 13:55:02 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c6bd8c-9406-43c7-9844-ab5ad8bbd84f]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51e42eb-475b-48c2-94a5-6c75f47a10b3]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:55:02 user nova-compute[73484]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:55:02 user nova-compute[73484]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)
Aug 14 13:55:02 user nova-compute[73484]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385 (non-flash)
Aug 14 13:55:02 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:55:02 user nova-compute[73484]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:55:02 user nova-compute[73484]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)
Aug 14 13:55:02 user nova-compute[73484]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385 (non-flash)
Aug 14 13:55:02 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[657d9ca3-2fff-46bb-b66f-fb620aa0f5c9]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:02 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: None {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:55:03 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:55:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qlpzHTVK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:55:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:55:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23536386561616530', 'path': '/dev/sde'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:55:03 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536386561616530', 'path': '/dev/sde'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:55:03 user nova-compute[73484]: DEBUG nova.objects.instance [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lazy-loading 'flavor' on Instance uuid b8a790d0-e5d0-4b78-8de4-36a58290b4ee {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:55:03 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 13:55:03 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:55:03 user nova-compute[73484]:   <source dev="/dev/sde"/>
Aug 14 13:55:03 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:55:03 user nova-compute[73484]:   <serial>9cfdd7f0-b366-4984-99f3-0b55514e2385</serial>
Aug 14 13:55:03 user nova-compute[73484]: </disk>
Aug 14 13:55:03 user nova-compute[73484]:  {{(pid=73484) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 13:55:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:55:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:55:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] No VIF found with MAC fa:16:3e:60:5a:aa, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:55:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a7975cb7-4b71-48e9-b564-f9f6d6cdc6ea tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.060s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:55:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:55:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquiring lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:55:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:55:06 user nova-compute[73484]: INFO nova.compute.manager [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Detaching volume 9cfdd7f0-b366-4984-99f3-0b55514e2385
Aug 14 13:55:06 user nova-compute[73484]: INFO nova.virt.block_device [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Attempting to driver detach volume 9cfdd7f0-b366-4984-99f3-0b55514e2385 from mountpoint /dev/vdb
Aug 14 13:55:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Attempting to detach device vdb from instance b8a790d0-e5d0-4b78-8de4-36a58290b4ee from the persistent domain config. {{(pid=73484) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 13:55:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:55:06 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:55:06 user nova-compute[73484]:   <source dev="/dev/sde"/>
Aug 14 13:55:06 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:55:06 user nova-compute[73484]:   <serial>9cfdd7f0-b366-4984-99f3-0b55514e2385</serial>
Aug 14 13:55:06 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 13:55:06 user nova-compute[73484]: </disk>
Aug 14 13:55:06 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:55:06 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Successfully detached device vdb from instance b8a790d0-e5d0-4b78-8de4-36a58290b4ee from the persistent domain config.
Aug 14 13:55:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b8a790d0-e5d0-4b78-8de4-36a58290b4ee from the live domain config. {{(pid=73484) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 13:55:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:55:06 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:55:06 user nova-compute[73484]:   <source dev="/dev/sde"/>
Aug 14 13:55:06 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:55:06 user nova-compute[73484]:   <serial>9cfdd7f0-b366-4984-99f3-0b55514e2385</serial>
Aug 14 13:55:06 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 13:55:06 user nova-compute[73484]: </disk>
Aug 14 13:55:06 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Received event <DeviceRemovedEvent: 1692021307.0807364, b8a790d0-e5d0-4b78-8de4-36a58290b4ee => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73484) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b8a790d0-e5d0-4b78-8de4-36a58290b4ee {{(pid=73484) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 13:55:07 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Successfully detached device vdb from instance b8a790d0-e5d0-4b78-8de4-36a58290b4ee from the live domain config.
Aug 14 13:55:07 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qlpzHTVK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:55:07 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:55:07 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[873a9afb-8c31-413c-9c5b-4f70ee7a5d23]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0d8c6e-6b2e-4fe5-9298-ee05313a7d86]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:55:07 user nova-compute[73484]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:55:07 user nova-compute[73484]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)
Aug 14 13:55:07 user nova-compute[73484]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385 (non-flash)
Aug 14 13:55:07 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:55:07 user nova-compute[73484]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:55:07 user nova-compute[73484]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)
Aug 14 13:55:07 user nova-compute[73484]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385 (non-flash)
Aug 14 13:55:07 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4585b2a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385'): ({'sde'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Removing single pathed devices sde {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d93834-ffca-4c84-9d89-c98b72f1f05a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8f4bcf-dedc-4a0e-aa4e-61b45a3a80bf]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Flushing IO for device /dev/sde {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[01aa5b52-51ac-4120-a10b-89815695c96a]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[468f6000-9d82-4e0a-82da-82aee4e2ffff]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] SCSI volumes sde have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f81e71-b96f-4ef7-b210-5ca03e2142e0]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385 -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[550e3b94-b617-48b8-b6c2-09ff90516cbd]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385, portal: 172.16.0.220,3260]
Aug 14 13:55:07 user nova-compute[73484]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385, portal: 172.16.0.220,3260] successful.
Aug 14 13:55:07 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385 -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cfdd7f0-b366-4984-99f3-0b55514e2385 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[990710e2-569a-4533-84b2-5add6470e92a]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] <== disconnect_volume: return (314ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:55:07 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:55:08 user nova-compute[73484]: DEBUG nova.objects.instance [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lazy-loading 'flavor' on Instance uuid b8a790d0-e5d0-4b78-8de4-36a58290b4ee {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:55:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1d9ad259-6476-4dfd-9659-deaaa0fda5f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.625s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:55:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "72f007af-a1e7-4a80-954c-ed12aaf129fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "72f007af-a1e7-4a80-954c-ed12aaf129fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "72f007af-a1e7-4a80-954c-ed12aaf129fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "72f007af-a1e7-4a80-954c-ed12aaf129fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "72f007af-a1e7-4a80-954c-ed12aaf129fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:55:13 user nova-compute[73484]: INFO nova.compute.manager [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Terminating instance
Aug 14 13:55:13 user nova-compute[73484]: DEBUG nova.compute.manager [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG nova.compute.manager [req-7b2d4bb1-1613-4960-821b-b98ead4227d8 req-b074048d-fc98-497b-9d4f-9e1b16f7cbbc service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Received event network-vif-unplugged-19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-7b2d4bb1-1613-4960-821b-b98ead4227d8 req-b074048d-fc98-497b-9d4f-9e1b16f7cbbc service nova] Acquiring lock "72f007af-a1e7-4a80-954c-ed12aaf129fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-7b2d4bb1-1613-4960-821b-b98ead4227d8 req-b074048d-fc98-497b-9d4f-9e1b16f7cbbc service nova] Lock "72f007af-a1e7-4a80-954c-ed12aaf129fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-7b2d4bb1-1613-4960-821b-b98ead4227d8 req-b074048d-fc98-497b-9d4f-9e1b16f7cbbc service nova] Lock "72f007af-a1e7-4a80-954c-ed12aaf129fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG nova.compute.manager [req-7b2d4bb1-1613-4960-821b-b98ead4227d8 req-b074048d-fc98-497b-9d4f-9e1b16f7cbbc service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] No waiting events found dispatching network-vif-unplugged-19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG nova.compute.manager [req-7b2d4bb1-1613-4960-821b-b98ead4227d8 req-b074048d-fc98-497b-9d4f-9e1b16f7cbbc service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Received event network-vif-unplugged-19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:13 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Instance destroyed successfully.
Aug 14 13:55:13 user nova-compute[73484]: DEBUG nova.objects.instance [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lazy-loading 'resources' on Instance uuid 72f007af-a1e7-4a80-954c-ed12aaf129fd {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1769794670',display_name='tempest-ServerActionsTestOtherA-server-1769794670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1769794670',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+U0YM0H+9FtSMWW9gC7hlmEYl+cufNxOVmMIw8gQGmCCRzcGdOpZ2rClVjHI02XniG6rU6cneNsbww6ySr+rPSIW5KD8/op2pTaoCA25ZKyUod+b+1u3EAmeZWFbiG0g==',key_name='tempest-keypair-1679559247',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:50:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff9e3bd3df8a408e96e9054775c3cb83',ramdisk_id='',reservation_id='r-50052euq',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2033458528',owner_user_name='tempest-ServerActionsTestOtherA-2033458528-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:52:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b22dfe5647e149a5b3a19d843f0efd66',uuid=72f007af-a1e7-4a80-954c-ed12aaf129fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "address": "fa:16:3e:22:ea:2c", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f75cf0-c8", "ovs_interfaceid": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Converting VIF {"id": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "address": "fa:16:3e:22:ea:2c", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19f75cf0-c8", "ovs_interfaceid": "19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:ea:2c,bridge_name='br-int',has_traffic_filtering=True,id=19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19f75cf0-c8') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG os_vif [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:ea:2c,bridge_name='br-int',has_traffic_filtering=True,id=19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19f75cf0-c8') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19f75cf0-c8, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:13 user nova-compute[73484]: INFO os_vif [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:ea:2c,bridge_name='br-int',has_traffic_filtering=True,id=19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19f75cf0-c8')
Aug 14 13:55:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EqNPGcOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:55:13 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:55:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3988c79-05a3-477e-aac5-4e08e3791b68]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec58165-55ad-4e08-b92f-6d1b151219f7]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:55:13 user nova-compute[73484]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:55:13 user nova-compute[73484]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)
Aug 14 13:55:13 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:55:13 user nova-compute[73484]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 (non-flash)
Aug 14 13:55:13 user nova-compute[73484]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)
Aug 14 13:55:13 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4583fcca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812'): ({'sdd'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Removing single pathed devices sdd {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa544aa-5a01-4143-aaee-afd00fecb1cc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b1d409-f012-4cac-908d-96cdb0a3f6ae]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Flushing IO for device /dev/sdd {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a5743a-918e-4656-a3c0-1299b16c2f3e]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:55:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:14 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2951c5d4-579c-47b7-8c54-25f5010c74be]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:14 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:55:14 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] SCSI volumes sdd have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:55:14 user nova-compute[73484]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO37378e00-9ff5f0b186b3f104', '/dev/disk/by-id/scsi-23966663566306231', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_37378e00') {{(pid=84315) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 13:55:14 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[266cd17f-2df4-44dd-86b7-61937953749b]: (4, None) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:55:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:14 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3da849d-bd7d-4475-92f6-1eedf163ed01]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:55:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:14 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3490a4ea-3179-4dd6-8e82-8f9cae7f9b4a]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812, portal: 172.16.0.220,3260]
Aug 14 13:55:14 user nova-compute[73484]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812, portal: 172.16.0.220,3260] successful.
Aug 14 13:55:14 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:55:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc7990bf-85e5-4d3a-9073-716c7875c812 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:14 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cb2912-b5ab-40f8-a49b-6765dd535a15]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:55:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:55:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] <== disconnect_volume: return (289ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:55:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:55:14 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Deleting instance files /opt/stack/data/nova/instances/72f007af-a1e7-4a80-954c-ed12aaf129fd_del
Aug 14 13:55:14 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Deletion of /opt/stack/data/nova/instances/72f007af-a1e7-4a80-954c-ed12aaf129fd_del complete
Aug 14 13:55:14 user nova-compute[73484]: INFO nova.compute.manager [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 14 13:55:14 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:55:14 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:55:14 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:55:15 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:55:15 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Took 0.86 seconds to deallocate network for instance.
Aug 14 13:55:15 user nova-compute[73484]: DEBUG nova.compute.manager [req-cd8f8e34-aaf0-4510-9623-e650a6c1d369 req-d735670a-6bd7-4d0e-864e-185be5c025a8 service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Received event network-vif-deleted-19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:55:15 user nova-compute[73484]: INFO nova.compute.manager [req-cd8f8e34-aaf0-4510-9623-e650a6c1d369 req-d735670a-6bd7-4d0e-864e-185be5c025a8 service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Neutron deleted interface 19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9; detaching it from the instance and deleting it from the info cache
Aug 14 13:55:15 user nova-compute[73484]: DEBUG nova.network.neutron [req-cd8f8e34-aaf0-4510-9623-e650a6c1d369 req-d735670a-6bd7-4d0e-864e-185be5c025a8 service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:55:15 user nova-compute[73484]: DEBUG nova.compute.manager [req-cd8f8e34-aaf0-4510-9623-e650a6c1d369 req-d735670a-6bd7-4d0e-864e-185be5c025a8 service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Detach interface failed, port_id=19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9, reason: Instance 72f007af-a1e7-4a80-954c-ed12aaf129fd could not be found. {{(pid=73484) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 13:55:15 user nova-compute[73484]: DEBUG nova.compute.manager [req-3c50da87-adf5-4d93-b58b-492445a39ca4 req-0794e2a3-de40-49cb-9e87-8ad747324517 service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Received event network-vif-plugged-19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:55:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3c50da87-adf5-4d93-b58b-492445a39ca4 req-0794e2a3-de40-49cb-9e87-8ad747324517 service nova] Acquiring lock "72f007af-a1e7-4a80-954c-ed12aaf129fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:55:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3c50da87-adf5-4d93-b58b-492445a39ca4 req-0794e2a3-de40-49cb-9e87-8ad747324517 service nova] Lock "72f007af-a1e7-4a80-954c-ed12aaf129fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:55:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3c50da87-adf5-4d93-b58b-492445a39ca4 req-0794e2a3-de40-49cb-9e87-8ad747324517 service nova] Lock "72f007af-a1e7-4a80-954c-ed12aaf129fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:55:15 user nova-compute[73484]: DEBUG nova.compute.manager [req-3c50da87-adf5-4d93-b58b-492445a39ca4 req-0794e2a3-de40-49cb-9e87-8ad747324517 service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] No waiting events found dispatching network-vif-plugged-19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:55:15 user nova-compute[73484]: WARNING nova.compute.manager [req-3c50da87-adf5-4d93-b58b-492445a39ca4 req-0794e2a3-de40-49cb-9e87-8ad747324517 service nova] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Received unexpected event network-vif-plugged-19f75cf0-c8b6-49fe-83ad-d2fdadc6adf9 for instance with vm_state active and task_state deleting.
Aug 14 13:55:15 user nova-compute[73484]: INFO nova.compute.manager [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Took 0.74 seconds to detach 1 volumes for instance.
Aug 14 13:55:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Deleting volume: cc7990bf-85e5-4d3a-9073-716c7875c812 {{(pid=73484) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 13:55:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:55:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:55:16 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:55:16 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:55:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:55:16 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Deleted allocations for instance 72f007af-a1e7-4a80-954c-ed12aaf129fd
Aug 14 13:55:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-eeeb0c31-cc20-4488-bbb4-258a854532ca tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "72f007af-a1e7-4a80-954c-ed12aaf129fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.327s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:55:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:55:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:28 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692021313.8024364, 72f007af-a1e7-4a80-954c-ed12aaf129fd => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:55:28 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] VM Stopped (Lifecycle Event)
Aug 14 13:55:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-317e6efa-3ace-42e7-8951-1ad93ac46e5a None None] [instance: 72f007af-a1e7-4a80-954c-ed12aaf129fd] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:55:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:55:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:55:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:55:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:55:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:55:36 user nova-compute[73484]: INFO nova.compute.manager [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Terminating instance
Aug 14 13:55:36 user nova-compute[73484]: DEBUG nova.compute.manager [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:55:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:36 user nova-compute[73484]: DEBUG nova.compute.manager [req-0ba053d3-2aed-4e82-ae2a-09558581d208 req-f9036bed-974d-4009-a2aa-d8e5cb4b762b service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Received event network-vif-unplugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:55:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0ba053d3-2aed-4e82-ae2a-09558581d208 req-f9036bed-974d-4009-a2aa-d8e5cb4b762b service nova] Acquiring lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:55:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0ba053d3-2aed-4e82-ae2a-09558581d208 req-f9036bed-974d-4009-a2aa-d8e5cb4b762b service nova] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:55:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0ba053d3-2aed-4e82-ae2a-09558581d208 req-f9036bed-974d-4009-a2aa-d8e5cb4b762b service nova] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:55:36 user nova-compute[73484]: DEBUG nova.compute.manager [req-0ba053d3-2aed-4e82-ae2a-09558581d208 req-f9036bed-974d-4009-a2aa-d8e5cb4b762b service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] No waiting events found dispatching network-vif-unplugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:55:36 user nova-compute[73484]: DEBUG nova.compute.manager [req-0ba053d3-2aed-4e82-ae2a-09558581d208 req-f9036bed-974d-4009-a2aa-d8e5cb4b762b service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Received event network-vif-unplugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:55:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:36 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Instance destroyed successfully.
Aug 14 13:55:36 user nova-compute[73484]: DEBUG nova.objects.instance [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lazy-loading 'resources' on Instance uuid a9d4ec42-3db9-439b-87a7-02bcaab514a4 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:55:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:39:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-276871641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-276871641',id=12,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:41:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c7f2c51c0f84bf1aedcf493a9ff860f',ramdisk_id='',reservation_id='r-zx07pb5m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-830908511',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:43:35Z,user_data=None,user_id='5a0f55ad018d4c0ca587d8bdd40df4c8',uuid=a9d4ec42-3db9-439b-87a7-02bcaab514a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "address": "fa:16:3e:a8:f5:8b", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa109f4ac-a7", "ovs_interfaceid": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:55:36 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Converting VIF {"id": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "address": "fa:16:3e:a8:f5:8b", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa109f4ac-a7", "ovs_interfaceid": "a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:55:36 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:f5:8b,bridge_name='br-int',has_traffic_filtering=True,id=a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26,network=Network(4ec437fc-4371-48d6-8026-b64423fbc0ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa109f4ac-a7') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:55:36 user nova-compute[73484]: DEBUG os_vif [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:f5:8b,bridge_name='br-int',has_traffic_filtering=True,id=a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26,network=Network(4ec437fc-4371-48d6-8026-b64423fbc0ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa109f4ac-a7') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:55:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa109f4ac-a7, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:55:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:55:36 user nova-compute[73484]: INFO os_vif [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:f5:8b,bridge_name='br-int',has_traffic_filtering=True,id=a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26,network=Network(4ec437fc-4371-48d6-8026-b64423fbc0ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa109f4ac-a7')
Aug 14 13:55:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:55:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzLZCdIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:55:36 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:55:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:55:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:55:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:55:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2ec1e5-c6f1-4f6b-b8bc-480d02ac8a0c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c0ee5e-e121-4a85-816d-c0f2b4c3aa8b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:55:37 user nova-compute[73484]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)
Aug 14 13:55:37 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d (non-flash)
Aug 14 13:55:37 user nova-compute[73484]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)
Aug 14 13:55:37 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4952c30a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d'): ({'sdb'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Removing single pathed devices sdb {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[784b5353-3a9e-410e-b8f2-22b3d7f14381]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[207d82fa-bd15-4cdc-af14-ecddf5338187]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Flushing IO for device /dev/sdb {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8911e41-5b0e-4002-8fbd-b18b6af5e14c]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4403192-d58f-4416-9f69-29c369e309fc]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] SCSI volumes sdb have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a26ab17-14fc-46bc-ab35-c82eead81d79]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e53cdf-529d-48fe-a32f-6b8ad3b294ca]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d, portal: 172.16.0.220,3260]
Aug 14 13:55:37 user nova-compute[73484]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d, portal: 172.16.0.220,3260] successful.
Aug 14 13:55:37 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac0dffc-1c43-44e8-adff-0463af08c68d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4f9e75-0a92-41cf-bf8d-7f0aa2203c60]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] <== disconnect_volume: return (292ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:55:37 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Deleting instance files /opt/stack/data/nova/instances/a9d4ec42-3db9-439b-87a7-02bcaab514a4_del
Aug 14 13:55:37 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Deletion of /opt/stack/data/nova/instances/a9d4ec42-3db9-439b-87a7-02bcaab514a4_del complete
Aug 14 13:55:37 user nova-compute[73484]: INFO nova.compute.manager [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 14 13:55:37 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:55:37 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:55:38 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:55:38 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Took 0.77 seconds to deallocate network for instance.
Aug 14 13:55:38 user nova-compute[73484]: DEBUG nova.compute.manager [req-b45036e9-16fe-48a9-bf0f-bf28516e9067 req-630ba848-bdef-4b9a-89d5-c9b64ddf9f66 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Received event network-vif-plugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:55:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b45036e9-16fe-48a9-bf0f-bf28516e9067 req-630ba848-bdef-4b9a-89d5-c9b64ddf9f66 service nova] Acquiring lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:55:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b45036e9-16fe-48a9-bf0f-bf28516e9067 req-630ba848-bdef-4b9a-89d5-c9b64ddf9f66 service nova] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:55:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b45036e9-16fe-48a9-bf0f-bf28516e9067 req-630ba848-bdef-4b9a-89d5-c9b64ddf9f66 service nova] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:55:38 user nova-compute[73484]: DEBUG nova.compute.manager [req-b45036e9-16fe-48a9-bf0f-bf28516e9067 req-630ba848-bdef-4b9a-89d5-c9b64ddf9f66 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] No waiting events found dispatching network-vif-plugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:55:38 user nova-compute[73484]: WARNING nova.compute.manager [req-b45036e9-16fe-48a9-bf0f-bf28516e9067 req-630ba848-bdef-4b9a-89d5-c9b64ddf9f66 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Received unexpected event network-vif-plugged-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 for instance with vm_state active and task_state deleting.
Aug 14 13:55:38 user nova-compute[73484]: DEBUG nova.compute.manager [req-b45036e9-16fe-48a9-bf0f-bf28516e9067 req-630ba848-bdef-4b9a-89d5-c9b64ddf9f66 service nova] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Received event network-vif-deleted-a109f4ac-a7eb-4a45-9cb2-50bb1aa3cd26 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:55:38 user nova-compute[73484]: INFO nova.compute.manager [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Took 0.74 seconds to detach 1 volumes for instance.
Aug 14 13:55:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:55:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:55:39 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:55:39 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:55:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.402s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:55:39 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Deleted allocations for instance a9d4ec42-3db9-439b-87a7-02bcaab514a4
Aug 14 13:55:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-76d36f55-e95d-4a17-9ed8-c253748a9c24 tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "a9d4ec42-3db9-439b-87a7-02bcaab514a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.236s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:55:41 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:42 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:44 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:55:44 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 13:55:44 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Didn't find any instances for network info cache update. {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 13:55:44 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:55:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:47 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:55:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 13:55:49 user nova-compute[73484]: DEBUG nova.compute.manager [req-b09821be-5dca-473d-b9ee-e93bdc302af0 req-0c25d306-4485-4934-9f19-b60d58418fc4 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Received event network-changed-0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:55:49 user nova-compute[73484]: DEBUG nova.compute.manager [req-b09821be-5dca-473d-b9ee-e93bdc302af0 req-0c25d306-4485-4934-9f19-b60d58418fc4 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Refreshing instance network info cache due to event network-changed-0259d05a-9595-41f7-839d-28df692755fb. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:55:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b09821be-5dca-473d-b9ee-e93bdc302af0 req-0c25d306-4485-4934-9f19-b60d58418fc4 service nova] Acquiring lock "refresh_cache-14999671-dcc7-43fa-85ec-21cbcf12d21e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:55:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b09821be-5dca-473d-b9ee-e93bdc302af0 req-0c25d306-4485-4934-9f19-b60d58418fc4 service nova] Acquired lock "refresh_cache-14999671-dcc7-43fa-85ec-21cbcf12d21e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:55:49 user nova-compute[73484]: DEBUG nova.network.neutron [req-b09821be-5dca-473d-b9ee-e93bdc302af0 req-0c25d306-4485-4934-9f19-b60d58418fc4 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Refreshing network info cache for port 0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:55:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "14999671-dcc7-43fa-85ec-21cbcf12d21e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:55:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:55:49 user nova-compute[73484]: DEBUG nova.objects.instance [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'flavor' on Instance uuid 14999671-dcc7-43fa-85ec-21cbcf12d21e {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:55:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:55:49 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:55:49 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:55:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "14999671-dcc7-43fa-85ec-21cbcf12d21e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:55:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:55:49 user nova-compute[73484]: INFO nova.compute.manager [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Attaching volume 241c2b81-26d1-4419-9710-d0add57160e5 to /dev/vdb
Aug 14 13:55:49 user nova-compute[73484]: DEBUG nova.network.neutron [req-b09821be-5dca-473d-b9ee-e93bdc302af0 req-0c25d306-4485-4934-9f19-b60d58418fc4 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Updated VIF entry in instance network info cache for port 0259d05a-9595-41f7-839d-28df692755fb. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:55:49 user nova-compute[73484]: DEBUG nova.network.neutron [req-b09821be-5dca-473d-b9ee-e93bdc302af0 req-0c25d306-4485-4934-9f19-b60d58418fc4 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Updating instance_info_cache with network_info: [{"id": "0259d05a-9595-41f7-839d-28df692755fb", "address": "fa:16:3e:d5:7f:13", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0259d05a-95", "ovs_interfaceid": "0259d05a-9595-41f7-839d-28df692755fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:55:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b09821be-5dca-473d-b9ee-e93bdc302af0 req-0c25d306-4485-4934-9f19-b60d58418fc4 service nova] Releasing lock "refresh_cache-14999671-dcc7-43fa-85ec-21cbcf12d21e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:55:49 user nova-compute[73484]: DEBUG os_brick.utils [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:55:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:49 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:49 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20b5385-b55a-421b-b468-f3dc75d29d0d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c23b7d2-ac47-43a9-8bac-d9e8bfa9b3a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4c88be-c34e-4e3d-a4a1-1d451bd9a75b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ceedbc-ec47-4b98-8427-d26b0eccb9c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:55:50 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:55:50 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[748ff3d6-295e-4d57-8bab-231d9a5ea18f]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG os_brick.utils [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Updating existing volume attachment record: 7a4d06c1-4c9e-4daf-98c4-e525a33777d6 {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG nova.compute.manager [req-1b092ff8-4646-4967-84f7-ce106fa74ea4 req-e21004e1-7682-4636-b64f-83ca16476bf8 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Received event network-changed-ef1b13c3-d3e6-492e-8082-b5939545f189 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG nova.compute.manager [req-1b092ff8-4646-4967-84f7-ce106fa74ea4 req-e21004e1-7682-4636-b64f-83ca16476bf8 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Refreshing instance network info cache due to event network-changed-ef1b13c3-d3e6-492e-8082-b5939545f189. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1b092ff8-4646-4967-84f7-ce106fa74ea4 req-e21004e1-7682-4636-b64f-83ca16476bf8 service nova] Acquiring lock "refresh_cache-a54902a5-df8a-473f-9cf1-a112528c3549" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1b092ff8-4646-4967-84f7-ce106fa74ea4 req-e21004e1-7682-4636-b64f-83ca16476bf8 service nova] Acquired lock "refresh_cache-a54902a5-df8a-473f-9cf1-a112528c3549" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG nova.network.neutron [req-1b092ff8-4646-4967-84f7-ce106fa74ea4 req-e21004e1-7682-4636-b64f-83ca16476bf8 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Refreshing network info cache for port ef1b13c3-d3e6-492e-8082-b5939545f189 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Acquiring lock "a54902a5-df8a-473f-9cf1-a112528c3549" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "a54902a5-df8a-473f-9cf1-a112528c3549" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Acquiring lock "a54902a5-df8a-473f-9cf1-a112528c3549-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "a54902a5-df8a-473f-9cf1-a112528c3549-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "a54902a5-df8a-473f-9cf1-a112528c3549-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:55:50 user nova-compute[73484]: INFO nova.compute.manager [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Terminating instance
Aug 14 13:55:50 user nova-compute[73484]: DEBUG nova.compute.manager [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG nova.compute.manager [req-7e81efd2-b40e-4cce-ae3c-55493658d99f req-3a07a9a7-19ab-4f63-a4f7-c57464370ebd service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Received event network-vif-unplugged-ef1b13c3-d3e6-492e-8082-b5939545f189 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-7e81efd2-b40e-4cce-ae3c-55493658d99f req-3a07a9a7-19ab-4f63-a4f7-c57464370ebd service nova] Acquiring lock "a54902a5-df8a-473f-9cf1-a112528c3549-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:55:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-7e81efd2-b40e-4cce-ae3c-55493658d99f req-3a07a9a7-19ab-4f63-a4f7-c57464370ebd service nova] Lock "a54902a5-df8a-473f-9cf1-a112528c3549-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-7e81efd2-b40e-4cce-ae3c-55493658d99f req-3a07a9a7-19ab-4f63-a4f7-c57464370ebd service nova] Lock "a54902a5-df8a-473f-9cf1-a112528c3549-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG nova.compute.manager [req-7e81efd2-b40e-4cce-ae3c-55493658d99f req-3a07a9a7-19ab-4f63-a4f7-c57464370ebd service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] No waiting events found dispatching network-vif-unplugged-ef1b13c3-d3e6-492e-8082-b5939545f189 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG nova.compute.manager [req-7e81efd2-b40e-4cce-ae3c-55493658d99f req-3a07a9a7-19ab-4f63-a4f7-c57464370ebd service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Received event network-vif-unplugged-ef1b13c3-d3e6-492e-8082-b5939545f189 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:55:51 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Instance destroyed successfully.
Aug 14 13:55:51 user nova-compute[73484]: DEBUG nova.objects.instance [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lazy-loading 'resources' on Instance uuid a54902a5-df8a-473f-9cf1-a112528c3549 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG nova.network.neutron [req-1b092ff8-4646-4967-84f7-ce106fa74ea4 req-e21004e1-7682-4636-b64f-83ca16476bf8 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Updated VIF entry in instance network info cache for port ef1b13c3-d3e6-492e-8082-b5939545f189. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG nova.network.neutron [req-1b092ff8-4646-4967-84f7-ce106fa74ea4 req-e21004e1-7682-4636-b64f-83ca16476bf8 service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Updating instance_info_cache with network_info: [{"id": "ef1b13c3-d3e6-492e-8082-b5939545f189", "address": "fa:16:3e:25:ba:8c", "network": {"id": "83e56acf-b902-47d4-8e67-89dd64cb110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773957043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844799698ad34e19ba511a302ffa57a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1b13c3-d3", "ovs_interfaceid": "ef1b13c3-d3e6-492e-8082-b5939545f189", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T13:50:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1804131842',display_name='tempest-TestShelveInstance-server-1804131842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1804131842',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxsFZ8NKDri+73Tn1zh9Wr6BQVIfh4MxDYhjkRccl1yD5yV+qy8XZKjgzVijNxBrMINGQYKNmEBr2Jszg8sPGJk+mssBnBusEo19PhQ2+8ia4TUjqmwOa2btGBPkDkkNg==',key_name='tempest-TestShelveInstance-1649769704',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:54:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='844799698ad34e19ba511a302ffa57a4',ramdisk_id='',reservation_id='r-romjeqoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1441042020',owner_user_name='tempest-TestShelveInstance-1441042020-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:54:16Z,user_data=None,user_id='c8d4d6031b59481d93c22075f19559b6',uuid=a54902a5-df8a-473f-9cf1-a112528c3549,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef1b13c3-d3e6-492e-8082-b5939545f189", "address": "fa:16:3e:25:ba:8c", "network": {"id": "83e56acf-b902-47d4-8e67-89dd64cb110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773957043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844799698ad34e19ba511a302ffa57a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1b13c3-d3", "ovs_interfaceid": "ef1b13c3-d3e6-492e-8082-b5939545f189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Converting VIF {"id": "ef1b13c3-d3e6-492e-8082-b5939545f189", "address": "fa:16:3e:25:ba:8c", "network": {"id": "83e56acf-b902-47d4-8e67-89dd64cb110e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1773957043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "844799698ad34e19ba511a302ffa57a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef1b13c3-d3", "ovs_interfaceid": "ef1b13c3-d3e6-492e-8082-b5939545f189", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:ba:8c,bridge_name='br-int',has_traffic_filtering=True,id=ef1b13c3-d3e6-492e-8082-b5939545f189,network=Network(83e56acf-b902-47d4-8e67-89dd64cb110e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1b13c3-d3') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG os_vif [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:ba:8c,bridge_name='br-int',has_traffic_filtering=True,id=ef1b13c3-d3e6-492e-8082-b5939545f189,network=Network(83e56acf-b902-47d4-8e67-89dd64cb110e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1b13c3-d3') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef1b13c3-d3, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:51 user nova-compute[73484]: INFO os_vif [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:ba:8c,bridge_name='br-int',has_traffic_filtering=True,id=ef1b13c3-d3e6-492e-8082-b5939545f189,network=Network(83e56acf-b902-47d4-8e67-89dd64cb110e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef1b13c3-d3')
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1b092ff8-4646-4967-84f7-ce106fa74ea4 req-e21004e1-7682-4636-b64f-83ca16476bf8 service nova] Releasing lock "refresh_cache-a54902a5-df8a-473f-9cf1-a112528c3549" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VTMsgrjJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:55:51 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:55:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[932a570c-6e03-4e4b-8a98-7430974576a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[468c23d5-6566-488f-91a1-05109f2e8762]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)
Aug 14 13:55:51 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 (non-flash)
Aug 14 13:55:51 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc492aefac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475'): ({'sdc'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Removing single pathed devices sdc {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff89ddc2-7ae5-462d-bee1-8ecba2354fe3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccf5f4d-d06b-440a-8430-973ca0d31971]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Flushing IO for device /dev/sdc {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4072ff77-6a78-4bff-9888-a5a9799d6b93]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6455f251-e398-4980-a677-44ff9c075c6c]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f88ef58-bbc0-416e-9d3a-8aa5990eca6f]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6938429-6ca7-499b-a081-5b8683240071]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475, portal: 172.16.0.220,3260]
Aug 14 13:55:51 user nova-compute[73484]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475, portal: 172.16.0.220,3260] successful.
Aug 14 13:55:51 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e55bf6f-36bb-45c9-84fe-491435460475 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d93ffa-6859-4703-88d5-a81c5c066818]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] <== disconnect_volume: return (343ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:55:51 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Deleting instance files /opt/stack/data/nova/instances/a54902a5-df8a-473f-9cf1-a112528c3549_del
Aug 14 13:55:51 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Deletion of /opt/stack/data/nova/instances/a54902a5-df8a-473f-9cf1-a112528c3549_del complete
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:51 user nova-compute[73484]: INFO nova.compute.manager [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Took 1.27 seconds to destroy the instance on the hypervisor.
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:51 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692021336.9235547, a9d4ec42-3db9-439b-87a7-02bcaab514a4 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:55:51 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] VM Stopped (Lifecycle Event)
Aug 14 13:55:51 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a6be66ac-2e84-4d64-bbf9-70e6bb4107b3 None None] [instance: a9d4ec42-3db9-439b-87a7-02bcaab514a4] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:55:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:52 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:55:52 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Took 0.69 seconds to deallocate network for instance.
Aug 14 13:55:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:53 user nova-compute[73484]: DEBUG nova.compute.manager [req-5af2c2b7-9d66-4ca7-b902-1626dd1b7254 req-cb5cffc6-3506-4fad-a1cd-2018fb6c8abf service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Received event network-vif-plugged-ef1b13c3-d3e6-492e-8082-b5939545f189 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:55:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5af2c2b7-9d66-4ca7-b902-1626dd1b7254 req-cb5cffc6-3506-4fad-a1cd-2018fb6c8abf service nova] Acquiring lock "a54902a5-df8a-473f-9cf1-a112528c3549-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:55:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5af2c2b7-9d66-4ca7-b902-1626dd1b7254 req-cb5cffc6-3506-4fad-a1cd-2018fb6c8abf service nova] Lock "a54902a5-df8a-473f-9cf1-a112528c3549-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:55:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5af2c2b7-9d66-4ca7-b902-1626dd1b7254 req-cb5cffc6-3506-4fad-a1cd-2018fb6c8abf service nova] Lock "a54902a5-df8a-473f-9cf1-a112528c3549-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:55:53 user nova-compute[73484]: DEBUG nova.compute.manager [req-5af2c2b7-9d66-4ca7-b902-1626dd1b7254 req-cb5cffc6-3506-4fad-a1cd-2018fb6c8abf service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] No waiting events found dispatching network-vif-plugged-ef1b13c3-d3e6-492e-8082-b5939545f189 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:55:53 user nova-compute[73484]: WARNING nova.compute.manager [req-5af2c2b7-9d66-4ca7-b902-1626dd1b7254 req-cb5cffc6-3506-4fad-a1cd-2018fb6c8abf service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Received unexpected event network-vif-plugged-ef1b13c3-d3e6-492e-8082-b5939545f189 for instance with vm_state active and task_state deleting.
Aug 14 13:55:53 user nova-compute[73484]: DEBUG nova.compute.manager [req-5af2c2b7-9d66-4ca7-b902-1626dd1b7254 req-cb5cffc6-3506-4fad-a1cd-2018fb6c8abf service nova] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Received event network-vif-deleted-ef1b13c3-d3e6-492e-8082-b5939545f189 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:55:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:53 user nova-compute[73484]: INFO nova.compute.manager [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Took 0.78 seconds to detach 1 volumes for instance.
Aug 14 13:55:53 user nova-compute[73484]: DEBUG nova.compute.manager [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Deleting volume: 5e55bf6f-36bb-45c9-84fe-491435460475 {{(pid=73484) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 13:55:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:55:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:55:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:53 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:55:53 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:55:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:55:53 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Deleted allocations for instance a54902a5-df8a-473f-9cf1-a112528c3549
Aug 14 13:55:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:53 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Error from libvirt while getting description of instance-00000020: [Error Code 42] Domain not found: no domain with matching uuid 'a54902a5-df8a-473f-9cf1-a112528c3549' (instance-00000020): libvirt.libvirtError: Domain not found: no domain with matching uuid 'a54902a5-df8a-473f-9cf1-a112528c3549' (instance-00000020)
Aug 14 13:55:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42273739-c086-4cc7-a6c8-10710b16f794/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b7f64363-a609-4003-89c6-cb1012d696db tempest-TestShelveInstance-1441042020 tempest-TestShelveInstance-1441042020-project-member] Lock "a54902a5-df8a-473f-9cf1-a112528c3549" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.561s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:55:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42273739-c086-4cc7-a6c8-10710b16f794/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42273739-c086-4cc7-a6c8-10710b16f794/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42273739-c086-4cc7-a6c8-10710b16f794/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:55 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:55:55 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:55:55 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=7827MB free_disk=25.23377227783203GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 13:55:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:55:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:55:55 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance f4f7788c-fcca-47c1-b5b8-72892253982d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:55:55 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 07bac569-8b2c-4555-b4d5-a74f7384630b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:55:55 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 782c6142-757a-49ae-9292-787a7f1e8a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:55:55 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 03255d24-b6fd-459c-8ac6-f9c4063b54b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:55:55 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance b8a790d0-e5d0-4b78-8de4-36a58290b4ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:55:55 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 14999671-dcc7-43fa-85ec-21cbcf12d21e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:55:55 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 42273739-c086-4cc7-a6c8-10710b16f794 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:55:55 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 13:55:55 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 13:55:55 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:55:55 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:55:55 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 13:55:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.456s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:55:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:58 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:55:58 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:55:58 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QflVkRMh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:55:59 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:55:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:55:59 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:55:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:55:59 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ca6b5a-cf79-407a-8d66-663af04ce72e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:55:59 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9e624c-a224-4ffe-969c-ac21cea6e0bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5] added
Aug 14 13:55:59 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0dba86c-dd79-4934-8878-7ed8b0a05677]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7ac8ee-4136-49b7-95d5-e317b9962a50]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QflVkRMh {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QflVkRMh" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91a166a-1223-43a1-9781-f363484fe1c9]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QflVkRMh'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.078s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f01dc1-ac9e-4674-a394-69a16886cc3a]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[00733fd0-a5a4-426e-a06f-740c8d132011]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 13:55:59 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 13:55:59 user nova-compute[73484]:  {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:55:59 user nova-compute[73484]: WARNING os_brick.initiator.connectors.iscsi [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 13:55:59 user nova-compute[73484]: 
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[42807ef8-2422-4b0b-be9a-c92b06ff3520]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5, portal: 172.16.0.220,3260]
Aug 14 13:55:59 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5, portal: 172.16.0.220,3260] successful.
Aug 14 13:55:59 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f8234e-86ed-471d-b899-c60db8dbc390]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[968b2a7c-32d8-4dc1-b64c-f0c335af6137]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)
Aug 14 13:55:59 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)
Aug 14 13:55:59 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd3872f-504f-4258-89b5-2cddc34c72bb]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:55:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QflVkRMh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:56:00 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:56:00 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '23236326566663264', 'path': '/dev/sdb'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:56:00 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236326566663264', 'path': '/dev/sdb'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:56:00 user nova-compute[73484]: DEBUG nova.objects.instance [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'flavor' on Instance uuid 14999671-dcc7-43fa-85ec-21cbcf12d21e {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:56:00 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 13:56:00 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:56:00 user nova-compute[73484]:   <source dev="/dev/sdb"/>
Aug 14 13:56:00 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:56:00 user nova-compute[73484]:   <serial>241c2b81-26d1-4419-9710-d0add57160e5</serial>
Aug 14 13:56:00 user nova-compute[73484]: </disk>
Aug 14 13:56:00 user nova-compute[73484]:  {{(pid=73484) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 13:56:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:56:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:56:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] No VIF found with MAC fa:16:3e:d5:7f:13, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:56:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c29b0ea2-afb5-48ac-959e-d83a885f0ce3 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.458s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:02 user nova-compute[73484]: INFO nova.compute.manager [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Rescuing
Aug 14 13:56:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "refresh_cache-14999671-dcc7-43fa-85ec-21cbcf12d21e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:56:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquired lock "refresh_cache-14999671-dcc7-43fa-85ec-21cbcf12d21e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:56:02 user nova-compute[73484]: DEBUG nova.network.neutron [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:56:02 user nova-compute[73484]: DEBUG nova.network.neutron [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Updating instance_info_cache with network_info: [{"id": "0259d05a-9595-41f7-839d-28df692755fb", "address": "fa:16:3e:d5:7f:13", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0259d05a-95", "ovs_interfaceid": "0259d05a-9595-41f7-839d-28df692755fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:56:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Releasing lock "refresh_cache-14999671-dcc7-43fa-85ec-21cbcf12d21e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:56:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:03 user nova-compute[73484]: DEBUG nova.compute.manager [req-ca78bc53-023c-461b-85e6-c9a093ee865e req-2bb060f3-0fa7-4daa-96cf-d347ecb6e013 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Received event network-vif-unplugged-0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:56:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ca78bc53-023c-461b-85e6-c9a093ee865e req-2bb060f3-0fa7-4daa-96cf-d347ecb6e013 service nova] Acquiring lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ca78bc53-023c-461b-85e6-c9a093ee865e req-2bb060f3-0fa7-4daa-96cf-d347ecb6e013 service nova] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ca78bc53-023c-461b-85e6-c9a093ee865e req-2bb060f3-0fa7-4daa-96cf-d347ecb6e013 service nova] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:03 user nova-compute[73484]: DEBUG nova.compute.manager [req-ca78bc53-023c-461b-85e6-c9a093ee865e req-2bb060f3-0fa7-4daa-96cf-d347ecb6e013 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] No waiting events found dispatching network-vif-unplugged-0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:56:03 user nova-compute[73484]: WARNING nova.compute.manager [req-ca78bc53-023c-461b-85e6-c9a093ee865e req-2bb060f3-0fa7-4daa-96cf-d347ecb6e013 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Received unexpected event network-vif-unplugged-0259d05a-9595-41f7-839d-28df692755fb for instance with vm_state active and task_state rescuing.
Aug 14 13:56:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:03 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Instance destroyed successfully.
Aug 14 13:56:03 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Attempting rescue
Aug 14 13:56:03 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73484) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 13:56:03 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Instance directory exists: not creating {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 13:56:03 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Creating image(s)
Aug 14 13:56:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "/opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "/opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "/opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.016s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:03 user nova-compute[73484]: DEBUG nova.objects.instance [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'trusted_certs' on Instance uuid 14999671-dcc7-43fa-85ec-21cbcf12d21e {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:56:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.229s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk.rescue {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk.rescue" returned: 0 in 0.079s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.322s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG nova.objects.instance [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'migration_context' on Instance uuid 14999671-dcc7-43fa-85ec-21cbcf12d21e {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Start _get_guest_xml network_info=[{"id": "0259d05a-9595-41f7-839d-28df692755fb", "address": "fa:16:3e:d5:7f:13", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "vif_mac": "fa:16:3e:d5:7f:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0259d05a-95", "ovs_interfaceid": "0259d05a-9595-41f7-839d-28df692755fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '35547d66-318f-468f-9286-e10554f69bf8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG nova.objects.instance [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'resources' on Instance uuid 14999671-dcc7-43fa-85ec-21cbcf12d21e {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG nova.objects.instance [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'numa_topology' on Instance uuid 14999671-dcc7-43fa-85ec-21cbcf12d21e {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:56:04 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:56:04 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:56:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG nova.objects.instance [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'vcpu_model' on Instance uuid 14999671-dcc7-43fa-85ec-21cbcf12d21e {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:53:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1791866722',display_name='tempest-ServerRescueNegativeTestJSON-server-1791866722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1791866722',id=35,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3FYahLoEeUzNQJsn+wqCzTl530H2uPDPATXW4sHxE7PqRzLmegfqzUhGXPfxcf8H5RdoHzVzXWdXYqXzLUllkhrrm06OkmmRQEVmYHqQEwUs5b1Jjk2rMUzKxmZrvCqg==',key_name='tempest-keypair-476477973',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:54:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f4df46bcfb843b7ac6c17d106703950',ramdisk_id='',reservation_id='r-zkhhqpeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-496474583',owner_user_name='tempest-ServerRescueNegativeTestJSON-496474583-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:54:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45d86b9371024e3d95ece74ccb2c37d9',uuid=14999671-dcc7-43fa-85ec-21cbcf12d21e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0259d05a-9595-41f7-839d-28df692755fb", "address": "fa:16:3e:d5:7f:13", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "vif_mac": "fa:16:3e:d5:7f:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0259d05a-95", "ovs_interfaceid": "0259d05a-9595-41f7-839d-28df692755fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Converting VIF {"id": "0259d05a-9595-41f7-839d-28df692755fb", "address": "fa:16:3e:d5:7f:13", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "vif_mac": "fa:16:3e:d5:7f:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0259d05a-95", "ovs_interfaceid": "0259d05a-9595-41f7-839d-28df692755fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:7f:13,bridge_name='br-int',has_traffic_filtering=True,id=0259d05a-9595-41f7-839d-28df692755fb,network=Network(cad53782-5ecf-4140-b113-62e807bf87df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0259d05a-95') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG nova.objects.instance [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'pci_devices' on Instance uuid 14999671-dcc7-43fa-85ec-21cbcf12d21e {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:56:04 user nova-compute[73484]:   <uuid>14999671-dcc7-43fa-85ec-21cbcf12d21e</uuid>
Aug 14 13:56:04 user nova-compute[73484]:   <name>instance-00000023</name>
Aug 14 13:56:04 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:56:04 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:56:04 user nova-compute[73484]:   <metadata>
Aug 14 13:56:04 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:56:04 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:56:04 user nova-compute[73484]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1791866722</nova:name>
Aug 14 13:56:04 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:56:04</nova:creationTime>
Aug 14 13:56:04 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:56:04 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:56:04 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:56:04 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:56:04 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:56:04 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:56:04 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:56:04 user nova-compute[73484]:       <nova:owner>
Aug 14 13:56:04 user nova-compute[73484]:         <nova:user uuid="45d86b9371024e3d95ece74ccb2c37d9">tempest-ServerRescueNegativeTestJSON-496474583-project-member</nova:user>
Aug 14 13:56:04 user nova-compute[73484]:         <nova:project uuid="0f4df46bcfb843b7ac6c17d106703950">tempest-ServerRescueNegativeTestJSON-496474583</nova:project>
Aug 14 13:56:04 user nova-compute[73484]:       </nova:owner>
Aug 14 13:56:04 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:56:04 user nova-compute[73484]:       <nova:ports>
Aug 14 13:56:04 user nova-compute[73484]:         <nova:port uuid="0259d05a-9595-41f7-839d-28df692755fb">
Aug 14 13:56:04 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 13:56:04 user nova-compute[73484]:         </nova:port>
Aug 14 13:56:04 user nova-compute[73484]:       </nova:ports>
Aug 14 13:56:04 user nova-compute[73484]:     </nova:instance>
Aug 14 13:56:04 user nova-compute[73484]:   </metadata>
Aug 14 13:56:04 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:56:04 user nova-compute[73484]:     <system>
Aug 14 13:56:04 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:56:04 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:56:04 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:56:04 user nova-compute[73484]:       <entry name="serial">14999671-dcc7-43fa-85ec-21cbcf12d21e</entry>
Aug 14 13:56:04 user nova-compute[73484]:       <entry name="uuid">14999671-dcc7-43fa-85ec-21cbcf12d21e</entry>
Aug 14 13:56:04 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:56:04 user nova-compute[73484]:     </system>
Aug 14 13:56:04 user nova-compute[73484]:   </sysinfo>
Aug 14 13:56:04 user nova-compute[73484]:   <os>
Aug 14 13:56:04 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:56:04 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:56:04 user nova-compute[73484]:   </os>
Aug 14 13:56:04 user nova-compute[73484]:   <features>
Aug 14 13:56:04 user nova-compute[73484]:     <acpi/>
Aug 14 13:56:04 user nova-compute[73484]:     <apic/>
Aug 14 13:56:04 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:56:04 user nova-compute[73484]:   </features>
Aug 14 13:56:04 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:56:04 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:56:04 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:56:04 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:56:04 user nova-compute[73484]:   </clock>
Aug 14 13:56:04 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:56:04 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:56:04 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:56:04 user nova-compute[73484]:   </cpu>
Aug 14 13:56:04 user nova-compute[73484]:   <devices>
Aug 14 13:56:04 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:56:04 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:56:04 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk.rescue"/>
Aug 14 13:56:04 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:56:04 user nova-compute[73484]:     </disk>
Aug 14 13:56:04 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:56:04 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:56:04 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk"/>
Aug 14 13:56:04 user nova-compute[73484]:       <target dev="vdb" bus="virtio"/>
Aug 14 13:56:04 user nova-compute[73484]:     </disk>
Aug 14 13:56:04 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:56:04 user nova-compute[73484]:       <mac address="fa:16:3e:d5:7f:13"/>
Aug 14 13:56:04 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:56:04 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:56:04 user nova-compute[73484]:       <target dev="tap0259d05a-95"/>
Aug 14 13:56:04 user nova-compute[73484]:     </interface>
Aug 14 13:56:04 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:56:04 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/console.log" append="off"/>
Aug 14 13:56:04 user nova-compute[73484]:     </serial>
Aug 14 13:56:04 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:56:04 user nova-compute[73484]:     <video>
Aug 14 13:56:04 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:56:04 user nova-compute[73484]:     </video>
Aug 14 13:56:04 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:56:04 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:56:04 user nova-compute[73484]:     </rng>
Aug 14 13:56:04 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:56:04 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:56:04 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:56:04 user nova-compute[73484]:     </memballoon>
Aug 14 13:56:04 user nova-compute[73484]:   </devices>
Aug 14 13:56:04 user nova-compute[73484]: </domain>
Aug 14 13:56:04 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:56:04 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Instance destroyed successfully.
Aug 14 13:56:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] No VIF found with MAC fa:16:3e:d5:7f:13, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:56:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:05 user nova-compute[73484]: DEBUG nova.compute.manager [req-ff4d932b-74de-4f2d-becc-317bdd6e39fd req-3b18c9f9-724f-4484-a3b5-9606e0502d16 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Received event network-vif-plugged-0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:56:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ff4d932b-74de-4f2d-becc-317bdd6e39fd req-3b18c9f9-724f-4484-a3b5-9606e0502d16 service nova] Acquiring lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ff4d932b-74de-4f2d-becc-317bdd6e39fd req-3b18c9f9-724f-4484-a3b5-9606e0502d16 service nova] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ff4d932b-74de-4f2d-becc-317bdd6e39fd req-3b18c9f9-724f-4484-a3b5-9606e0502d16 service nova] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:05 user nova-compute[73484]: DEBUG nova.compute.manager [req-ff4d932b-74de-4f2d-becc-317bdd6e39fd req-3b18c9f9-724f-4484-a3b5-9606e0502d16 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] No waiting events found dispatching network-vif-plugged-0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:56:05 user nova-compute[73484]: WARNING nova.compute.manager [req-ff4d932b-74de-4f2d-becc-317bdd6e39fd req-3b18c9f9-724f-4484-a3b5-9606e0502d16 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Received unexpected event network-vif-plugged-0259d05a-9595-41f7-839d-28df692755fb for instance with vm_state active and task_state rescuing.
Aug 14 13:56:05 user nova-compute[73484]: DEBUG nova.compute.manager [None req-1b54897d-966c-4a92-be5e-5bf61c4fc3aa tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:56:05 user nova-compute[73484]: INFO nova.compute.manager [None req-1b54897d-966c-4a92-be5e-5bf61c4fc3aa tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] instance snapshotting
Aug 14 13:56:05 user nova-compute[73484]: DEBUG nova.compute.manager [req-4b163767-4a21-4992-9fcc-00bdc86da66d req-51cd5516-618f-4909-b537-be677ab2abde service nova] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Received event network-changed-e74d5355-d919-48fe-9355-918c02f38dd8 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:56:05 user nova-compute[73484]: DEBUG nova.compute.manager [req-4b163767-4a21-4992-9fcc-00bdc86da66d req-51cd5516-618f-4909-b537-be677ab2abde service nova] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Refreshing instance network info cache due to event network-changed-e74d5355-d919-48fe-9355-918c02f38dd8. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:56:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4b163767-4a21-4992-9fcc-00bdc86da66d req-51cd5516-618f-4909-b537-be677ab2abde service nova] Acquiring lock "refresh_cache-42273739-c086-4cc7-a6c8-10710b16f794" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:56:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4b163767-4a21-4992-9fcc-00bdc86da66d req-51cd5516-618f-4909-b537-be677ab2abde service nova] Acquired lock "refresh_cache-42273739-c086-4cc7-a6c8-10710b16f794" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:56:05 user nova-compute[73484]: DEBUG nova.network.neutron [req-4b163767-4a21-4992-9fcc-00bdc86da66d req-51cd5516-618f-4909-b537-be677ab2abde service nova] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Refreshing network info cache for port e74d5355-d919-48fe-9355-918c02f38dd8 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:56:06 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-1b54897d-966c-4a92-be5e-5bf61c4fc3aa tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Beginning live snapshot process
Aug 14 13:56:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1b54897d-966c-4a92-be5e-5bf61c4fc3aa tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json -f qcow2 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:06 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692021351.27329, a54902a5-df8a-473f-9cf1-a112528c3549 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:56:06 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] VM Stopped (Lifecycle Event)
Aug 14 13:56:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:06 user nova-compute[73484]: DEBUG nova.compute.manager [None req-95854916-ddcf-47f7-b34a-17e192ba47a3 None None] [instance: a54902a5-df8a-473f-9cf1-a112528c3549] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:56:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1b54897d-966c-4a92-be5e-5bf61c4fc3aa tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json -f qcow2" returned: 0 in 0.229s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1b54897d-966c-4a92-be5e-5bf61c4fc3aa tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json -f qcow2 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1b54897d-966c-4a92-be5e-5bf61c4fc3aa tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json -f qcow2" returned: 0 in 0.243s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1b54897d-966c-4a92-be5e-5bf61c4fc3aa tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1b54897d-966c-4a92-be5e-5bf61c4fc3aa tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.233s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1b54897d-966c-4a92-be5e-5bf61c4fc3aa tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpr277isb5/e1b157adc0e849a993c3008a1a5849b9.delta 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1b54897d-966c-4a92-be5e-5bf61c4fc3aa tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpr277isb5/e1b157adc0e849a993c3008a1a5849b9.delta 1073741824" returned: 0 in 0.056s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:07 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-1b54897d-966c-4a92-be5e-5bf61c4fc3aa tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 13:56:07 user nova-compute[73484]: DEBUG nova.compute.manager [req-f605de93-bf0f-46dd-abb3-7c528807bdab req-ad0608a1-28fe-4204-8fc6-dfec6d242a3a service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Received event network-vif-plugged-0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:56:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f605de93-bf0f-46dd-abb3-7c528807bdab req-ad0608a1-28fe-4204-8fc6-dfec6d242a3a service nova] Acquiring lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f605de93-bf0f-46dd-abb3-7c528807bdab req-ad0608a1-28fe-4204-8fc6-dfec6d242a3a service nova] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f605de93-bf0f-46dd-abb3-7c528807bdab req-ad0608a1-28fe-4204-8fc6-dfec6d242a3a service nova] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:07 user nova-compute[73484]: DEBUG nova.compute.manager [req-f605de93-bf0f-46dd-abb3-7c528807bdab req-ad0608a1-28fe-4204-8fc6-dfec6d242a3a service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] No waiting events found dispatching network-vif-plugged-0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:56:07 user nova-compute[73484]: WARNING nova.compute.manager [req-f605de93-bf0f-46dd-abb3-7c528807bdab req-ad0608a1-28fe-4204-8fc6-dfec6d242a3a service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Received unexpected event network-vif-plugged-0259d05a-9595-41f7-839d-28df692755fb for instance with vm_state active and task_state rescuing.
Aug 14 13:56:07 user nova-compute[73484]: DEBUG nova.compute.manager [req-f605de93-bf0f-46dd-abb3-7c528807bdab req-ad0608a1-28fe-4204-8fc6-dfec6d242a3a service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Received event network-vif-plugged-0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:56:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f605de93-bf0f-46dd-abb3-7c528807bdab req-ad0608a1-28fe-4204-8fc6-dfec6d242a3a service nova] Acquiring lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f605de93-bf0f-46dd-abb3-7c528807bdab req-ad0608a1-28fe-4204-8fc6-dfec6d242a3a service nova] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f605de93-bf0f-46dd-abb3-7c528807bdab req-ad0608a1-28fe-4204-8fc6-dfec6d242a3a service nova] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:07 user nova-compute[73484]: DEBUG nova.compute.manager [req-f605de93-bf0f-46dd-abb3-7c528807bdab req-ad0608a1-28fe-4204-8fc6-dfec6d242a3a service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] No waiting events found dispatching network-vif-plugged-0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:56:07 user nova-compute[73484]: WARNING nova.compute.manager [req-f605de93-bf0f-46dd-abb3-7c528807bdab req-ad0608a1-28fe-4204-8fc6-dfec6d242a3a service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Received unexpected event network-vif-plugged-0259d05a-9595-41f7-839d-28df692755fb for instance with vm_state active and task_state rescuing.
Aug 14 13:56:07 user nova-compute[73484]: DEBUG nova.network.neutron [req-4b163767-4a21-4992-9fcc-00bdc86da66d req-51cd5516-618f-4909-b537-be677ab2abde service nova] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Updated VIF entry in instance network info cache for port e74d5355-d919-48fe-9355-918c02f38dd8. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:56:07 user nova-compute[73484]: DEBUG nova.network.neutron [req-4b163767-4a21-4992-9fcc-00bdc86da66d req-51cd5516-618f-4909-b537-be677ab2abde service nova] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Updating instance_info_cache with network_info: [{"id": "e74d5355-d919-48fe-9355-918c02f38dd8", "address": "fa:16:3e:fd:d0:83", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape74d5355-d9", "ovs_interfaceid": "e74d5355-d919-48fe-9355-918c02f38dd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:56:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4b163767-4a21-4992-9fcc-00bdc86da66d req-51cd5516-618f-4909-b537-be677ab2abde service nova] Releasing lock "refresh_cache-42273739-c086-4cc7-a6c8-10710b16f794" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:56:07 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-1b54897d-966c-4a92-be5e-5bf61c4fc3aa tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73484) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 13:56:08 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-1b54897d-966c-4a92-be5e-5bf61c4fc3aa tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] COPY block job progress, current cursor: 28246016 final cursor: 75563008 {{(pid=73484) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 13:56:08 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-1b54897d-966c-4a92-be5e-5bf61c4fc3aa tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73484) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 13:56:08 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-1b54897d-966c-4a92-be5e-5bf61c4fc3aa tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 13:56:09 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Removed pending event for 14999671-dcc7-43fa-85ec-21cbcf12d21e due to event {{(pid=73484) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 13:56:09 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021369.0680065, 14999671-dcc7-43fa-85ec-21cbcf12d21e => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:56:09 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] VM Resumed (Lifecycle Event)
Aug 14 13:56:09 user nova-compute[73484]: DEBUG nova.compute.manager [None req-fd510892-2486-4176-bfab-f29ff0795fa2 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:56:09 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:56:09 user nova-compute[73484]: DEBUG nova.privsep.utils [None req-1b54897d-966c-4a92-be5e-5bf61c4fc3aa tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73484) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 13:56:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1b54897d-966c-4a92-be5e-5bf61c4fc3aa tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpr277isb5/e1b157adc0e849a993c3008a1a5849b9.delta /opt/stack/data/nova/instances/snapshots/tmpr277isb5/e1b157adc0e849a993c3008a1a5849b9 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:09 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:56:09 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021369.07378, 14999671-dcc7-43fa-85ec-21cbcf12d21e => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:56:09 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] VM Started (Lifecycle Event)
Aug 14 13:56:09 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:56:09 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:56:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1b54897d-966c-4a92-be5e-5bf61c4fc3aa tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpr277isb5/e1b157adc0e849a993c3008a1a5849b9.delta /opt/stack/data/nova/instances/snapshots/tmpr277isb5/e1b157adc0e849a993c3008a1a5849b9" returned: 0 in 0.899s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:10 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-1b54897d-966c-4a92-be5e-5bf61c4fc3aa tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Snapshot extracted, beginning image upload
Aug 14 13:56:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "42273739-c086-4cc7-a6c8-10710b16f794" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "42273739-c086-4cc7-a6c8-10710b16f794" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG nova.objects.instance [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lazy-loading 'flavor' on Instance uuid 42273739-c086-4cc7-a6c8-10710b16f794 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "42273739-c086-4cc7-a6c8-10710b16f794" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "42273739-c086-4cc7-a6c8-10710b16f794" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "42273739-c086-4cc7-a6c8-10710b16f794" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:11 user nova-compute[73484]: INFO nova.compute.manager [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Attaching volume 4008fdd6-5697-4118-80ee-6eb6e94e8c0c to /dev/vdb
Aug 14 13:56:11 user nova-compute[73484]: DEBUG os_brick.utils [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b95b33c-e9af-4f6f-9403-5a9a0e85783b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[607d693d-fd0f-445f-b6a9-c9f3062e9102]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c1794c-2d29-4e50-8ddc-bd8b380c5735]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf5c98e-ce2c-4c7c-a45b-9dcccadd72b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-982cdca0-dd23-48d7-9985-516450d03383 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "07bac569-8b2c-4555-b4d5-a74f7384630b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-982cdca0-dd23-48d7-9985-516450d03383 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "07bac569-8b2c-4555-b4d5-a74f7384630b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-982cdca0-dd23-48d7-9985-516450d03383 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "07bac569-8b2c-4555-b4d5-a74f7384630b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-982cdca0-dd23-48d7-9985-516450d03383 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "07bac569-8b2c-4555-b4d5-a74f7384630b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-982cdca0-dd23-48d7-9985-516450d03383 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "07bac569-8b2c-4555-b4d5-a74f7384630b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:11 user nova-compute[73484]: INFO nova.compute.manager [None req-982cdca0-dd23-48d7-9985-516450d03383 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Terminating instance
Aug 14 13:56:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:56:11 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:56:11 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2c8b6a-38c1-459c-a097-cb3ac23146c4]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG nova.compute.manager [None req-982cdca0-dd23-48d7-9985-516450d03383 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG os_brick.utils [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Updating existing volume attachment record: 20e15e62-b4cf-4ad6-9782-3e4b46cd6c47 {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:12 user nova-compute[73484]: DEBUG nova.compute.manager [req-99c4677a-090e-4317-a9e0-3a9404063807 req-32db695f-a9c6-4452-a587-b12ab6918be6 service nova] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Received event network-vif-unplugged-cb7f3901-875e-489a-87f8-5642b9fded9c {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:56:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-99c4677a-090e-4317-a9e0-3a9404063807 req-32db695f-a9c6-4452-a587-b12ab6918be6 service nova] Acquiring lock "07bac569-8b2c-4555-b4d5-a74f7384630b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-99c4677a-090e-4317-a9e0-3a9404063807 req-32db695f-a9c6-4452-a587-b12ab6918be6 service nova] Lock "07bac569-8b2c-4555-b4d5-a74f7384630b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-99c4677a-090e-4317-a9e0-3a9404063807 req-32db695f-a9c6-4452-a587-b12ab6918be6 service nova] Lock "07bac569-8b2c-4555-b4d5-a74f7384630b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:12 user nova-compute[73484]: DEBUG nova.compute.manager [req-99c4677a-090e-4317-a9e0-3a9404063807 req-32db695f-a9c6-4452-a587-b12ab6918be6 service nova] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] No waiting events found dispatching network-vif-unplugged-cb7f3901-875e-489a-87f8-5642b9fded9c {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:56:12 user nova-compute[73484]: DEBUG nova.compute.manager [req-99c4677a-090e-4317-a9e0-3a9404063807 req-32db695f-a9c6-4452-a587-b12ab6918be6 service nova] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Received event network-vif-unplugged-cb7f3901-875e-489a-87f8-5642b9fded9c for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:56:12 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Instance destroyed successfully.
Aug 14 13:56:12 user nova-compute[73484]: DEBUG nova.objects.instance [None req-982cdca0-dd23-48d7-9985-516450d03383 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lazy-loading 'resources' on Instance uuid 07bac569-8b2c-4555-b4d5-a74f7384630b {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:56:12 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-982cdca0-dd23-48d7-9985-516450d03383 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:36:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-309867077',display_name='tempest-ServerActionsTestOtherA-server-309867077',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-309867077',id=3,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+U0YM0H+9FtSMWW9gC7hlmEYl+cufNxOVmMIw8gQGmCCRzcGdOpZ2rClVjHI02XniG6rU6cneNsbww6ySr+rPSIW5KD8/op2pTaoCA25ZKyUod+b+1u3EAmeZWFbiG0g==',key_name='tempest-keypair-1679559247',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:37:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff9e3bd3df8a408e96e9054775c3cb83',ramdisk_id='',reservation_id='r-en88zafj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2033458528',owner_user_name='tempest-ServerActionsTestOtherA-2033458528-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:37:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b22dfe5647e149a5b3a19d843f0efd66',uuid=07bac569-8b2c-4555-b4d5-a74f7384630b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb7f3901-875e-489a-87f8-5642b9fded9c", "address": "fa:16:3e:6c:13:9e", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7f3901-87", "ovs_interfaceid": "cb7f3901-875e-489a-87f8-5642b9fded9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:56:12 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-982cdca0-dd23-48d7-9985-516450d03383 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Converting VIF {"id": "cb7f3901-875e-489a-87f8-5642b9fded9c", "address": "fa:16:3e:6c:13:9e", "network": {"id": "13fa7ea2-fd81-4aa4-8457-fa292c6e08e4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1493391166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff9e3bd3df8a408e96e9054775c3cb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb7f3901-87", "ovs_interfaceid": "cb7f3901-875e-489a-87f8-5642b9fded9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:56:12 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-982cdca0-dd23-48d7-9985-516450d03383 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:13:9e,bridge_name='br-int',has_traffic_filtering=True,id=cb7f3901-875e-489a-87f8-5642b9fded9c,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb7f3901-87') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:56:12 user nova-compute[73484]: DEBUG os_vif [None req-982cdca0-dd23-48d7-9985-516450d03383 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:13:9e,bridge_name='br-int',has_traffic_filtering=True,id=cb7f3901-875e-489a-87f8-5642b9fded9c,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb7f3901-87') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:56:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb7f3901-87, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:56:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:12 user nova-compute[73484]: INFO os_vif [None req-982cdca0-dd23-48d7-9985-516450d03383 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:13:9e,bridge_name='br-int',has_traffic_filtering=True,id=cb7f3901-875e-489a-87f8-5642b9fded9c,network=Network(13fa7ea2-fd81-4aa4-8457-fa292c6e08e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb7f3901-87')
Aug 14 13:56:12 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-982cdca0-dd23-48d7-9985-516450d03383 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Deleting instance files /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b_del
Aug 14 13:56:12 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-982cdca0-dd23-48d7-9985-516450d03383 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Deletion of /opt/stack/data/nova/instances/07bac569-8b2c-4555-b4d5-a74f7384630b_del complete
Aug 14 13:56:12 user nova-compute[73484]: INFO nova.compute.manager [None req-982cdca0-dd23-48d7-9985-516450d03383 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 14 13:56:12 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-982cdca0-dd23-48d7-9985-516450d03383 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:56:12 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:56:12 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:56:12 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-1b54897d-966c-4a92-be5e-5bf61c4fc3aa tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Snapshot image upload complete
Aug 14 13:56:12 user nova-compute[73484]: INFO nova.compute.manager [None req-1b54897d-966c-4a92-be5e-5bf61c4fc3aa tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Took 7.06 seconds to snapshot the instance on the hypervisor.
Aug 14 13:56:13 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:56:13 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Took 0.89 seconds to deallocate network for instance.
Aug 14 13:56:13 user nova-compute[73484]: DEBUG nova.compute.manager [req-e147b93c-0a95-4c6a-8bc3-cc525b11b0d7 req-9fa7a2a0-1264-448e-9aa6-7cb3997fde31 service nova] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Received event network-vif-deleted-cb7f3901-875e-489a-87f8-5642b9fded9c {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:56:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-982cdca0-dd23-48d7-9985-516450d03383 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-982cdca0-dd23-48d7-9985-516450d03383 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:13 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-982cdca0-dd23-48d7-9985-516450d03383 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:56:13 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-982cdca0-dd23-48d7-9985-516450d03383 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:56:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-982cdca0-dd23-48d7-9985-516450d03383 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:13 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-982cdca0-dd23-48d7-9985-516450d03383 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Deleted allocations for instance 07bac569-8b2c-4555-b4d5-a74f7384630b
Aug 14 13:56:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-982cdca0-dd23-48d7-9985-516450d03383 tempest-ServerActionsTestOtherA-2033458528 tempest-ServerActionsTestOtherA-2033458528-project-member] Lock "07bac569-8b2c-4555-b4d5-a74f7384630b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.414s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:14 user nova-compute[73484]: DEBUG nova.compute.manager [req-65088a6c-11ac-487c-8b5c-cc7f68a106fe req-77ad8292-237b-4d2d-a3d1-d112f389bf7d service nova] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Received event network-vif-plugged-cb7f3901-875e-489a-87f8-5642b9fded9c {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:56:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-65088a6c-11ac-487c-8b5c-cc7f68a106fe req-77ad8292-237b-4d2d-a3d1-d112f389bf7d service nova] Acquiring lock "07bac569-8b2c-4555-b4d5-a74f7384630b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-65088a6c-11ac-487c-8b5c-cc7f68a106fe req-77ad8292-237b-4d2d-a3d1-d112f389bf7d service nova] Lock "07bac569-8b2c-4555-b4d5-a74f7384630b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-65088a6c-11ac-487c-8b5c-cc7f68a106fe req-77ad8292-237b-4d2d-a3d1-d112f389bf7d service nova] Lock "07bac569-8b2c-4555-b4d5-a74f7384630b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:14 user nova-compute[73484]: DEBUG nova.compute.manager [req-65088a6c-11ac-487c-8b5c-cc7f68a106fe req-77ad8292-237b-4d2d-a3d1-d112f389bf7d service nova] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] No waiting events found dispatching network-vif-plugged-cb7f3901-875e-489a-87f8-5642b9fded9c {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:56:14 user nova-compute[73484]: WARNING nova.compute.manager [req-65088a6c-11ac-487c-8b5c-cc7f68a106fe req-77ad8292-237b-4d2d-a3d1-d112f389bf7d service nova] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Received unexpected event network-vif-plugged-cb7f3901-875e-489a-87f8-5642b9fded9c for instance with vm_state deleted and task_state None.
Aug 14 13:56:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquiring lock "b6d97e05-3311-4372-90d7-b07004369a4d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "b6d97e05-3311-4372-90d7-b07004369a4d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:56:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:15 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:56:15 user nova-compute[73484]: INFO nova.compute.claims [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Claim successful on node user
Aug 14 13:56:15 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:56:15 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:56:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:56:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:56:15 user nova-compute[73484]: DEBUG nova.network.neutron [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:56:15 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:56:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:56:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:15 user nova-compute[73484]: DEBUG nova.policy [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e9d4aa3f4ad04184bb6181332a6ef6e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a442b6e525b4ae9ba256aa1c71e1a94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:56:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:56:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:56:15 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Creating image(s)
Aug 14 13:56:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquiring lock "/opt/stack/data/nova/instances/b6d97e05-3311-4372-90d7-b07004369a4d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "/opt/stack/data/nova/instances/b6d97e05-3311-4372-90d7-b07004369a4d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "/opt/stack/data/nova/instances/b6d97e05-3311-4372-90d7-b07004369a4d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquiring lock "de4eb93428f085f86e3da10aa57a5d4c0a8561e3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "de4eb93428f085f86e3da10aa57a5d4c0a8561e3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de4eb93428f085f86e3da10aa57a5d4c0a8561e3.part --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:16 user nova-compute[73484]: DEBUG nova.network.neutron [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Successfully created port: 6fded38c-518a-453c-93db-d64ceebab4ba {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:56:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de4eb93428f085f86e3da10aa57a5d4c0a8561e3.part --force-share --output=json" returned: 0 in 0.202s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:17 user nova-compute[73484]: DEBUG nova.virt.images [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] 52c1cf71-1e8e-45b6-b6e6-339c42c7abb9 was qcow2, converting to raw {{(pid=73484) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 13:56:17 user nova-compute[73484]: DEBUG nova.privsep.utils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73484) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 13:56:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/de4eb93428f085f86e3da10aa57a5d4c0a8561e3.part /opt/stack/data/nova/instances/_base/de4eb93428f085f86e3da10aa57a5d4c0a8561e3.converted {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/de4eb93428f085f86e3da10aa57a5d4c0a8561e3.part /opt/stack/data/nova/instances/_base/de4eb93428f085f86e3da10aa57a5d4c0a8561e3.converted" returned: 0 in 1.320s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de4eb93428f085f86e3da10aa57a5d4c0a8561e3.converted --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de4eb93428f085f86e3da10aa57a5d4c0a8561e3.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "de4eb93428f085f86e3da10aa57a5d4c0a8561e3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.866s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de4eb93428f085f86e3da10aa57a5d4c0a8561e3 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:18 user nova-compute[73484]: DEBUG nova.network.neutron [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Successfully updated port: 6fded38c-518a-453c-93db-d64ceebab4ba {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:56:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquiring lock "refresh_cache-b6d97e05-3311-4372-90d7-b07004369a4d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:56:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquired lock "refresh_cache-b6d97e05-3311-4372-90d7-b07004369a4d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:56:18 user nova-compute[73484]: DEBUG nova.network.neutron [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:56:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-a2e16f94-f080-48dd-8129-7c2bbeb42054 req-fc28c023-c49f-48fb-b58e-657bcb7f8822 service nova] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Received event network-changed-6fded38c-518a-453c-93db-d64ceebab4ba {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:56:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-a2e16f94-f080-48dd-8129-7c2bbeb42054 req-fc28c023-c49f-48fb-b58e-657bcb7f8822 service nova] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Refreshing instance network info cache due to event network-changed-6fded38c-518a-453c-93db-d64ceebab4ba. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:56:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a2e16f94-f080-48dd-8129-7c2bbeb42054 req-fc28c023-c49f-48fb-b58e-657bcb7f8822 service nova] Acquiring lock "refresh_cache-b6d97e05-3311-4372-90d7-b07004369a4d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:56:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de4eb93428f085f86e3da10aa57a5d4c0a8561e3 --force-share --output=json" returned: 0 in 0.180s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquiring lock "de4eb93428f085f86e3da10aa57a5d4c0a8561e3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "de4eb93428f085f86e3da10aa57a5d4c0a8561e3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de4eb93428f085f86e3da10aa57a5d4c0a8561e3 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:18 user nova-compute[73484]: DEBUG nova.network.neutron [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de4eb93428f085f86e3da10aa57a5d4c0a8561e3 --force-share --output=json" returned: 0 in 0.200s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de4eb93428f085f86e3da10aa57a5d4c0a8561e3,backing_fmt=raw /opt/stack/data/nova/instances/b6d97e05-3311-4372-90d7-b07004369a4d/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de4eb93428f085f86e3da10aa57a5d4c0a8561e3,backing_fmt=raw /opt/stack/data/nova/instances/b6d97e05-3311-4372-90d7-b07004369a4d/disk 1073741824" returned: 0 in 0.065s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "de4eb93428f085f86e3da10aa57a5d4c0a8561e3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de4eb93428f085f86e3da10aa57a5d4c0a8561e3 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.network.neutron [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Updating instance_info_cache with network_info: [{"id": "6fded38c-518a-453c-93db-d64ceebab4ba", "address": "fa:16:3e:db:9d:8f", "network": {"id": "8f719ef2-7286-46f1-96e0-d08fd389db0e", "bridge": "br-int", "label": "tempest-TestStampPattern-1811054691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a442b6e525b4ae9ba256aa1c71e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fded38c-51", "ovs_interfaceid": "6fded38c-518a-453c-93db-d64ceebab4ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Releasing lock "refresh_cache-b6d97e05-3311-4372-90d7-b07004369a4d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.compute.manager [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Instance network_info: |[{"id": "6fded38c-518a-453c-93db-d64ceebab4ba", "address": "fa:16:3e:db:9d:8f", "network": {"id": "8f719ef2-7286-46f1-96e0-d08fd389db0e", "bridge": "br-int", "label": "tempest-TestStampPattern-1811054691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a442b6e525b4ae9ba256aa1c71e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fded38c-51", "ovs_interfaceid": "6fded38c-518a-453c-93db-d64ceebab4ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a2e16f94-f080-48dd-8129-7c2bbeb42054 req-fc28c023-c49f-48fb-b58e-657bcb7f8822 service nova] Acquired lock "refresh_cache-b6d97e05-3311-4372-90d7-b07004369a4d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.network.neutron [req-a2e16f94-f080-48dd-8129-7c2bbeb42054 req-fc28c023-c49f-48fb-b58e-657bcb7f8822 service nova] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Refreshing network info cache for port 6fded38c-518a-453c-93db-d64ceebab4ba {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de4eb93428f085f86e3da10aa57a5d4c0a8561e3 --force-share --output=json" returned: 0 in 0.199s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.objects.instance [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lazy-loading 'migration_context' on Instance uuid b6d97e05-3311-4372-90d7-b07004369a4d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Ensure instance console log exists: /opt/stack/data/nova/instances/b6d97e05-3311-4372-90d7-b07004369a4d/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Start _get_guest_xml network_info=[{"id": "6fded38c-518a-453c-93db-d64ceebab4ba", "address": "fa:16:3e:db:9d:8f", "network": {"id": "8f719ef2-7286-46f1-96e0-d08fd389db0e", "bridge": "br-int", "label": "tempest-TestStampPattern-1811054691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a442b6e525b4ae9ba256aa1c71e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fded38c-51", "ovs_interfaceid": "6fded38c-518a-453c-93db-d64ceebab4ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='37552b41038ab954767f0d24b24f8a60',container_format='bare',created_at=2023-08-14T13:56:06Z,direct_url=<?>,disk_format='qcow2',id=52c1cf71-1e8e-45b6-b6e6-339c42c7abb9,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1635307097',owner='5a442b6e525b4ae9ba256aa1c71e1a94',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T13:56:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '52c1cf71-1e8e-45b6-b6e6-339c42c7abb9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:56:19 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:56:19 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='37552b41038ab954767f0d24b24f8a60',container_format='bare',created_at=2023-08-14T13:56:06Z,direct_url=<?>,disk_format='qcow2',id=52c1cf71-1e8e-45b6-b6e6-339c42c7abb9,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1635307097',owner='5a442b6e525b4ae9ba256aa1c71e1a94',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T13:56:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:56:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-938337146',display_name='tempest-TestStampPattern-server-938337146',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-938337146',id=37,image_ref='52c1cf71-1e8e-45b6-b6e6-339c42c7abb9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcHOndY4thu+Li/XG3hWqIOD4cGsaZ6per43xYR1P6MSwf1FXn+zuKlHDSmWjudBpUwpsq+XH3XDp8yg1o4KErin8MFeGY1rhZ0UCW+BGzI3wFo1KaDX12K6RUas0q53g==',key_name='tempest-TestStampPattern-1459796457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a442b6e525b4ae9ba256aa1c71e1a94',ramdisk_id='',reservation_id='r-ta0xy2z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b8a790d0-e5d0-4b78-8de4-36a58290b4ee',image_min_disk='1',image_min_ram='0',image_owner_id='5a442b6e525b4ae9ba256aa1c71e1a94',image_owner_project_name='tempest-TestStampPattern-678241444',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-678241444-project-member',image_user_id='e9d4aa3f4ad04184bb6181332a6ef6e1',network_allocated='True',owner_project_name='tempest-TestStampPattern-678241444',owner_user_name='tempest-TestStampPattern-678241444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:56:16Z,user_data=None,user_id='e9d4aa3f4ad04184bb6181332a6ef6e1',uuid=b6d97e05-3311-4372-90d7-b07004369a4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fded38c-518a-453c-93db-d64ceebab4ba", "address": "fa:16:3e:db:9d:8f", "network": {"id": "8f719ef2-7286-46f1-96e0-d08fd389db0e", "bridge": "br-int", "label": "tempest-TestStampPattern-1811054691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a442b6e525b4ae9ba256aa1c71e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fded38c-51", "ovs_interfaceid": "6fded38c-518a-453c-93db-d64ceebab4ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Converting VIF {"id": "6fded38c-518a-453c-93db-d64ceebab4ba", "address": "fa:16:3e:db:9d:8f", "network": {"id": "8f719ef2-7286-46f1-96e0-d08fd389db0e", "bridge": "br-int", "label": "tempest-TestStampPattern-1811054691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a442b6e525b4ae9ba256aa1c71e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fded38c-51", "ovs_interfaceid": "6fded38c-518a-453c-93db-d64ceebab4ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:9d:8f,bridge_name='br-int',has_traffic_filtering=True,id=6fded38c-518a-453c-93db-d64ceebab4ba,network=Network(8f719ef2-7286-46f1-96e0-d08fd389db0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fded38c-51') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.objects.instance [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lazy-loading 'pci_devices' on Instance uuid b6d97e05-3311-4372-90d7-b07004369a4d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:56:19 user nova-compute[73484]:   <uuid>b6d97e05-3311-4372-90d7-b07004369a4d</uuid>
Aug 14 13:56:19 user nova-compute[73484]:   <name>instance-00000025</name>
Aug 14 13:56:19 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:56:19 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:56:19 user nova-compute[73484]:   <metadata>
Aug 14 13:56:19 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:56:19 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:56:19 user nova-compute[73484]:       <nova:name>tempest-TestStampPattern-server-938337146</nova:name>
Aug 14 13:56:19 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:56:19</nova:creationTime>
Aug 14 13:56:19 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:56:19 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:56:19 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:56:19 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:56:19 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:56:19 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:56:19 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:56:19 user nova-compute[73484]:       <nova:owner>
Aug 14 13:56:19 user nova-compute[73484]:         <nova:user uuid="e9d4aa3f4ad04184bb6181332a6ef6e1">tempest-TestStampPattern-678241444-project-member</nova:user>
Aug 14 13:56:19 user nova-compute[73484]:         <nova:project uuid="5a442b6e525b4ae9ba256aa1c71e1a94">tempest-TestStampPattern-678241444</nova:project>
Aug 14 13:56:19 user nova-compute[73484]:       </nova:owner>
Aug 14 13:56:19 user nova-compute[73484]:       <nova:root type="image" uuid="52c1cf71-1e8e-45b6-b6e6-339c42c7abb9"/>
Aug 14 13:56:19 user nova-compute[73484]:       <nova:ports>
Aug 14 13:56:19 user nova-compute[73484]:         <nova:port uuid="6fded38c-518a-453c-93db-d64ceebab4ba">
Aug 14 13:56:19 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 13:56:19 user nova-compute[73484]:         </nova:port>
Aug 14 13:56:19 user nova-compute[73484]:       </nova:ports>
Aug 14 13:56:19 user nova-compute[73484]:     </nova:instance>
Aug 14 13:56:19 user nova-compute[73484]:   </metadata>
Aug 14 13:56:19 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:56:19 user nova-compute[73484]:     <system>
Aug 14 13:56:19 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:56:19 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:56:19 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:56:19 user nova-compute[73484]:       <entry name="serial">b6d97e05-3311-4372-90d7-b07004369a4d</entry>
Aug 14 13:56:19 user nova-compute[73484]:       <entry name="uuid">b6d97e05-3311-4372-90d7-b07004369a4d</entry>
Aug 14 13:56:19 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:56:19 user nova-compute[73484]:     </system>
Aug 14 13:56:19 user nova-compute[73484]:   </sysinfo>
Aug 14 13:56:19 user nova-compute[73484]:   <os>
Aug 14 13:56:19 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:56:19 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:56:19 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:56:19 user nova-compute[73484]:   </os>
Aug 14 13:56:19 user nova-compute[73484]:   <features>
Aug 14 13:56:19 user nova-compute[73484]:     <acpi/>
Aug 14 13:56:19 user nova-compute[73484]:     <apic/>
Aug 14 13:56:19 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:56:19 user nova-compute[73484]:   </features>
Aug 14 13:56:19 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:56:19 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:56:19 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:56:19 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:56:19 user nova-compute[73484]:   </clock>
Aug 14 13:56:19 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:56:19 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:56:19 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:56:19 user nova-compute[73484]:   </cpu>
Aug 14 13:56:19 user nova-compute[73484]:   <devices>
Aug 14 13:56:19 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:56:19 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:56:19 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/b6d97e05-3311-4372-90d7-b07004369a4d/disk"/>
Aug 14 13:56:19 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:56:19 user nova-compute[73484]:     </disk>
Aug 14 13:56:19 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:56:19 user nova-compute[73484]:       <mac address="fa:16:3e:db:9d:8f"/>
Aug 14 13:56:19 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:56:19 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:56:19 user nova-compute[73484]:       <target dev="tap6fded38c-51"/>
Aug 14 13:56:19 user nova-compute[73484]:     </interface>
Aug 14 13:56:19 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:56:19 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/b6d97e05-3311-4372-90d7-b07004369a4d/console.log" append="off"/>
Aug 14 13:56:19 user nova-compute[73484]:     </serial>
Aug 14 13:56:19 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:56:19 user nova-compute[73484]:     <video>
Aug 14 13:56:19 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:56:19 user nova-compute[73484]:     </video>
Aug 14 13:56:19 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:56:19 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:56:19 user nova-compute[73484]:     </rng>
Aug 14 13:56:19 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:56:19 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:56:19 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:56:19 user nova-compute[73484]:     </memballoon>
Aug 14 13:56:19 user nova-compute[73484]:   </devices>
Aug 14 13:56:19 user nova-compute[73484]: </domain>
Aug 14 13:56:19 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:56:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-938337146',display_name='tempest-TestStampPattern-server-938337146',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-938337146',id=37,image_ref='52c1cf71-1e8e-45b6-b6e6-339c42c7abb9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcHOndY4thu+Li/XG3hWqIOD4cGsaZ6per43xYR1P6MSwf1FXn+zuKlHDSmWjudBpUwpsq+XH3XDp8yg1o4KErin8MFeGY1rhZ0UCW+BGzI3wFo1KaDX12K6RUas0q53g==',key_name='tempest-TestStampPattern-1459796457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a442b6e525b4ae9ba256aa1c71e1a94',ramdisk_id='',reservation_id='r-ta0xy2z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b8a790d0-e5d0-4b78-8de4-36a58290b4ee',image_min_disk='1',image_min_ram='0',image_owner_id='5a442b6e525b4ae9ba256aa1c71e1a94',image_owner_project_name='tempest-TestStampPattern-678241444',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-678241444-project-member',image_user_id='e9d4aa3f4ad04184bb6181332a6ef6e1',network_allocated='True',owner_project_name='tempest-TestStampPattern-678241444',owner_user_name='tempest-TestStampPattern-678241444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:56:16Z,user_data=None,user_id='e9d4aa3f4ad04184bb6181332a6ef6e1',uuid=b6d97e05-3311-4372-90d7-b07004369a4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fded38c-518a-453c-93db-d64ceebab4ba", "address": "fa:16:3e:db:9d:8f", "network": {"id": "8f719ef2-7286-46f1-96e0-d08fd389db0e", "bridge": "br-int", "label": "tempest-TestStampPattern-1811054691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a442b6e525b4ae9ba256aa1c71e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fded38c-51", "ovs_interfaceid": "6fded38c-518a-453c-93db-d64ceebab4ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Converting VIF {"id": "6fded38c-518a-453c-93db-d64ceebab4ba", "address": "fa:16:3e:db:9d:8f", "network": {"id": "8f719ef2-7286-46f1-96e0-d08fd389db0e", "bridge": "br-int", "label": "tempest-TestStampPattern-1811054691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a442b6e525b4ae9ba256aa1c71e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fded38c-51", "ovs_interfaceid": "6fded38c-518a-453c-93db-d64ceebab4ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:9d:8f,bridge_name='br-int',has_traffic_filtering=True,id=6fded38c-518a-453c-93db-d64ceebab4ba,network=Network(8f719ef2-7286-46f1-96e0-d08fd389db0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fded38c-51') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG os_vif [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:9d:8f,bridge_name='br-int',has_traffic_filtering=True,id=6fded38c-518a-453c-93db-d64ceebab4ba,network=Network(8f719ef2-7286-46f1-96e0-d08fd389db0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fded38c-51') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6fded38c-51, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6fded38c-51, col_values=(('external_ids', {'iface-id': '6fded38c-518a-453c-93db-d64ceebab4ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:9d:8f', 'vm-uuid': 'b6d97e05-3311-4372-90d7-b07004369a4d'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:19 user nova-compute[73484]: INFO os_vif [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:9d:8f,bridge_name='br-int',has_traffic_filtering=True,id=6fded38c-518a-453c-93db-d64ceebab4ba,network=Network(8f719ef2-7286-46f1-96e0-d08fd389db0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fded38c-51')
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] No VIF found with MAC fa:16:3e:db:9d:8f, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.network.neutron [req-a2e16f94-f080-48dd-8129-7c2bbeb42054 req-fc28c023-c49f-48fb-b58e-657bcb7f8822 service nova] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Updated VIF entry in instance network info cache for port 6fded38c-518a-453c-93db-d64ceebab4ba. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG nova.network.neutron [req-a2e16f94-f080-48dd-8129-7c2bbeb42054 req-fc28c023-c49f-48fb-b58e-657bcb7f8822 service nova] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Updating instance_info_cache with network_info: [{"id": "6fded38c-518a-453c-93db-d64ceebab4ba", "address": "fa:16:3e:db:9d:8f", "network": {"id": "8f719ef2-7286-46f1-96e0-d08fd389db0e", "bridge": "br-int", "label": "tempest-TestStampPattern-1811054691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a442b6e525b4ae9ba256aa1c71e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fded38c-51", "ovs_interfaceid": "6fded38c-518a-453c-93db-d64ceebab4ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:56:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a2e16f94-f080-48dd-8129-7c2bbeb42054 req-fc28c023-c49f-48fb-b58e-657bcb7f8822 service nova] Releasing lock "refresh_cache-b6d97e05-3311-4372-90d7-b07004369a4d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:56:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG nova.compute.manager [req-e969defc-b8ca-4c73-b81e-686aa6931af0 req-379881e1-c4fe-4ad6-8503-a1ac82b37d23 service nova] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Received event network-vif-plugged-6fded38c-518a-453c-93db-d64ceebab4ba {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e969defc-b8ca-4c73-b81e-686aa6931af0 req-379881e1-c4fe-4ad6-8503-a1ac82b37d23 service nova] Acquiring lock "b6d97e05-3311-4372-90d7-b07004369a4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e969defc-b8ca-4c73-b81e-686aa6931af0 req-379881e1-c4fe-4ad6-8503-a1ac82b37d23 service nova] Lock "b6d97e05-3311-4372-90d7-b07004369a4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e969defc-b8ca-4c73-b81e-686aa6931af0 req-379881e1-c4fe-4ad6-8503-a1ac82b37d23 service nova] Lock "b6d97e05-3311-4372-90d7-b07004369a4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG nova.compute.manager [req-e969defc-b8ca-4c73-b81e-686aa6931af0 req-379881e1-c4fe-4ad6-8503-a1ac82b37d23 service nova] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] No waiting events found dispatching network-vif-plugged-6fded38c-518a-453c-93db-d64ceebab4ba {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:56:21 user nova-compute[73484]: WARNING nova.compute.manager [req-e969defc-b8ca-4c73-b81e-686aa6931af0 req-379881e1-c4fe-4ad6-8503-a1ac82b37d23 service nova] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Received unexpected event network-vif-plugged-6fded38c-518a-453c-93db-d64ceebab4ba for instance with vm_state building and task_state spawning.
Aug 14 13:56:21 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ytZzhbqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:56:21 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:56:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:56:21 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:56:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:56:21 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:56:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[859ecaa1-8014-4eb5-867c-a74a6876ea92]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:56:21 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0983752-a450-4230-b7c7-f05206cd1659]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c] added
Aug 14 13:56:21 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6448d0-68cd-4f5a-bd4b-d015dd3eaf85]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[60649ada-be28-4fa9-a148-3589b6bc9365]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ytZzhbqT {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ytZzhbqT" returned: 0 in 0.029s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[060767a6-94e9-4d45-9bf4-303dd4fcd9ee]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ytZzhbqT'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6707774-c19e-463b-bd7b-ff00759714e1]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[81697739-dc13-4b0d-a608-a1da359752ce]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)
Aug 14 13:56:21 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)
Aug 14 13:56:21 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:56:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:22 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:22 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[832321f3-fa03-4ebe-a63e-51605572445a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:56:22 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c, portal: 172.16.0.220,3260]
Aug 14 13:56:22 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c, portal: 172.16.0.220,3260] successful.
Aug 14 13:56:22 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:56:22 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:22 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:22 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec988b0b-09ef-4613-ba3d-429536e62a91]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:56:22 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:56:22 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:22 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:22 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d8973f-2a82-4682-aacd-a58c7136d9e5]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:56:22 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)
Aug 14 13:56:22 user nova-compute[73484]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c (non-flash)
Aug 14 13:56:22 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:56:22 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)
Aug 14 13:56:22 user nova-compute[73484]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c (non-flash)
Aug 14 13:56:22 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:56:22 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:56:22 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:56:22 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:56:22 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:56:22 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:22 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:22 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[12092667-98b8-4089-933a-9b2a168699e5]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:56:22 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:56:22 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ytZzhbqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:56:23 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:56:23 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26436656162393234', 'path': '/dev/sdc'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:56:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436656162393234', 'path': '/dev/sdc'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:56:23 user nova-compute[73484]: DEBUG nova.objects.instance [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lazy-loading 'flavor' on Instance uuid 42273739-c086-4cc7-a6c8-10710b16f794 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:56:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 13:56:23 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:56:23 user nova-compute[73484]:   <source dev="/dev/sdc"/>
Aug 14 13:56:23 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:56:23 user nova-compute[73484]:   <serial>4008fdd6-5697-4118-80ee-6eb6e94e8c0c</serial>
Aug 14 13:56:23 user nova-compute[73484]: </disk>
Aug 14 13:56:23 user nova-compute[73484]:  {{(pid=73484) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 13:56:23 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021383.2181706, b6d97e05-3311-4372-90d7-b07004369a4d => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:56:23 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] VM Resumed (Lifecycle Event)
Aug 14 13:56:23 user nova-compute[73484]: DEBUG nova.compute.manager [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:56:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:56:23 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Instance spawned successfully.
Aug 14 13:56:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:56:23 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:56:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:56:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:56:23 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:56:23 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:56:23 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021383.2193975, b6d97e05-3311-4372-90d7-b07004369a4d => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:56:23 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] VM Started (Lifecycle Event)
Aug 14 13:56:23 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:56:23 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:56:23 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:56:23 user nova-compute[73484]: DEBUG nova.compute.manager [req-926d238a-a539-480d-ad8e-2538d5671066 req-e5b89b7f-231d-4e6d-af6b-beb5980a3643 service nova] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Received event network-vif-plugged-6fded38c-518a-453c-93db-d64ceebab4ba {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:56:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-926d238a-a539-480d-ad8e-2538d5671066 req-e5b89b7f-231d-4e6d-af6b-beb5980a3643 service nova] Acquiring lock "b6d97e05-3311-4372-90d7-b07004369a4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-926d238a-a539-480d-ad8e-2538d5671066 req-e5b89b7f-231d-4e6d-af6b-beb5980a3643 service nova] Lock "b6d97e05-3311-4372-90d7-b07004369a4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-926d238a-a539-480d-ad8e-2538d5671066 req-e5b89b7f-231d-4e6d-af6b-beb5980a3643 service nova] Lock "b6d97e05-3311-4372-90d7-b07004369a4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:23 user nova-compute[73484]: DEBUG nova.compute.manager [req-926d238a-a539-480d-ad8e-2538d5671066 req-e5b89b7f-231d-4e6d-af6b-beb5980a3643 service nova] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] No waiting events found dispatching network-vif-plugged-6fded38c-518a-453c-93db-d64ceebab4ba {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:56:23 user nova-compute[73484]: WARNING nova.compute.manager [req-926d238a-a539-480d-ad8e-2538d5671066 req-e5b89b7f-231d-4e6d-af6b-beb5980a3643 service nova] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Received unexpected event network-vif-plugged-6fded38c-518a-453c-93db-d64ceebab4ba for instance with vm_state building and task_state spawning.
Aug 14 13:56:23 user nova-compute[73484]: INFO nova.compute.manager [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Took 7.68 seconds to spawn the instance on the hypervisor.
Aug 14 13:56:23 user nova-compute[73484]: DEBUG nova.compute.manager [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:56:23 user nova-compute[73484]: INFO nova.compute.manager [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Took 8.56 seconds to build instance.
Aug 14 13:56:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-32738f61-fb36-4051-a134-45c4faa09014 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "b6d97e05-3311-4372-90d7-b07004369a4d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.727s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:56:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:56:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] No VIF found with MAC fa:16:3e:fd:d0:83, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:56:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-68f3d415-d6cc-4c8c-bd5c-cb3106cf6ae3 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "42273739-c086-4cc7-a6c8-10710b16f794" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.453s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "42273739-c086-4cc7-a6c8-10710b16f794" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "42273739-c086-4cc7-a6c8-10710b16f794" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:25 user nova-compute[73484]: INFO nova.compute.manager [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Detaching volume 4008fdd6-5697-4118-80ee-6eb6e94e8c0c
Aug 14 13:56:25 user nova-compute[73484]: INFO nova.virt.block_device [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Attempting to driver detach volume 4008fdd6-5697-4118-80ee-6eb6e94e8c0c from mountpoint /dev/vdb
Aug 14 13:56:25 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Attempting to detach device vdb from instance 42273739-c086-4cc7-a6c8-10710b16f794 from the persistent domain config. {{(pid=73484) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 13:56:25 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:56:25 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:56:25 user nova-compute[73484]:   <source dev="/dev/sdc"/>
Aug 14 13:56:25 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:56:25 user nova-compute[73484]:   <serial>4008fdd6-5697-4118-80ee-6eb6e94e8c0c</serial>
Aug 14 13:56:25 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 13:56:25 user nova-compute[73484]: </disk>
Aug 14 13:56:25 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:56:25 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Successfully detached device vdb from instance 42273739-c086-4cc7-a6c8-10710b16f794 from the persistent domain config.
Aug 14 13:56:25 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 42273739-c086-4cc7-a6c8-10710b16f794 from the live domain config. {{(pid=73484) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 13:56:25 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:56:25 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:56:25 user nova-compute[73484]:   <source dev="/dev/sdc"/>
Aug 14 13:56:25 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:56:25 user nova-compute[73484]:   <serial>4008fdd6-5697-4118-80ee-6eb6e94e8c0c</serial>
Aug 14 13:56:25 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 13:56:25 user nova-compute[73484]: </disk>
Aug 14 13:56:25 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:56:25 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Received event <DeviceRemovedEvent: 1692021385.8514066, 42273739-c086-4cc7-a6c8-10710b16f794 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73484) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 13:56:25 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 42273739-c086-4cc7-a6c8-10710b16f794 {{(pid=73484) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 13:56:25 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Successfully detached device vdb from instance 42273739-c086-4cc7-a6c8-10710b16f794 from the live domain config.
Aug 14 13:56:25 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:56:25 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ytZzhbqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:56:25 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:56:25 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:56:25 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:56:25 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:56:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:25 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[941aed16-3782-4696-a167-04497a8cd635]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:56:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:25 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e8f4d8-a842-4c9c-8223-64555e24eb4b]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:56:25 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)
Aug 14 13:56:25 user nova-compute[73484]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c (non-flash)
Aug 14 13:56:25 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:56:25 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)
Aug 14 13:56:25 user nova-compute[73484]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c (non-flash)
Aug 14 13:56:25 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:56:25 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc458397640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c'): ({'sdc'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:56:25 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Removing single pathed devices sdc {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:56:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:25 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd4de4b-9494-4a34-b2d7-f4316bf22962]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:56:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:25 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee24c14e-2a87-4ddd-b5a4-330f0fb1bd7d]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:56:25 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Flushing IO for device /dev/sdc {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:56:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:26 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b9d3c2-23c0-42fc-9c40-9e00d3e092f0]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:56:26 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:56:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:26 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1850d919-dd66-445c-8908-fbdc7845f0c1]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:56:26 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:56:26 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:56:26 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:56:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:26 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d49891-1920-42b3-bc8f-b5e77f00be07]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:56:26 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:56:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c -p 172.16.0.220:3260 --logout" returned: 0 in 0.103s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:26 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92eb119-a716-45e8-b658-86b497ee3dfa]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:56:26 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c, portal: 172.16.0.220,3260]
Aug 14 13:56:26 user nova-compute[73484]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c, portal: 172.16.0.220,3260] successful.
Aug 14 13:56:26 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:56:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4008fdd6-5697-4118-80ee-6eb6e94e8c0c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:26 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1adf5e0-dec8-42be-9091-212c887511d8]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:56:26 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:56:26 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:56:26 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] <== disconnect_volume: return (351ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:56:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:56:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9f9f6a41-9929-45ef-b33b-ea26fb8e6b3d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "f4f7788c-fcca-47c1-b5b8-72892253982d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9f9f6a41-9929-45ef-b33b-ea26fb8e6b3d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "f4f7788c-fcca-47c1-b5b8-72892253982d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9f9f6a41-9929-45ef-b33b-ea26fb8e6b3d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "f4f7788c-fcca-47c1-b5b8-72892253982d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9f9f6a41-9929-45ef-b33b-ea26fb8e6b3d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "f4f7788c-fcca-47c1-b5b8-72892253982d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9f9f6a41-9929-45ef-b33b-ea26fb8e6b3d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "f4f7788c-fcca-47c1-b5b8-72892253982d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:26 user nova-compute[73484]: INFO nova.compute.manager [None req-9f9f6a41-9929-45ef-b33b-ea26fb8e6b3d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Terminating instance
Aug 14 13:56:26 user nova-compute[73484]: DEBUG nova.compute.manager [None req-9f9f6a41-9929-45ef-b33b-ea26fb8e6b3d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:56:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:27 user nova-compute[73484]: DEBUG nova.objects.instance [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lazy-loading 'flavor' on Instance uuid 42273739-c086-4cc7-a6c8-10710b16f794 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:56:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-89686613-9ab4-4e07-9b8b-98d5794d0c54 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "42273739-c086-4cc7-a6c8-10710b16f794" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.906s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:27 user nova-compute[73484]: DEBUG nova.compute.manager [req-74417de8-c67e-4918-a894-8b4e676b1d3f req-0d4c34eb-6aef-438d-a680-bfd8dd2aff0d service nova] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Received event network-vif-unplugged-5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:56:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-74417de8-c67e-4918-a894-8b4e676b1d3f req-0d4c34eb-6aef-438d-a680-bfd8dd2aff0d service nova] Acquiring lock "f4f7788c-fcca-47c1-b5b8-72892253982d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-74417de8-c67e-4918-a894-8b4e676b1d3f req-0d4c34eb-6aef-438d-a680-bfd8dd2aff0d service nova] Lock "f4f7788c-fcca-47c1-b5b8-72892253982d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-74417de8-c67e-4918-a894-8b4e676b1d3f req-0d4c34eb-6aef-438d-a680-bfd8dd2aff0d service nova] Lock "f4f7788c-fcca-47c1-b5b8-72892253982d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:27 user nova-compute[73484]: DEBUG nova.compute.manager [req-74417de8-c67e-4918-a894-8b4e676b1d3f req-0d4c34eb-6aef-438d-a680-bfd8dd2aff0d service nova] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] No waiting events found dispatching network-vif-unplugged-5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:56:27 user nova-compute[73484]: DEBUG nova.compute.manager [req-74417de8-c67e-4918-a894-8b4e676b1d3f req-0d4c34eb-6aef-438d-a680-bfd8dd2aff0d service nova] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Received event network-vif-unplugged-5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:56:27 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692021372.517086, 07bac569-8b2c-4555-b4d5-a74f7384630b => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:56:27 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] VM Stopped (Lifecycle Event)
Aug 14 13:56:27 user nova-compute[73484]: DEBUG nova.compute.manager [None req-57384b3d-a16c-4a94-8e40-2831e7f0af8f None None] [instance: 07bac569-8b2c-4555-b4d5-a74f7384630b] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:56:27 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Instance destroyed successfully.
Aug 14 13:56:27 user nova-compute[73484]: DEBUG nova.objects.instance [None req-9f9f6a41-9929-45ef-b33b-ea26fb8e6b3d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lazy-loading 'resources' on Instance uuid f4f7788c-fcca-47c1-b5b8-72892253982d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:56:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-9f9f6a41-9929-45ef-b33b-ea26fb8e6b3d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:36:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1818814659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1818814659',id=1,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:37:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c7f2c51c0f84bf1aedcf493a9ff860f',ramdisk_id='',reservation_id='r-ldchyjq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-830908511',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:38:45Z,user_data=None,user_id='5a0f55ad018d4c0ca587d8bdd40df4c8',uuid=f4f7788c-fcca-47c1-b5b8-72892253982d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b", "address": "fa:16:3e:8b:e0:96", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc7ee1a-4f", "ovs_interfaceid": "5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:56:27 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-9f9f6a41-9929-45ef-b33b-ea26fb8e6b3d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Converting VIF {"id": "5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b", "address": "fa:16:3e:8b:e0:96", "network": {"id": "4ec437fc-4371-48d6-8026-b64423fbc0ca", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1850000584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c7f2c51c0f84bf1aedcf493a9ff860f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc7ee1a-4f", "ovs_interfaceid": "5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:56:27 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-9f9f6a41-9929-45ef-b33b-ea26fb8e6b3d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:e0:96,bridge_name='br-int',has_traffic_filtering=True,id=5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b,network=Network(4ec437fc-4371-48d6-8026-b64423fbc0ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc7ee1a-4f') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:56:27 user nova-compute[73484]: DEBUG os_vif [None req-9f9f6a41-9929-45ef-b33b-ea26fb8e6b3d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:e0:96,bridge_name='br-int',has_traffic_filtering=True,id=5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b,network=Network(4ec437fc-4371-48d6-8026-b64423fbc0ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc7ee1a-4f') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:56:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5cc7ee1a-4f, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:56:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:56:27 user nova-compute[73484]: INFO os_vif [None req-9f9f6a41-9929-45ef-b33b-ea26fb8e6b3d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:e0:96,bridge_name='br-int',has_traffic_filtering=True,id=5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b,network=Network(4ec437fc-4371-48d6-8026-b64423fbc0ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc7ee1a-4f')
Aug 14 13:56:27 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-9f9f6a41-9929-45ef-b33b-ea26fb8e6b3d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Deleting instance files /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d_del
Aug 14 13:56:27 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-9f9f6a41-9929-45ef-b33b-ea26fb8e6b3d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Deletion of /opt/stack/data/nova/instances/f4f7788c-fcca-47c1-b5b8-72892253982d_del complete
Aug 14 13:56:27 user nova-compute[73484]: INFO nova.compute.manager [None req-9f9f6a41-9929-45ef-b33b-ea26fb8e6b3d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 14 13:56:27 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-9f9f6a41-9929-45ef-b33b-ea26fb8e6b3d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:56:27 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:56:27 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:56:28 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:56:28 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Took 0.63 seconds to deallocate network for instance.
Aug 14 13:56:28 user nova-compute[73484]: DEBUG nova.compute.manager [req-c4a6fe2d-723a-4a68-b259-1c5c87e9e0a1 req-65e4c34b-c1fa-4876-bbb5-86e82f1c876a service nova] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Received event network-vif-deleted-5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:56:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9f9f6a41-9929-45ef-b33b-ea26fb8e6b3d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9f9f6a41-9929-45ef-b33b-ea26fb8e6b3d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:28 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-9f9f6a41-9929-45ef-b33b-ea26fb8e6b3d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:56:28 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-9f9f6a41-9929-45ef-b33b-ea26fb8e6b3d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:56:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9f9f6a41-9929-45ef-b33b-ea26fb8e6b3d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:28 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-9f9f6a41-9929-45ef-b33b-ea26fb8e6b3d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Deleted allocations for instance f4f7788c-fcca-47c1-b5b8-72892253982d
Aug 14 13:56:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9f9f6a41-9929-45ef-b33b-ea26fb8e6b3d tempest-ServerBootFromVolumeStableRescueTest-830908511 tempest-ServerBootFromVolumeStableRescueTest-830908511-project-member] Lock "f4f7788c-fcca-47c1-b5b8-72892253982d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.086s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:29 user nova-compute[73484]: DEBUG nova.compute.manager [req-494e0021-8f95-418e-8bcb-ea5ad9ee8579 req-ba551129-64bc-4e3f-b89d-0f27c8859a62 service nova] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Received event network-vif-plugged-5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:56:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-494e0021-8f95-418e-8bcb-ea5ad9ee8579 req-ba551129-64bc-4e3f-b89d-0f27c8859a62 service nova] Acquiring lock "f4f7788c-fcca-47c1-b5b8-72892253982d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-494e0021-8f95-418e-8bcb-ea5ad9ee8579 req-ba551129-64bc-4e3f-b89d-0f27c8859a62 service nova] Lock "f4f7788c-fcca-47c1-b5b8-72892253982d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-494e0021-8f95-418e-8bcb-ea5ad9ee8579 req-ba551129-64bc-4e3f-b89d-0f27c8859a62 service nova] Lock "f4f7788c-fcca-47c1-b5b8-72892253982d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:29 user nova-compute[73484]: DEBUG nova.compute.manager [req-494e0021-8f95-418e-8bcb-ea5ad9ee8579 req-ba551129-64bc-4e3f-b89d-0f27c8859a62 service nova] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] No waiting events found dispatching network-vif-plugged-5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:56:29 user nova-compute[73484]: WARNING nova.compute.manager [req-494e0021-8f95-418e-8bcb-ea5ad9ee8579 req-ba551129-64bc-4e3f-b89d-0f27c8859a62 service nova] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Received unexpected event network-vif-plugged-5cc7ee1a-4fe9-4c51-8e63-8ad202f2b93b for instance with vm_state deleted and task_state None.
Aug 14 13:56:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:42 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692021387.7372277, f4f7788c-fcca-47c1-b5b8-72892253982d => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:56:42 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] VM Stopped (Lifecycle Event)
Aug 14 13:56:42 user nova-compute[73484]: DEBUG nova.compute.manager [None req-b1fc0a0c-89b8-40f9-891f-0f6705729ece None None] [instance: f4f7788c-fcca-47c1-b5b8-72892253982d] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:56:42 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:44 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:56:44 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 13:56:44 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Rebuilding the list of instances to heal {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 13:56:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-782c6142-757a-49ae-9292-787a7f1e8a23" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:56:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-782c6142-757a-49ae-9292-787a7f1e8a23" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:56:44 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 13:56:44 user nova-compute[73484]: DEBUG nova.objects.instance [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lazy-loading 'info_cache' on Instance uuid 782c6142-757a-49ae-9292-787a7f1e8a23 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:56:45 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Updating instance_info_cache with network_info: [{"id": "2246e004-4f6b-449d-91b2-8e67b4f51006", "address": "fa:16:3e:31:2a:06", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2246e004-4f", "ovs_interfaceid": "2246e004-4f6b-449d-91b2-8e67b4f51006", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:56:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-782c6142-757a-49ae-9292-787a7f1e8a23" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:56:45 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 13:56:46 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:56:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:49 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:56:49 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 13:56:50 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:56:50 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:56:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "a3282525-9822-4be9-8ef1-c213392c6267" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "a3282525-9822-4be9-8ef1-c213392c6267" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:51 user nova-compute[73484]: DEBUG nova.compute.manager [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:56:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:51 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:56:51 user nova-compute[73484]: INFO nova.compute.claims [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Claim successful on node user
Aug 14 13:56:52 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:56:52 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:56:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:52 user nova-compute[73484]: DEBUG nova.compute.manager [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:56:52 user nova-compute[73484]: DEBUG nova.compute.manager [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:56:52 user nova-compute[73484]: DEBUG nova.network.neutron [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:56:52 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:56:52 user nova-compute[73484]: DEBUG nova.compute.manager [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:56:52 user nova-compute[73484]: DEBUG nova.policy [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be2ee7c7641d4d0892cc3bc03f8340f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1934a2112a584b82a20c4ae8c13a70db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:56:52 user nova-compute[73484]: DEBUG nova.compute.manager [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:56:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:56:52 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Creating image(s)
Aug 14 13:56:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "/opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "/opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.015s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "f3fb9741552644df917dbf6ea1872c0b98835be1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "f3fb9741552644df917dbf6ea1872c0b98835be1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3fb9741552644df917dbf6ea1872c0b98835be1.part --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:53 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:56:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:53 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 13:56:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3fb9741552644df917dbf6ea1872c0b98835be1.part --force-share --output=json" returned: 0 in 0.198s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:53 user nova-compute[73484]: DEBUG nova.virt.images [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] 7e9f7742-c3f5-492c-b4c8-212072532633 was qcow2, converting to raw {{(pid=73484) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 13:56:53 user nova-compute[73484]: DEBUG nova.privsep.utils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73484) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 13:56:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f3fb9741552644df917dbf6ea1872c0b98835be1.part /opt/stack/data/nova/instances/_base/f3fb9741552644df917dbf6ea1872c0b98835be1.converted {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f3fb9741552644df917dbf6ea1872c0b98835be1.part /opt/stack/data/nova/instances/_base/f3fb9741552644df917dbf6ea1872c0b98835be1.converted" returned: 0 in 0.315s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3fb9741552644df917dbf6ea1872c0b98835be1.converted --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3fb9741552644df917dbf6ea1872c0b98835be1.converted --force-share --output=json" returned: 0 in 0.219s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "f3fb9741552644df917dbf6ea1872c0b98835be1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.230s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3fb9741552644df917dbf6ea1872c0b98835be1 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:53 user nova-compute[73484]: DEBUG nova.network.neutron [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Successfully created port: 7ce35860-fbe8-4c2b-9697-bf867ebe5b39 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:56:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3fb9741552644df917dbf6ea1872c0b98835be1 --force-share --output=json" returned: 0 in 0.180s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "f3fb9741552644df917dbf6ea1872c0b98835be1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "f3fb9741552644df917dbf6ea1872c0b98835be1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3fb9741552644df917dbf6ea1872c0b98835be1 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3fb9741552644df917dbf6ea1872c0b98835be1 --force-share --output=json" returned: 0 in 0.252s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3fb9741552644df917dbf6ea1872c0b98835be1,backing_fmt=raw /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3fb9741552644df917dbf6ea1872c0b98835be1,backing_fmt=raw /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk 1073741824" returned: 0 in 0.148s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "f3fb9741552644df917dbf6ea1872c0b98835be1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.408s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3fb9741552644df917dbf6ea1872c0b98835be1 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d97e05-3311-4372-90d7-b07004369a4d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3fb9741552644df917dbf6ea1872c0b98835be1 --force-share --output=json" returned: 0 in 0.185s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG nova.network.neutron [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Successfully updated port: 7ce35860-fbe8-4c2b-9697-bf867ebe5b39 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d97e05-3311-4372-90d7-b07004369a4d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d97e05-3311-4372-90d7-b07004369a4d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "refresh_cache-a3282525-9822-4be9-8ef1-c213392c6267" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquired lock "refresh_cache-a3282525-9822-4be9-8ef1-c213392c6267" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG nova.network.neutron [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG nova.compute.manager [req-b56294c0-e4e7-44a7-9e21-46d4db8f6a9f req-62a1d5c8-bcee-4f51-9f7e-415d0ba0df53 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Received event network-changed-7ce35860-fbe8-4c2b-9697-bf867ebe5b39 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG nova.compute.manager [req-b56294c0-e4e7-44a7-9e21-46d4db8f6a9f req-62a1d5c8-bcee-4f51-9f7e-415d0ba0df53 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Refreshing instance network info cache due to event network-changed-7ce35860-fbe8-4c2b-9697-bf867ebe5b39. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b56294c0-e4e7-44a7-9e21-46d4db8f6a9f req-62a1d5c8-bcee-4f51-9f7e-415d0ba0df53 service nova] Acquiring lock "refresh_cache-a3282525-9822-4be9-8ef1-c213392c6267" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Cannot resize image /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG nova.objects.instance [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lazy-loading 'migration_context' on Instance uuid a3282525-9822-4be9-8ef1-c213392c6267 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG nova.network.neutron [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Ensure instance console log exists: /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d97e05-3311-4372-90d7-b07004369a4d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.network.neutron [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Updating instance_info_cache with network_info: [{"id": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "address": "fa:16:3e:2e:7e:05", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce35860-fb", "ovs_interfaceid": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Releasing lock "refresh_cache-a3282525-9822-4be9-8ef1-c213392c6267" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.compute.manager [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Instance network_info: |[{"id": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "address": "fa:16:3e:2e:7e:05", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce35860-fb", "ovs_interfaceid": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b56294c0-e4e7-44a7-9e21-46d4db8f6a9f req-62a1d5c8-bcee-4f51-9f7e-415d0ba0df53 service nova] Acquired lock "refresh_cache-a3282525-9822-4be9-8ef1-c213392c6267" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.network.neutron [req-b56294c0-e4e7-44a7-9e21-46d4db8f6a9f req-62a1d5c8-bcee-4f51-9f7e-415d0ba0df53 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Refreshing network info cache for port 7ce35860-fbe8-4c2b-9697-bf867ebe5b39 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Start _get_guest_xml network_info=[{"id": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "address": "fa:16:3e:2e:7e:05", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce35860-fb", "ovs_interfaceid": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:56:49Z,direct_url=<?>,disk_format='qcow2',id=7e9f7742-c3f5-492c-b4c8-212072532633,min_disk=0,min_ram=0,name='tempest-scenario-img--103638006',owner='1934a2112a584b82a20c4ae8c13a70db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:56:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '7e9f7742-c3f5-492c-b4c8-212072532633'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:56:55 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:56:55 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:56:49Z,direct_url=<?>,disk_format='qcow2',id=7e9f7742-c3f5-492c-b4c8-212072532633,min_disk=0,min_ram=0,name='tempest-scenario-img--103638006',owner='1934a2112a584b82a20c4ae8c13a70db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:56:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:56:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1008126369',display_name='tempest-TestMinimumBasicScenario-server-1008126369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1008126369',id=38,image_ref='7e9f7742-c3f5-492c-b4c8-212072532633',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4a8pn3Vvu6dQiHnUjxe5S47vZZcNV7BZnNmiXptsYleB+jhejPspwALEfKvnpz0zOvOfgUo98QUeJ8MA0+PLeMfsNuk9i0SCfN25RGVr1raXPMKT0/tB3wEblrXP1NQA==',key_name='tempest-TestMinimumBasicScenario-229925239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1934a2112a584b82a20c4ae8c13a70db',ramdisk_id='',reservation_id='r-dafyuxae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7e9f7742-c3f5-492c-b4c8-212072532633',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-227652473',owner_user_name='tempest-TestMinimumBasicScenario-227652473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:56:52Z,user_data=None,user_id='be2ee7c7641d4d0892cc3bc03f8340f1',uuid=a3282525-9822-4be9-8ef1-c213392c6267,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "address": "fa:16:3e:2e:7e:05", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce35860-fb", "ovs_interfaceid": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Converting VIF {"id": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "address": "fa:16:3e:2e:7e:05", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce35860-fb", "ovs_interfaceid": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:7e:05,bridge_name='br-int',has_traffic_filtering=True,id=7ce35860-fbe8-4c2b-9697-bf867ebe5b39,network=Network(b63f0a71-864e-4b2c-9602-fd57c50c5501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce35860-fb') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.objects.instance [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lazy-loading 'pci_devices' on Instance uuid a3282525-9822-4be9-8ef1-c213392c6267 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:56:55 user nova-compute[73484]:   <uuid>a3282525-9822-4be9-8ef1-c213392c6267</uuid>
Aug 14 13:56:55 user nova-compute[73484]:   <name>instance-00000026</name>
Aug 14 13:56:55 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:56:55 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:56:55 user nova-compute[73484]:   <metadata>
Aug 14 13:56:55 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:56:55 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:56:55 user nova-compute[73484]:       <nova:name>tempest-TestMinimumBasicScenario-server-1008126369</nova:name>
Aug 14 13:56:55 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:56:55</nova:creationTime>
Aug 14 13:56:55 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:56:55 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:56:55 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:56:55 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:56:55 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:56:55 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:56:55 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:56:55 user nova-compute[73484]:       <nova:owner>
Aug 14 13:56:55 user nova-compute[73484]:         <nova:user uuid="be2ee7c7641d4d0892cc3bc03f8340f1">tempest-TestMinimumBasicScenario-227652473-project-member</nova:user>
Aug 14 13:56:55 user nova-compute[73484]:         <nova:project uuid="1934a2112a584b82a20c4ae8c13a70db">tempest-TestMinimumBasicScenario-227652473</nova:project>
Aug 14 13:56:55 user nova-compute[73484]:       </nova:owner>
Aug 14 13:56:55 user nova-compute[73484]:       <nova:root type="image" uuid="7e9f7742-c3f5-492c-b4c8-212072532633"/>
Aug 14 13:56:55 user nova-compute[73484]:       <nova:ports>
Aug 14 13:56:55 user nova-compute[73484]:         <nova:port uuid="7ce35860-fbe8-4c2b-9697-bf867ebe5b39">
Aug 14 13:56:55 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 13:56:55 user nova-compute[73484]:         </nova:port>
Aug 14 13:56:55 user nova-compute[73484]:       </nova:ports>
Aug 14 13:56:55 user nova-compute[73484]:     </nova:instance>
Aug 14 13:56:55 user nova-compute[73484]:   </metadata>
Aug 14 13:56:55 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:56:55 user nova-compute[73484]:     <system>
Aug 14 13:56:55 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:56:55 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:56:55 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:56:55 user nova-compute[73484]:       <entry name="serial">a3282525-9822-4be9-8ef1-c213392c6267</entry>
Aug 14 13:56:55 user nova-compute[73484]:       <entry name="uuid">a3282525-9822-4be9-8ef1-c213392c6267</entry>
Aug 14 13:56:55 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:56:55 user nova-compute[73484]:     </system>
Aug 14 13:56:55 user nova-compute[73484]:   </sysinfo>
Aug 14 13:56:55 user nova-compute[73484]:   <os>
Aug 14 13:56:55 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:56:55 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:56:55 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:56:55 user nova-compute[73484]:   </os>
Aug 14 13:56:55 user nova-compute[73484]:   <features>
Aug 14 13:56:55 user nova-compute[73484]:     <acpi/>
Aug 14 13:56:55 user nova-compute[73484]:     <apic/>
Aug 14 13:56:55 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:56:55 user nova-compute[73484]:   </features>
Aug 14 13:56:55 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:56:55 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:56:55 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:56:55 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:56:55 user nova-compute[73484]:   </clock>
Aug 14 13:56:55 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:56:55 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:56:55 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:56:55 user nova-compute[73484]:   </cpu>
Aug 14 13:56:55 user nova-compute[73484]:   <devices>
Aug 14 13:56:55 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:56:55 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:56:55 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk"/>
Aug 14 13:56:55 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:56:55 user nova-compute[73484]:     </disk>
Aug 14 13:56:55 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:56:55 user nova-compute[73484]:       <mac address="fa:16:3e:2e:7e:05"/>
Aug 14 13:56:55 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:56:55 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:56:55 user nova-compute[73484]:       <target dev="tap7ce35860-fb"/>
Aug 14 13:56:55 user nova-compute[73484]:     </interface>
Aug 14 13:56:55 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:56:55 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/console.log" append="off"/>
Aug 14 13:56:55 user nova-compute[73484]:     </serial>
Aug 14 13:56:55 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:56:55 user nova-compute[73484]:     <video>
Aug 14 13:56:55 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:56:55 user nova-compute[73484]:     </video>
Aug 14 13:56:55 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:56:55 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:56:55 user nova-compute[73484]:     </rng>
Aug 14 13:56:55 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:56:55 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:56:55 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:56:55 user nova-compute[73484]:     </memballoon>
Aug 14 13:56:55 user nova-compute[73484]:   </devices>
Aug 14 13:56:55 user nova-compute[73484]: </domain>
Aug 14 13:56:55 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:56:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1008126369',display_name='tempest-TestMinimumBasicScenario-server-1008126369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1008126369',id=38,image_ref='7e9f7742-c3f5-492c-b4c8-212072532633',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4a8pn3Vvu6dQiHnUjxe5S47vZZcNV7BZnNmiXptsYleB+jhejPspwALEfKvnpz0zOvOfgUo98QUeJ8MA0+PLeMfsNuk9i0SCfN25RGVr1raXPMKT0/tB3wEblrXP1NQA==',key_name='tempest-TestMinimumBasicScenario-229925239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1934a2112a584b82a20c4ae8c13a70db',ramdisk_id='',reservation_id='r-dafyuxae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7e9f7742-c3f5-492c-b4c8-212072532633',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-227652473',owner_user_name='tempest-TestMinimumBasicScenario-227652473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:56:52Z,user_data=None,user_id='be2ee7c7641d4d0892cc3bc03f8340f1',uuid=a3282525-9822-4be9-8ef1-c213392c6267,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "address": "fa:16:3e:2e:7e:05", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce35860-fb", "ovs_interfaceid": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Converting VIF {"id": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "address": "fa:16:3e:2e:7e:05", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce35860-fb", "ovs_interfaceid": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:7e:05,bridge_name='br-int',has_traffic_filtering=True,id=7ce35860-fbe8-4c2b-9697-bf867ebe5b39,network=Network(b63f0a71-864e-4b2c-9602-fd57c50c5501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce35860-fb') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG os_vif [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:7e:05,bridge_name='br-int',has_traffic_filtering=True,id=7ce35860-fbe8-4c2b-9697-bf867ebe5b39,network=Network(b63f0a71-864e-4b2c-9602-fd57c50c5501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce35860-fb') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ce35860-fb, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7ce35860-fb, col_values=(('external_ids', {'iface-id': '7ce35860-fbe8-4c2b-9697-bf867ebe5b39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:7e:05', 'vm-uuid': 'a3282525-9822-4be9-8ef1-c213392c6267'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42273739-c086-4cc7-a6c8-10710b16f794/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:56:55 user nova-compute[73484]: INFO os_vif [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:7e:05,bridge_name='br-int',has_traffic_filtering=True,id=7ce35860-fbe8-4c2b-9697-bf867ebe5b39,network=Network(b63f0a71-864e-4b2c-9602-fd57c50c5501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce35860-fb')
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] No VIF found with MAC fa:16:3e:2e:7e:05, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42273739-c086-4cc7-a6c8-10710b16f794/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42273739-c086-4cc7-a6c8-10710b16f794/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42273739-c086-4cc7-a6c8-10710b16f794/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.network.neutron [req-b56294c0-e4e7-44a7-9e21-46d4db8f6a9f req-62a1d5c8-bcee-4f51-9f7e-415d0ba0df53 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Updated VIF entry in instance network info cache for port 7ce35860-fbe8-4c2b-9697-bf867ebe5b39. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.network.neutron [req-b56294c0-e4e7-44a7-9e21-46d4db8f6a9f req-62a1d5c8-bcee-4f51-9f7e-415d0ba0df53 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Updating instance_info_cache with network_info: [{"id": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "address": "fa:16:3e:2e:7e:05", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce35860-fb", "ovs_interfaceid": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b56294c0-e4e7-44a7-9e21-46d4db8f6a9f req-62a1d5c8-bcee-4f51-9f7e-415d0ba0df53 service nova] Releasing lock "refresh_cache-a3282525-9822-4be9-8ef1-c213392c6267" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:56:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:56:56 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:56:56 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:56:56 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=7960MB free_disk=25.159038543701172GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 13:56:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:56 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 782c6142-757a-49ae-9292-787a7f1e8a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:56:56 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 03255d24-b6fd-459c-8ac6-f9c4063b54b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:56:56 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance b8a790d0-e5d0-4b78-8de4-36a58290b4ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:56:56 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 14999671-dcc7-43fa-85ec-21cbcf12d21e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:56:56 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 42273739-c086-4cc7-a6c8-10710b16f794 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:56:56 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance b6d97e05-3311-4372-90d7-b07004369a4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:56:56 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance a3282525-9822-4be9-8ef1-c213392c6267 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:56:56 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 13:56:56 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 13:56:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:56 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:56:56 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:56:56 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 13:56:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.467s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:56 user nova-compute[73484]: DEBUG nova.compute.manager [req-02675726-ca8a-4198-99eb-4ec2665126ae req-12a252d9-9d93-4a39-82fb-c8fc926ba96f service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Received event network-vif-plugged-7ce35860-fbe8-4c2b-9697-bf867ebe5b39 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:56:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-02675726-ca8a-4198-99eb-4ec2665126ae req-12a252d9-9d93-4a39-82fb-c8fc926ba96f service nova] Acquiring lock "a3282525-9822-4be9-8ef1-c213392c6267-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-02675726-ca8a-4198-99eb-4ec2665126ae req-12a252d9-9d93-4a39-82fb-c8fc926ba96f service nova] Lock "a3282525-9822-4be9-8ef1-c213392c6267-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-02675726-ca8a-4198-99eb-4ec2665126ae req-12a252d9-9d93-4a39-82fb-c8fc926ba96f service nova] Lock "a3282525-9822-4be9-8ef1-c213392c6267-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:56 user nova-compute[73484]: DEBUG nova.compute.manager [req-02675726-ca8a-4198-99eb-4ec2665126ae req-12a252d9-9d93-4a39-82fb-c8fc926ba96f service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] No waiting events found dispatching network-vif-plugged-7ce35860-fbe8-4c2b-9697-bf867ebe5b39 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:56:56 user nova-compute[73484]: WARNING nova.compute.manager [req-02675726-ca8a-4198-99eb-4ec2665126ae req-12a252d9-9d93-4a39-82fb-c8fc926ba96f service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Received unexpected event network-vif-plugged-7ce35860-fbe8-4c2b-9697-bf867ebe5b39 for instance with vm_state building and task_state spawning.
Aug 14 13:56:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:56:57 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:56:57 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:56:58 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:56:58 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:56:58 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021418.8459253, a3282525-9822-4be9-8ef1-c213392c6267 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:56:58 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a3282525-9822-4be9-8ef1-c213392c6267] VM Resumed (Lifecycle Event)
Aug 14 13:56:58 user nova-compute[73484]: DEBUG nova.compute.manager [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:56:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:56:58 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Instance spawned successfully.
Aug 14 13:56:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:56:58 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:56:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:56:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:56:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:56:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:56:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:56:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:56:58 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:56:58 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a3282525-9822-4be9-8ef1-c213392c6267] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:56:58 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021418.847135, a3282525-9822-4be9-8ef1-c213392c6267 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:56:58 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a3282525-9822-4be9-8ef1-c213392c6267] VM Started (Lifecycle Event)
Aug 14 13:56:58 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:56:58 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:56:58 user nova-compute[73484]: INFO nova.compute.manager [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Took 6.47 seconds to spawn the instance on the hypervisor.
Aug 14 13:56:58 user nova-compute[73484]: DEBUG nova.compute.manager [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:56:58 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a3282525-9822-4be9-8ef1-c213392c6267] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:56:59 user nova-compute[73484]: DEBUG nova.compute.manager [req-588fd1fb-2362-4201-822d-d08f5cba4974 req-7ef29d8a-bf3b-4063-9b45-66c0a79dee2c service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Received event network-vif-plugged-7ce35860-fbe8-4c2b-9697-bf867ebe5b39 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:56:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-588fd1fb-2362-4201-822d-d08f5cba4974 req-7ef29d8a-bf3b-4063-9b45-66c0a79dee2c service nova] Acquiring lock "a3282525-9822-4be9-8ef1-c213392c6267-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:56:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-588fd1fb-2362-4201-822d-d08f5cba4974 req-7ef29d8a-bf3b-4063-9b45-66c0a79dee2c service nova] Lock "a3282525-9822-4be9-8ef1-c213392c6267-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:56:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-588fd1fb-2362-4201-822d-d08f5cba4974 req-7ef29d8a-bf3b-4063-9b45-66c0a79dee2c service nova] Lock "a3282525-9822-4be9-8ef1-c213392c6267-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:59 user nova-compute[73484]: DEBUG nova.compute.manager [req-588fd1fb-2362-4201-822d-d08f5cba4974 req-7ef29d8a-bf3b-4063-9b45-66c0a79dee2c service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] No waiting events found dispatching network-vif-plugged-7ce35860-fbe8-4c2b-9697-bf867ebe5b39 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:56:59 user nova-compute[73484]: WARNING nova.compute.manager [req-588fd1fb-2362-4201-822d-d08f5cba4974 req-7ef29d8a-bf3b-4063-9b45-66c0a79dee2c service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Received unexpected event network-vif-plugged-7ce35860-fbe8-4c2b-9697-bf867ebe5b39 for instance with vm_state building and task_state spawning.
Aug 14 13:56:59 user nova-compute[73484]: INFO nova.compute.manager [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Took 7.21 seconds to build instance.
Aug 14 13:56:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f1cc2f20-7024-4e79-865b-a8d56473470d tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "a3282525-9822-4be9-8ef1-c213392c6267" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.303s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:56:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e78b2835-ce98-4ce1-80d4-f0ee9cbec8f4 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "42273739-c086-4cc7-a6c8-10710b16f794" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:57:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e78b2835-ce98-4ce1-80d4-f0ee9cbec8f4 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "42273739-c086-4cc7-a6c8-10710b16f794" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:57:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e78b2835-ce98-4ce1-80d4-f0ee9cbec8f4 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "42273739-c086-4cc7-a6c8-10710b16f794-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:57:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e78b2835-ce98-4ce1-80d4-f0ee9cbec8f4 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "42273739-c086-4cc7-a6c8-10710b16f794-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:57:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e78b2835-ce98-4ce1-80d4-f0ee9cbec8f4 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "42273739-c086-4cc7-a6c8-10710b16f794-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:57:15 user nova-compute[73484]: INFO nova.compute.manager [None req-e78b2835-ce98-4ce1-80d4-f0ee9cbec8f4 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Terminating instance
Aug 14 13:57:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-e78b2835-ce98-4ce1-80d4-f0ee9cbec8f4 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:57:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:16 user nova-compute[73484]: DEBUG nova.compute.manager [req-36373fae-9b5f-4c8f-a46c-3432be9a6dcf req-62b3d648-36c4-4dfc-8a48-c3df95a33e33 service nova] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Received event network-vif-unplugged-e74d5355-d919-48fe-9355-918c02f38dd8 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:57:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-36373fae-9b5f-4c8f-a46c-3432be9a6dcf req-62b3d648-36c4-4dfc-8a48-c3df95a33e33 service nova] Acquiring lock "42273739-c086-4cc7-a6c8-10710b16f794-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:57:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-36373fae-9b5f-4c8f-a46c-3432be9a6dcf req-62b3d648-36c4-4dfc-8a48-c3df95a33e33 service nova] Lock "42273739-c086-4cc7-a6c8-10710b16f794-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:57:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-36373fae-9b5f-4c8f-a46c-3432be9a6dcf req-62b3d648-36c4-4dfc-8a48-c3df95a33e33 service nova] Lock "42273739-c086-4cc7-a6c8-10710b16f794-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:57:16 user nova-compute[73484]: DEBUG nova.compute.manager [req-36373fae-9b5f-4c8f-a46c-3432be9a6dcf req-62b3d648-36c4-4dfc-8a48-c3df95a33e33 service nova] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] No waiting events found dispatching network-vif-unplugged-e74d5355-d919-48fe-9355-918c02f38dd8 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:57:16 user nova-compute[73484]: DEBUG nova.compute.manager [req-36373fae-9b5f-4c8f-a46c-3432be9a6dcf req-62b3d648-36c4-4dfc-8a48-c3df95a33e33 service nova] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Received event network-vif-unplugged-e74d5355-d919-48fe-9355-918c02f38dd8 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 13:57:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:16 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Instance destroyed successfully.
Aug 14 13:57:16 user nova-compute[73484]: DEBUG nova.objects.instance [None req-e78b2835-ce98-4ce1-80d4-f0ee9cbec8f4 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lazy-loading 'resources' on Instance uuid 42273739-c086-4cc7-a6c8-10710b16f794 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:57:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-e78b2835-ce98-4ce1-80d4-f0ee9cbec8f4 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-453751482',display_name='tempest-AttachVolumeNegativeTest-server-453751482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-453751482',id=36,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcedXJDha79sUX6ccwZgCYbf70iiVn05qrZpDAtndKACMVHvJcmBrhdHhLFaaD971eVkQP/udRhiGMKgqjuzhmsjKaB4MsvdeEYg8/jNQHKwz2YxRDGSsZPJ5UhI6SoTQ==',key_name='tempest-keypair-694000823',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:54:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f404795fcace4922a10abdb33740e87d',ramdisk_id='',reservation_id='r-uaftuxg6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1043074889',owner_user_name='tempest-AttachVolumeNegativeTest-1043074889-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:54:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3ccc9cc867644d9bc040e9dfd4eb231',uuid=42273739-c086-4cc7-a6c8-10710b16f794,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e74d5355-d919-48fe-9355-918c02f38dd8", "address": "fa:16:3e:fd:d0:83", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape74d5355-d9", "ovs_interfaceid": "e74d5355-d919-48fe-9355-918c02f38dd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:57:16 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-e78b2835-ce98-4ce1-80d4-f0ee9cbec8f4 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Converting VIF {"id": "e74d5355-d919-48fe-9355-918c02f38dd8", "address": "fa:16:3e:fd:d0:83", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape74d5355-d9", "ovs_interfaceid": "e74d5355-d919-48fe-9355-918c02f38dd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:57:16 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-e78b2835-ce98-4ce1-80d4-f0ee9cbec8f4 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:d0:83,bridge_name='br-int',has_traffic_filtering=True,id=e74d5355-d919-48fe-9355-918c02f38dd8,network=Network(10d4738f-25c6-4995-a4b7-6fbee86f070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape74d5355-d9') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:57:16 user nova-compute[73484]: DEBUG os_vif [None req-e78b2835-ce98-4ce1-80d4-f0ee9cbec8f4 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:d0:83,bridge_name='br-int',has_traffic_filtering=True,id=e74d5355-d919-48fe-9355-918c02f38dd8,network=Network(10d4738f-25c6-4995-a4b7-6fbee86f070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape74d5355-d9') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:57:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape74d5355-d9, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:57:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:57:16 user nova-compute[73484]: INFO os_vif [None req-e78b2835-ce98-4ce1-80d4-f0ee9cbec8f4 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:d0:83,bridge_name='br-int',has_traffic_filtering=True,id=e74d5355-d919-48fe-9355-918c02f38dd8,network=Network(10d4738f-25c6-4995-a4b7-6fbee86f070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape74d5355-d9')
Aug 14 13:57:16 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-e78b2835-ce98-4ce1-80d4-f0ee9cbec8f4 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Deleting instance files /opt/stack/data/nova/instances/42273739-c086-4cc7-a6c8-10710b16f794_del
Aug 14 13:57:16 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-e78b2835-ce98-4ce1-80d4-f0ee9cbec8f4 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Deletion of /opt/stack/data/nova/instances/42273739-c086-4cc7-a6c8-10710b16f794_del complete
Aug 14 13:57:16 user nova-compute[73484]: INFO nova.compute.manager [None req-e78b2835-ce98-4ce1-80d4-f0ee9cbec8f4 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 14 13:57:16 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-e78b2835-ce98-4ce1-80d4-f0ee9cbec8f4 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:57:16 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:57:16 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:57:18 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:57:18 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Took 1.43 seconds to deallocate network for instance.
Aug 14 13:57:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-c13de52a-8d3d-4a85-b8b3-46cfe436475a req-dadcd5ba-65c7-4c33-9c59-a561503fa16a service nova] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Received event network-vif-deleted-e74d5355-d919-48fe-9355-918c02f38dd8 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:57:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e78b2835-ce98-4ce1-80d4-f0ee9cbec8f4 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:57:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e78b2835-ce98-4ce1-80d4-f0ee9cbec8f4 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:57:18 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-e78b2835-ce98-4ce1-80d4-f0ee9cbec8f4 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:57:18 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-e78b2835-ce98-4ce1-80d4-f0ee9cbec8f4 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:57:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e78b2835-ce98-4ce1-80d4-f0ee9cbec8f4 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.257s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:57:18 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-e78b2835-ce98-4ce1-80d4-f0ee9cbec8f4 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Deleted allocations for instance 42273739-c086-4cc7-a6c8-10710b16f794
Aug 14 13:57:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-1b7289e3-9ff1-4a01-adcf-376c207c8e6c req-187e3eaf-ca33-4f2a-a3d7-ebbdecf25bf4 service nova] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Received event network-vif-plugged-e74d5355-d919-48fe-9355-918c02f38dd8 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:57:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1b7289e3-9ff1-4a01-adcf-376c207c8e6c req-187e3eaf-ca33-4f2a-a3d7-ebbdecf25bf4 service nova] Acquiring lock "42273739-c086-4cc7-a6c8-10710b16f794-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:57:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1b7289e3-9ff1-4a01-adcf-376c207c8e6c req-187e3eaf-ca33-4f2a-a3d7-ebbdecf25bf4 service nova] Lock "42273739-c086-4cc7-a6c8-10710b16f794-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:57:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1b7289e3-9ff1-4a01-adcf-376c207c8e6c req-187e3eaf-ca33-4f2a-a3d7-ebbdecf25bf4 service nova] Lock "42273739-c086-4cc7-a6c8-10710b16f794-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:57:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-1b7289e3-9ff1-4a01-adcf-376c207c8e6c req-187e3eaf-ca33-4f2a-a3d7-ebbdecf25bf4 service nova] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] No waiting events found dispatching network-vif-plugged-e74d5355-d919-48fe-9355-918c02f38dd8 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:57:18 user nova-compute[73484]: WARNING nova.compute.manager [req-1b7289e3-9ff1-4a01-adcf-376c207c8e6c req-187e3eaf-ca33-4f2a-a3d7-ebbdecf25bf4 service nova] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Received unexpected event network-vif-plugged-e74d5355-d919-48fe-9355-918c02f38dd8 for instance with vm_state deleted and task_state None.
Aug 14 13:57:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e78b2835-ce98-4ce1-80d4-f0ee9cbec8f4 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "42273739-c086-4cc7-a6c8-10710b16f794" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.772s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:57:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:31 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692021436.7014298, 42273739-c086-4cc7-a6c8-10710b16f794 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:57:31 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] VM Stopped (Lifecycle Event)
Aug 14 13:57:31 user nova-compute[73484]: DEBUG nova.compute.manager [None req-7529e22e-21ef-495b-a691-30fd41a64a1e None None] [instance: 42273739-c086-4cc7-a6c8-10710b16f794] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:57:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:41 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:45 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:57:45 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 13:57:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-03255d24-b6fd-459c-8ac6-f9c4063b54b2" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:57:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-03255d24-b6fd-459c-8ac6-f9c4063b54b2" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:57:46 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 13:57:46 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Updating instance_info_cache with network_info: [{"id": "be08ca28-6a00-468c-9988-87185f498ca3", "address": "fa:16:3e:66:27:2e", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe08ca28-6a", "ovs_interfaceid": "be08ca28-6a00-468c-9988-87185f498ca3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:57:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-03255d24-b6fd-459c-8ac6-f9c4063b54b2" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:57:46 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 13:57:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:57:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 13:57:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:57:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:57:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:47 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:57:50 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:57:50 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:57:50 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73484) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 13:57:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:51 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:57:51 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:57:51 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 13:57:53 user nova-compute[73484]: INFO nova.compute.manager [None req-2241c1da-e263-4ca8-b465-4e1dc4d42f0a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Unrescuing
Aug 14 13:57:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2241c1da-e263-4ca8-b465-4e1dc4d42f0a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "refresh_cache-14999671-dcc7-43fa-85ec-21cbcf12d21e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:57:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2241c1da-e263-4ca8-b465-4e1dc4d42f0a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquired lock "refresh_cache-14999671-dcc7-43fa-85ec-21cbcf12d21e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:57:53 user nova-compute[73484]: DEBUG nova.network.neutron [None req-2241c1da-e263-4ca8-b465-4e1dc4d42f0a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:57:54 user nova-compute[73484]: DEBUG nova.network.neutron [None req-2241c1da-e263-4ca8-b465-4e1dc4d42f0a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Updating instance_info_cache with network_info: [{"id": "0259d05a-9595-41f7-839d-28df692755fb", "address": "fa:16:3e:d5:7f:13", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0259d05a-95", "ovs_interfaceid": "0259d05a-9595-41f7-839d-28df692755fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:57:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2241c1da-e263-4ca8-b465-4e1dc4d42f0a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Releasing lock "refresh_cache-14999671-dcc7-43fa-85ec-21cbcf12d21e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:57:54 user nova-compute[73484]: DEBUG nova.objects.instance [None req-2241c1da-e263-4ca8-b465-4e1dc4d42f0a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'flavor' on Instance uuid 14999671-dcc7-43fa-85ec-21cbcf12d21e {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:57:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:54 user nova-compute[73484]: DEBUG nova.compute.manager [req-d4902347-5de0-4c7b-ba05-6cc08b5a5a63 req-d555baef-e915-4bcc-ab6f-b468f4dfb2c7 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Received event network-vif-unplugged-0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:57:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d4902347-5de0-4c7b-ba05-6cc08b5a5a63 req-d555baef-e915-4bcc-ab6f-b468f4dfb2c7 service nova] Acquiring lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:57:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d4902347-5de0-4c7b-ba05-6cc08b5a5a63 req-d555baef-e915-4bcc-ab6f-b468f4dfb2c7 service nova] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:57:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d4902347-5de0-4c7b-ba05-6cc08b5a5a63 req-d555baef-e915-4bcc-ab6f-b468f4dfb2c7 service nova] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:57:54 user nova-compute[73484]: DEBUG nova.compute.manager [req-d4902347-5de0-4c7b-ba05-6cc08b5a5a63 req-d555baef-e915-4bcc-ab6f-b468f4dfb2c7 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] No waiting events found dispatching network-vif-unplugged-0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:57:54 user nova-compute[73484]: WARNING nova.compute.manager [req-d4902347-5de0-4c7b-ba05-6cc08b5a5a63 req-d555baef-e915-4bcc-ab6f-b468f4dfb2c7 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Received unexpected event network-vif-unplugged-0259d05a-9595-41f7-839d-28df692755fb for instance with vm_state rescued and task_state unrescuing.
Aug 14 13:57:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:54 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:57:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:57:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:57:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:57:54 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 13:57:54 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Instance destroyed successfully.
Aug 14 13:57:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:56 user nova-compute[73484]: DEBUG nova.compute.manager [req-43fc6f3f-db21-4ac4-83d3-ce21846de203 req-b83109b1-37f7-495f-afa7-789a9703d857 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Received event network-vif-plugged-0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:57:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-43fc6f3f-db21-4ac4-83d3-ce21846de203 req-b83109b1-37f7-495f-afa7-789a9703d857 service nova] Acquiring lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:57:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-43fc6f3f-db21-4ac4-83d3-ce21846de203 req-b83109b1-37f7-495f-afa7-789a9703d857 service nova] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:57:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-43fc6f3f-db21-4ac4-83d3-ce21846de203 req-b83109b1-37f7-495f-afa7-789a9703d857 service nova] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:57:56 user nova-compute[73484]: DEBUG nova.compute.manager [req-43fc6f3f-db21-4ac4-83d3-ce21846de203 req-b83109b1-37f7-495f-afa7-789a9703d857 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] No waiting events found dispatching network-vif-plugged-0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:57:56 user nova-compute[73484]: WARNING nova.compute.manager [req-43fc6f3f-db21-4ac4-83d3-ce21846de203 req-b83109b1-37f7-495f-afa7-789a9703d857 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Received unexpected event network-vif-plugged-0259d05a-9595-41f7-839d-28df692755fb for instance with vm_state rescued and task_state unrescuing.
Aug 14 13:57:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:57:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:57:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:57:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:57:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:57:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:57:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:57:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:57:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:57:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:57:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:57:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:57:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:57:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d97e05-3311-4372-90d7-b07004369a4d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:57:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d97e05-3311-4372-90d7-b07004369a4d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:57:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d97e05-3311-4372-90d7-b07004369a4d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:57:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d97e05-3311-4372-90d7-b07004369a4d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:57:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:57:58 user nova-compute[73484]: DEBUG nova.compute.manager [None req-2241c1da-e263-4ca8-b465-4e1dc4d42f0a tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:57:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Removed pending event for 14999671-dcc7-43fa-85ec-21cbcf12d21e due to event {{(pid=73484) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 13:57:58 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021478.501697, 14999671-dcc7-43fa-85ec-21cbcf12d21e => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:57:58 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] VM Resumed (Lifecycle Event)
Aug 14 13:57:58 user nova-compute[73484]: DEBUG nova.compute.manager [req-799b6429-9e2b-487a-93b1-189eeff309ac req-74e89a48-6220-4ede-92d7-78110141cb61 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Received event network-vif-plugged-0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:57:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-799b6429-9e2b-487a-93b1-189eeff309ac req-74e89a48-6220-4ede-92d7-78110141cb61 service nova] Acquiring lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:57:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-799b6429-9e2b-487a-93b1-189eeff309ac req-74e89a48-6220-4ede-92d7-78110141cb61 service nova] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:57:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-799b6429-9e2b-487a-93b1-189eeff309ac req-74e89a48-6220-4ede-92d7-78110141cb61 service nova] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:57:58 user nova-compute[73484]: DEBUG nova.compute.manager [req-799b6429-9e2b-487a-93b1-189eeff309ac req-74e89a48-6220-4ede-92d7-78110141cb61 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] No waiting events found dispatching network-vif-plugged-0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:57:58 user nova-compute[73484]: WARNING nova.compute.manager [req-799b6429-9e2b-487a-93b1-189eeff309ac req-74e89a48-6220-4ede-92d7-78110141cb61 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Received unexpected event network-vif-plugged-0259d05a-9595-41f7-839d-28df692755fb for instance with vm_state rescued and task_state unrescuing.
Aug 14 13:57:58 user nova-compute[73484]: DEBUG nova.compute.manager [req-799b6429-9e2b-487a-93b1-189eeff309ac req-74e89a48-6220-4ede-92d7-78110141cb61 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Received event network-vif-plugged-0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:57:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-799b6429-9e2b-487a-93b1-189eeff309ac req-74e89a48-6220-4ede-92d7-78110141cb61 service nova] Acquiring lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:57:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-799b6429-9e2b-487a-93b1-189eeff309ac req-74e89a48-6220-4ede-92d7-78110141cb61 service nova] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:57:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-799b6429-9e2b-487a-93b1-189eeff309ac req-74e89a48-6220-4ede-92d7-78110141cb61 service nova] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:57:58 user nova-compute[73484]: DEBUG nova.compute.manager [req-799b6429-9e2b-487a-93b1-189eeff309ac req-74e89a48-6220-4ede-92d7-78110141cb61 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] No waiting events found dispatching network-vif-plugged-0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:57:58 user nova-compute[73484]: WARNING nova.compute.manager [req-799b6429-9e2b-487a-93b1-189eeff309ac req-74e89a48-6220-4ede-92d7-78110141cb61 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Received unexpected event network-vif-plugged-0259d05a-9595-41f7-839d-28df692755fb for instance with vm_state rescued and task_state unrescuing.
Aug 14 13:57:58 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:57:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:57:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:57:58 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:57:58 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 13:57:58 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021478.502021, 14999671-dcc7-43fa-85ec-21cbcf12d21e => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:57:58 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] VM Started (Lifecycle Event)
Aug 14 13:57:58 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:57:58 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:57:58 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 13:57:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:57:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:57:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:57:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:57:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:57:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:57:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:57:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:57:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:57:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:58:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:00 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:58:00 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:58:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=8114MB free_disk=25.137645721435547GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 13:58:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:58:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:58:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 782c6142-757a-49ae-9292-787a7f1e8a23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:58:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 03255d24-b6fd-459c-8ac6-f9c4063b54b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:58:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance b8a790d0-e5d0-4b78-8de4-36a58290b4ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:58:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 14999671-dcc7-43fa-85ec-21cbcf12d21e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:58:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance b6d97e05-3311-4372-90d7-b07004369a4d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:58:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance a3282525-9822-4be9-8ef1-c213392c6267 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:58:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 13:58:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 13:58:00 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Refreshing inventories for resource provider 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 13:58:00 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Updating ProviderTree inventory for provider 165d4635-93b4-49a6-879a-21c1324822ab from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 13:58:00 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Updating inventory in ProviderTree for provider 165d4635-93b4-49a6-879a-21c1324822ab with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 13:58:00 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Refreshing aggregate associations for resource provider 165d4635-93b4-49a6-879a-21c1324822ab, aggregates: None {{(pid=73484) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 13:58:00 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Refreshing trait associations for resource provider 165d4635-93b4-49a6-879a-21c1324822ab, traits: COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS {{(pid=73484) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 13:58:00 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:58:00 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:58:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 13:58:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.693s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:58:00 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:58:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:01 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:58:01 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:58:01 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:58:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:05 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:58:05 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Cleaning up deleted instances {{(pid=73484) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 13:58:05 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] There are 0 instances to clean {{(pid=73484) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 13:58:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:07 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:08 user nova-compute[73484]: DEBUG nova.compute.manager [req-f363b759-f8c6-4039-88e6-b96b01e17285 req-0f47638c-a923-406e-ba18-cee3b8bb6ea0 service nova] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Received event network-changed-6fded38c-518a-453c-93db-d64ceebab4ba {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:58:08 user nova-compute[73484]: DEBUG nova.compute.manager [req-f363b759-f8c6-4039-88e6-b96b01e17285 req-0f47638c-a923-406e-ba18-cee3b8bb6ea0 service nova] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Refreshing instance network info cache due to event network-changed-6fded38c-518a-453c-93db-d64ceebab4ba. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:58:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f363b759-f8c6-4039-88e6-b96b01e17285 req-0f47638c-a923-406e-ba18-cee3b8bb6ea0 service nova] Acquiring lock "refresh_cache-b6d97e05-3311-4372-90d7-b07004369a4d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:58:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f363b759-f8c6-4039-88e6-b96b01e17285 req-0f47638c-a923-406e-ba18-cee3b8bb6ea0 service nova] Acquired lock "refresh_cache-b6d97e05-3311-4372-90d7-b07004369a4d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:58:08 user nova-compute[73484]: DEBUG nova.network.neutron [req-f363b759-f8c6-4039-88e6-b96b01e17285 req-0f47638c-a923-406e-ba18-cee3b8bb6ea0 service nova] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Refreshing network info cache for port 6fded38c-518a-453c-93db-d64ceebab4ba {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:58:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquiring lock "b6d97e05-3311-4372-90d7-b07004369a4d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:58:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "b6d97e05-3311-4372-90d7-b07004369a4d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:58:09 user nova-compute[73484]: DEBUG nova.objects.instance [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lazy-loading 'flavor' on Instance uuid b6d97e05-3311-4372-90d7-b07004369a4d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:58:09 user nova-compute[73484]: DEBUG nova.network.neutron [req-f363b759-f8c6-4039-88e6-b96b01e17285 req-0f47638c-a923-406e-ba18-cee3b8bb6ea0 service nova] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Updated VIF entry in instance network info cache for port 6fded38c-518a-453c-93db-d64ceebab4ba. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:58:09 user nova-compute[73484]: DEBUG nova.network.neutron [req-f363b759-f8c6-4039-88e6-b96b01e17285 req-0f47638c-a923-406e-ba18-cee3b8bb6ea0 service nova] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Updating instance_info_cache with network_info: [{"id": "6fded38c-518a-453c-93db-d64ceebab4ba", "address": "fa:16:3e:db:9d:8f", "network": {"id": "8f719ef2-7286-46f1-96e0-d08fd389db0e", "bridge": "br-int", "label": "tempest-TestStampPattern-1811054691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a442b6e525b4ae9ba256aa1c71e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fded38c-51", "ovs_interfaceid": "6fded38c-518a-453c-93db-d64ceebab4ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:58:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "b6d97e05-3311-4372-90d7-b07004369a4d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:58:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f363b759-f8c6-4039-88e6-b96b01e17285 req-0f47638c-a923-406e-ba18-cee3b8bb6ea0 service nova] Releasing lock "refresh_cache-b6d97e05-3311-4372-90d7-b07004369a4d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:58:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquiring lock "b6d97e05-3311-4372-90d7-b07004369a4d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:58:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "b6d97e05-3311-4372-90d7-b07004369a4d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:58:09 user nova-compute[73484]: INFO nova.compute.manager [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Attaching volume c9b10526-68fd-428c-95a5-7e9ee6d1ab0c to /dev/vdb
Aug 14 13:58:09 user nova-compute[73484]: DEBUG os_brick.utils [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:58:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05de615-a310-4a50-8493-fb0b3b0eee88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d9681f-5251-4282-842b-60eac7f2f573]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[70152cfd-04ab-4b55-960c-b39c251a2af3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf03af3-1823-49c1-ae26-5f526e60de65]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:58:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:58:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:58:09 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:58:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd516bc0-7f24-4214-8788-e165e45c64ec]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:58:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:58:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:58:09 user nova-compute[73484]: DEBUG os_brick.utils [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:58:09 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Updating existing volume attachment record: 045366e8-0b46-4b95-9745-677be3066b3e {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:58:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "165b7234-2b91-482a-8532-5fc41e481e1e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:58:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "165b7234-2b91-482a-8532-5fc41e481e1e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:58:11 user nova-compute[73484]: DEBUG nova.compute.manager [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:58:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:58:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:58:11 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:58:11 user nova-compute[73484]: INFO nova.compute.claims [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Claim successful on node user
Aug 14 13:58:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:11 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:58:11 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:58:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:58:11 user nova-compute[73484]: DEBUG nova.compute.manager [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:58:12 user nova-compute[73484]: DEBUG nova.compute.manager [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:58:12 user nova-compute[73484]: DEBUG nova.network.neutron [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:58:12 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:58:12 user nova-compute[73484]: DEBUG nova.compute.manager [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:58:12 user nova-compute[73484]: DEBUG nova.compute.manager [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:58:12 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:58:12 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Creating image(s)
Aug 14 13:58:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "/opt/stack/data/nova/instances/165b7234-2b91-482a-8532-5fc41e481e1e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:58:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "/opt/stack/data/nova/instances/165b7234-2b91-482a-8532-5fc41e481e1e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:58:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "/opt/stack/data/nova/instances/165b7234-2b91-482a-8532-5fc41e481e1e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:58:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:12 user nova-compute[73484]: DEBUG nova.policy [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3ccc9cc867644d9bc040e9dfd4eb231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404795fcace4922a10abdb33740e87d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:58:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.192s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:58:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:58:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.198s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/165b7234-2b91-482a-8532-5fc41e481e1e/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/165b7234-2b91-482a-8532-5fc41e481e1e/disk 1073741824" returned: 0 in 0.066s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:58:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.218s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:12 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Checking if we can resize image /opt/stack/data/nova/instances/165b7234-2b91-482a-8532-5fc41e481e1e/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:58:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/165b7234-2b91-482a-8532-5fc41e481e1e/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Acquiring lock "75ff316d-3957-421c-9b55-1744fc7d4cce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:58:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "75ff316d-3957-421c-9b55-1744fc7d4cce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:58:12 user nova-compute[73484]: DEBUG nova.compute.manager [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:58:13 user nova-compute[73484]: DEBUG nova.network.neutron [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Successfully created port: 253e674d-b55e-4d07-a5f1-833901a27e9b {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:58:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:58:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:58:13 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:58:13 user nova-compute[73484]: INFO nova.compute.claims [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Claim successful on node user
Aug 14 13:58:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/165b7234-2b91-482a-8532-5fc41e481e1e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:13 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Cannot resize image /opt/stack/data/nova/instances/165b7234-2b91-482a-8532-5fc41e481e1e/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:58:13 user nova-compute[73484]: DEBUG nova.objects.instance [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lazy-loading 'migration_context' on Instance uuid 165b7234-2b91-482a-8532-5fc41e481e1e {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:58:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:58:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Ensure instance console log exists: /opt/stack/data/nova/instances/165b7234-2b91-482a-8532-5fc41e481e1e/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:58:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:58:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:58:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:58:13 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:58:13 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:58:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:58:13 user nova-compute[73484]: DEBUG nova.compute.manager [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:58:13 user nova-compute[73484]: DEBUG nova.compute.manager [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:58:13 user nova-compute[73484]: DEBUG nova.network.neutron [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:58:13 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:58:13 user nova-compute[73484]: DEBUG nova.compute.manager [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:58:13 user nova-compute[73484]: DEBUG nova.compute.manager [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:58:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:58:13 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Creating image(s)
Aug 14 13:58:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Acquiring lock "/opt/stack/data/nova/instances/75ff316d-3957-421c-9b55-1744fc7d4cce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:58:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "/opt/stack/data/nova/instances/75ff316d-3957-421c-9b55-1744fc7d4cce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:58:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "/opt/stack/data/nova/instances/75ff316d-3957-421c-9b55-1744fc7d4cce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:58:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:13 user nova-compute[73484]: DEBUG nova.policy [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '948dcb0982b745659f53c0d4d9a68a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3a83ee8b254c66a0b9904abf8c65c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:58:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.187s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:58:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:58:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:13 user nova-compute[73484]: DEBUG nova.network.neutron [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Successfully updated port: 253e674d-b55e-4d07-a5f1-833901a27e9b {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "refresh_cache-165b7234-2b91-482a-8532-5fc41e481e1e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquired lock "refresh_cache-165b7234-2b91-482a-8532-5fc41e481e1e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.network.neutron [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.compute.manager [req-dd84d727-d664-4657-b073-a5f2167cf94a req-ec7ca95f-c399-4e5d-aa0c-3a89f14b4358 service nova] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Received event network-changed-253e674d-b55e-4d07-a5f1-833901a27e9b {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.compute.manager [req-dd84d727-d664-4657-b073-a5f2167cf94a req-ec7ca95f-c399-4e5d-aa0c-3a89f14b4358 service nova] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Refreshing instance network info cache due to event network-changed-253e674d-b55e-4d07-a5f1-833901a27e9b. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-dd84d727-d664-4657-b073-a5f2167cf94a req-ec7ca95f-c399-4e5d-aa0c-3a89f14b4358 service nova] Acquiring lock "refresh_cache-165b7234-2b91-482a-8532-5fc41e481e1e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.197s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/75ff316d-3957-421c-9b55-1744fc7d4cce/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.network.neutron [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/75ff316d-3957-421c-9b55-1744fc7d4cce/disk 1073741824" returned: 0 in 0.079s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.173s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Checking if we can resize image /opt/stack/data/nova/instances/75ff316d-3957-421c-9b55-1744fc7d4cce/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75ff316d-3957-421c-9b55-1744fc7d4cce/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75ff316d-3957-421c-9b55-1744fc7d4cce/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Cannot resize image /opt/stack/data/nova/instances/75ff316d-3957-421c-9b55-1744fc7d4cce/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.objects.instance [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lazy-loading 'migration_context' on Instance uuid 75ff316d-3957-421c-9b55-1744fc7d4cce {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Ensure instance console log exists: /opt/stack/data/nova/instances/75ff316d-3957-421c-9b55-1744fc7d4cce/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.network.neutron [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Updating instance_info_cache with network_info: [{"id": "253e674d-b55e-4d07-a5f1-833901a27e9b", "address": "fa:16:3e:d1:78:40", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap253e674d-b5", "ovs_interfaceid": "253e674d-b55e-4d07-a5f1-833901a27e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Releasing lock "refresh_cache-165b7234-2b91-482a-8532-5fc41e481e1e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Instance network_info: |[{"id": "253e674d-b55e-4d07-a5f1-833901a27e9b", "address": "fa:16:3e:d1:78:40", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap253e674d-b5", "ovs_interfaceid": "253e674d-b55e-4d07-a5f1-833901a27e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-dd84d727-d664-4657-b073-a5f2167cf94a req-ec7ca95f-c399-4e5d-aa0c-3a89f14b4358 service nova] Acquired lock "refresh_cache-165b7234-2b91-482a-8532-5fc41e481e1e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.network.neutron [req-dd84d727-d664-4657-b073-a5f2167cf94a req-ec7ca95f-c399-4e5d-aa0c-3a89f14b4358 service nova] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Refreshing network info cache for port 253e674d-b55e-4d07-a5f1-833901a27e9b {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Start _get_guest_xml network_info=[{"id": "253e674d-b55e-4d07-a5f1-833901a27e9b", "address": "fa:16:3e:d1:78:40", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap253e674d-b5", "ovs_interfaceid": "253e674d-b55e-4d07-a5f1-833901a27e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.network.neutron [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Successfully created port: acdc4fd3-cd24-470a-b845-f4893b062cb1 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:14 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:58:14 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-597269201',display_name='tempest-AttachVolumeNegativeTest-server-597269201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-597269201',id=39,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIg6PQPPMHr6jqpnyCtzBmMxyYfjkkSXQp8Big2Tz0hSb08D3ZVXlj7lnZedTel/MPVwZLRBoJS/Ox2NHM3OWtvZiLBG9EJ42YfIfn+kiVYqht2pFJVpRlukSQaQ0/z6rQ==',key_name='tempest-keypair-2033658647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f404795fcace4922a10abdb33740e87d',ramdisk_id='',reservation_id='r-cqz4a0ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1043074889',owner_user_name='tempest-AttachVolumeNegativeTest-1043074889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:58:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3ccc9cc867644d9bc040e9dfd4eb231',uuid=165b7234-2b91-482a-8532-5fc41e481e1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "253e674d-b55e-4d07-a5f1-833901a27e9b", "address": "fa:16:3e:d1:78:40", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap253e674d-b5", "ovs_interfaceid": "253e674d-b55e-4d07-a5f1-833901a27e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Converting VIF {"id": "253e674d-b55e-4d07-a5f1-833901a27e9b", "address": "fa:16:3e:d1:78:40", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap253e674d-b5", "ovs_interfaceid": "253e674d-b55e-4d07-a5f1-833901a27e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:78:40,bridge_name='br-int',has_traffic_filtering=True,id=253e674d-b55e-4d07-a5f1-833901a27e9b,network=Network(10d4738f-25c6-4995-a4b7-6fbee86f070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap253e674d-b5') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.objects.instance [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lazy-loading 'pci_devices' on Instance uuid 165b7234-2b91-482a-8532-5fc41e481e1e {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:58:14 user nova-compute[73484]:   <uuid>165b7234-2b91-482a-8532-5fc41e481e1e</uuid>
Aug 14 13:58:14 user nova-compute[73484]:   <name>instance-00000027</name>
Aug 14 13:58:14 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:58:14 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:58:14 user nova-compute[73484]:   <metadata>
Aug 14 13:58:14 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:58:14 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:58:14 user nova-compute[73484]:       <nova:name>tempest-AttachVolumeNegativeTest-server-597269201</nova:name>
Aug 14 13:58:14 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:58:14</nova:creationTime>
Aug 14 13:58:14 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:58:14 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:58:14 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:58:14 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:58:14 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:58:14 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:58:14 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:58:14 user nova-compute[73484]:       <nova:owner>
Aug 14 13:58:14 user nova-compute[73484]:         <nova:user uuid="b3ccc9cc867644d9bc040e9dfd4eb231">tempest-AttachVolumeNegativeTest-1043074889-project-member</nova:user>
Aug 14 13:58:14 user nova-compute[73484]:         <nova:project uuid="f404795fcace4922a10abdb33740e87d">tempest-AttachVolumeNegativeTest-1043074889</nova:project>
Aug 14 13:58:14 user nova-compute[73484]:       </nova:owner>
Aug 14 13:58:14 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:58:14 user nova-compute[73484]:       <nova:ports>
Aug 14 13:58:14 user nova-compute[73484]:         <nova:port uuid="253e674d-b55e-4d07-a5f1-833901a27e9b">
Aug 14 13:58:14 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 13:58:14 user nova-compute[73484]:         </nova:port>
Aug 14 13:58:14 user nova-compute[73484]:       </nova:ports>
Aug 14 13:58:14 user nova-compute[73484]:     </nova:instance>
Aug 14 13:58:14 user nova-compute[73484]:   </metadata>
Aug 14 13:58:14 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:58:14 user nova-compute[73484]:     <system>
Aug 14 13:58:14 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:58:14 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:58:14 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:58:14 user nova-compute[73484]:       <entry name="serial">165b7234-2b91-482a-8532-5fc41e481e1e</entry>
Aug 14 13:58:14 user nova-compute[73484]:       <entry name="uuid">165b7234-2b91-482a-8532-5fc41e481e1e</entry>
Aug 14 13:58:14 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:58:14 user nova-compute[73484]:     </system>
Aug 14 13:58:14 user nova-compute[73484]:   </sysinfo>
Aug 14 13:58:14 user nova-compute[73484]:   <os>
Aug 14 13:58:14 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:58:14 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:58:14 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:58:14 user nova-compute[73484]:   </os>
Aug 14 13:58:14 user nova-compute[73484]:   <features>
Aug 14 13:58:14 user nova-compute[73484]:     <acpi/>
Aug 14 13:58:14 user nova-compute[73484]:     <apic/>
Aug 14 13:58:14 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:58:14 user nova-compute[73484]:   </features>
Aug 14 13:58:14 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:58:14 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:58:14 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:58:14 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:58:14 user nova-compute[73484]:   </clock>
Aug 14 13:58:14 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:58:14 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:58:14 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:58:14 user nova-compute[73484]:   </cpu>
Aug 14 13:58:14 user nova-compute[73484]:   <devices>
Aug 14 13:58:14 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:58:14 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:58:14 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/165b7234-2b91-482a-8532-5fc41e481e1e/disk"/>
Aug 14 13:58:14 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:58:14 user nova-compute[73484]:     </disk>
Aug 14 13:58:14 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:58:14 user nova-compute[73484]:       <mac address="fa:16:3e:d1:78:40"/>
Aug 14 13:58:14 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:58:14 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:58:14 user nova-compute[73484]:       <target dev="tap253e674d-b5"/>
Aug 14 13:58:14 user nova-compute[73484]:     </interface>
Aug 14 13:58:14 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:58:14 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/165b7234-2b91-482a-8532-5fc41e481e1e/console.log" append="off"/>
Aug 14 13:58:14 user nova-compute[73484]:     </serial>
Aug 14 13:58:14 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:58:14 user nova-compute[73484]:     <video>
Aug 14 13:58:14 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:58:14 user nova-compute[73484]:     </video>
Aug 14 13:58:14 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:58:14 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:58:14 user nova-compute[73484]:     </rng>
Aug 14 13:58:14 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:58:14 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:58:14 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:58:14 user nova-compute[73484]:     </memballoon>
Aug 14 13:58:14 user nova-compute[73484]:   </devices>
Aug 14 13:58:14 user nova-compute[73484]: </domain>
Aug 14 13:58:14 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-597269201',display_name='tempest-AttachVolumeNegativeTest-server-597269201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-597269201',id=39,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIg6PQPPMHr6jqpnyCtzBmMxyYfjkkSXQp8Big2Tz0hSb08D3ZVXlj7lnZedTel/MPVwZLRBoJS/Ox2NHM3OWtvZiLBG9EJ42YfIfn+kiVYqht2pFJVpRlukSQaQ0/z6rQ==',key_name='tempest-keypair-2033658647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f404795fcace4922a10abdb33740e87d',ramdisk_id='',reservation_id='r-cqz4a0ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1043074889',owner_user_name='tempest-AttachVolumeNegativeTest-1043074889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:58:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3ccc9cc867644d9bc040e9dfd4eb231',uuid=165b7234-2b91-482a-8532-5fc41e481e1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "253e674d-b55e-4d07-a5f1-833901a27e9b", "address": "fa:16:3e:d1:78:40", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap253e674d-b5", "ovs_interfaceid": "253e674d-b55e-4d07-a5f1-833901a27e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Converting VIF {"id": "253e674d-b55e-4d07-a5f1-833901a27e9b", "address": "fa:16:3e:d1:78:40", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap253e674d-b5", "ovs_interfaceid": "253e674d-b55e-4d07-a5f1-833901a27e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:78:40,bridge_name='br-int',has_traffic_filtering=True,id=253e674d-b55e-4d07-a5f1-833901a27e9b,network=Network(10d4738f-25c6-4995-a4b7-6fbee86f070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap253e674d-b5') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG os_vif [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:78:40,bridge_name='br-int',has_traffic_filtering=True,id=253e674d-b55e-4d07-a5f1-833901a27e9b,network=Network(10d4738f-25c6-4995-a4b7-6fbee86f070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap253e674d-b5') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap253e674d-b5, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap253e674d-b5, col_values=(('external_ids', {'iface-id': '253e674d-b55e-4d07-a5f1-833901a27e9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:78:40', 'vm-uuid': '165b7234-2b91-482a-8532-5fc41e481e1e'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:58:14 user nova-compute[73484]: INFO os_vif [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:78:40,bridge_name='br-int',has_traffic_filtering=True,id=253e674d-b55e-4d07-a5f1-833901a27e9b,network=Network(10d4738f-25c6-4995-a4b7-6fbee86f070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap253e674d-b5')
Aug 14 13:58:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:58:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] No VIF found with MAC fa:16:3e:d1:78:40, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:58:15 user nova-compute[73484]: DEBUG nova.network.neutron [req-dd84d727-d664-4657-b073-a5f2167cf94a req-ec7ca95f-c399-4e5d-aa0c-3a89f14b4358 service nova] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Updated VIF entry in instance network info cache for port 253e674d-b55e-4d07-a5f1-833901a27e9b. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:58:15 user nova-compute[73484]: DEBUG nova.network.neutron [req-dd84d727-d664-4657-b073-a5f2167cf94a req-ec7ca95f-c399-4e5d-aa0c-3a89f14b4358 service nova] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Updating instance_info_cache with network_info: [{"id": "253e674d-b55e-4d07-a5f1-833901a27e9b", "address": "fa:16:3e:d1:78:40", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap253e674d-b5", "ovs_interfaceid": "253e674d-b55e-4d07-a5f1-833901a27e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:58:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-dd84d727-d664-4657-b073-a5f2167cf94a req-ec7ca95f-c399-4e5d-aa0c-3a89f14b4358 service nova] Releasing lock "refresh_cache-165b7234-2b91-482a-8532-5fc41e481e1e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.network.neutron [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Successfully updated port: acdc4fd3-cd24-470a-b845-f4893b062cb1 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Acquiring lock "refresh_cache-75ff316d-3957-421c-9b55-1744fc7d4cce" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Acquired lock "refresh_cache-75ff316d-3957-421c-9b55-1744fc7d4cce" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.network.neutron [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.compute.manager [req-d6e7f171-13fd-43cd-b3e3-71c385d8d473 req-4330a2ad-d4ed-4432-b751-c0c39006b975 service nova] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Received event network-changed-acdc4fd3-cd24-470a-b845-f4893b062cb1 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.compute.manager [req-d6e7f171-13fd-43cd-b3e3-71c385d8d473 req-4330a2ad-d4ed-4432-b751-c0c39006b975 service nova] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Refreshing instance network info cache due to event network-changed-acdc4fd3-cd24-470a-b845-f4893b062cb1. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d6e7f171-13fd-43cd-b3e3-71c385d8d473 req-4330a2ad-d4ed-4432-b751-c0c39006b975 service nova] Acquiring lock "refresh_cache-75ff316d-3957-421c-9b55-1744fc7d4cce" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.network.neutron [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.network.neutron [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Updating instance_info_cache with network_info: [{"id": "acdc4fd3-cd24-470a-b845-f4893b062cb1", "address": "fa:16:3e:9a:6a:ec", "network": {"id": "0579994b-5b06-4838-87f7-e83438382cdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419510355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3a83ee8b254c66a0b9904abf8c65c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacdc4fd3-cd", "ovs_interfaceid": "acdc4fd3-cd24-470a-b845-f4893b062cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Releasing lock "refresh_cache-75ff316d-3957-421c-9b55-1744fc7d4cce" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.compute.manager [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Instance network_info: |[{"id": "acdc4fd3-cd24-470a-b845-f4893b062cb1", "address": "fa:16:3e:9a:6a:ec", "network": {"id": "0579994b-5b06-4838-87f7-e83438382cdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419510355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3a83ee8b254c66a0b9904abf8c65c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacdc4fd3-cd", "ovs_interfaceid": "acdc4fd3-cd24-470a-b845-f4893b062cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d6e7f171-13fd-43cd-b3e3-71c385d8d473 req-4330a2ad-d4ed-4432-b751-c0c39006b975 service nova] Acquired lock "refresh_cache-75ff316d-3957-421c-9b55-1744fc7d4cce" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.network.neutron [req-d6e7f171-13fd-43cd-b3e3-71c385d8d473 req-4330a2ad-d4ed-4432-b751-c0c39006b975 service nova] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Refreshing network info cache for port acdc4fd3-cd24-470a-b845-f4893b062cb1 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Start _get_guest_xml network_info=[{"id": "acdc4fd3-cd24-470a-b845-f4893b062cb1", "address": "fa:16:3e:9a:6a:ec", "network": {"id": "0579994b-5b06-4838-87f7-e83438382cdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419510355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3a83ee8b254c66a0b9904abf8c65c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacdc4fd3-cd", "ovs_interfaceid": "acdc4fd3-cd24-470a-b845-f4893b062cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:58:16 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:58:16 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:58:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1538035053',display_name='tempest-VolumesActionsTest-instance-1538035053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1538035053',id=40,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a3a83ee8b254c66a0b9904abf8c65c5',ramdisk_id='',reservation_id='r-najilewt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1293487514',owner_user_name='tempest-VolumesActionsTest-1293487514-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:58:14Z,user_data=None,user_id='948dcb0982b745659f53c0d4d9a68a07',uuid=75ff316d-3957-421c-9b55-1744fc7d4cce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acdc4fd3-cd24-470a-b845-f4893b062cb1", "address": "fa:16:3e:9a:6a:ec", "network": {"id": "0579994b-5b06-4838-87f7-e83438382cdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419510355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3a83ee8b254c66a0b9904abf8c65c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacdc4fd3-cd", "ovs_interfaceid": "acdc4fd3-cd24-470a-b845-f4893b062cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Converting VIF {"id": "acdc4fd3-cd24-470a-b845-f4893b062cb1", "address": "fa:16:3e:9a:6a:ec", "network": {"id": "0579994b-5b06-4838-87f7-e83438382cdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419510355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3a83ee8b254c66a0b9904abf8c65c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacdc4fd3-cd", "ovs_interfaceid": "acdc4fd3-cd24-470a-b845-f4893b062cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:6a:ec,bridge_name='br-int',has_traffic_filtering=True,id=acdc4fd3-cd24-470a-b845-f4893b062cb1,network=Network(0579994b-5b06-4838-87f7-e83438382cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacdc4fd3-cd') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.objects.instance [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lazy-loading 'pci_devices' on Instance uuid 75ff316d-3957-421c-9b55-1744fc7d4cce {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.compute.manager [req-0555cf83-8cbc-4de5-a74d-8ff50b4a5079 req-a8ef6aa2-4d27-4d3e-a6e1-1f8d21595847 service nova] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Received event network-vif-plugged-253e674d-b55e-4d07-a5f1-833901a27e9b {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0555cf83-8cbc-4de5-a74d-8ff50b4a5079 req-a8ef6aa2-4d27-4d3e-a6e1-1f8d21595847 service nova] Acquiring lock "165b7234-2b91-482a-8532-5fc41e481e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0555cf83-8cbc-4de5-a74d-8ff50b4a5079 req-a8ef6aa2-4d27-4d3e-a6e1-1f8d21595847 service nova] Lock "165b7234-2b91-482a-8532-5fc41e481e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0555cf83-8cbc-4de5-a74d-8ff50b4a5079 req-a8ef6aa2-4d27-4d3e-a6e1-1f8d21595847 service nova] Lock "165b7234-2b91-482a-8532-5fc41e481e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.compute.manager [req-0555cf83-8cbc-4de5-a74d-8ff50b4a5079 req-a8ef6aa2-4d27-4d3e-a6e1-1f8d21595847 service nova] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] No waiting events found dispatching network-vif-plugged-253e674d-b55e-4d07-a5f1-833901a27e9b {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:58:16 user nova-compute[73484]: WARNING nova.compute.manager [req-0555cf83-8cbc-4de5-a74d-8ff50b4a5079 req-a8ef6aa2-4d27-4d3e-a6e1-1f8d21595847 service nova] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Received unexpected event network-vif-plugged-253e674d-b55e-4d07-a5f1-833901a27e9b for instance with vm_state building and task_state spawning.
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:58:16 user nova-compute[73484]:   <uuid>75ff316d-3957-421c-9b55-1744fc7d4cce</uuid>
Aug 14 13:58:16 user nova-compute[73484]:   <name>instance-00000028</name>
Aug 14 13:58:16 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:58:16 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:58:16 user nova-compute[73484]:   <metadata>
Aug 14 13:58:16 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:58:16 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:58:16 user nova-compute[73484]:       <nova:name>tempest-VolumesActionsTest-instance-1538035053</nova:name>
Aug 14 13:58:16 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:58:16</nova:creationTime>
Aug 14 13:58:16 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:58:16 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:58:16 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:58:16 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:58:16 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:58:16 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:58:16 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:58:16 user nova-compute[73484]:       <nova:owner>
Aug 14 13:58:16 user nova-compute[73484]:         <nova:user uuid="948dcb0982b745659f53c0d4d9a68a07">tempest-VolumesActionsTest-1293487514-project-member</nova:user>
Aug 14 13:58:16 user nova-compute[73484]:         <nova:project uuid="8a3a83ee8b254c66a0b9904abf8c65c5">tempest-VolumesActionsTest-1293487514</nova:project>
Aug 14 13:58:16 user nova-compute[73484]:       </nova:owner>
Aug 14 13:58:16 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:58:16 user nova-compute[73484]:       <nova:ports>
Aug 14 13:58:16 user nova-compute[73484]:         <nova:port uuid="acdc4fd3-cd24-470a-b845-f4893b062cb1">
Aug 14 13:58:16 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 13:58:16 user nova-compute[73484]:         </nova:port>
Aug 14 13:58:16 user nova-compute[73484]:       </nova:ports>
Aug 14 13:58:16 user nova-compute[73484]:     </nova:instance>
Aug 14 13:58:16 user nova-compute[73484]:   </metadata>
Aug 14 13:58:16 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:58:16 user nova-compute[73484]:     <system>
Aug 14 13:58:16 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:58:16 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:58:16 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:58:16 user nova-compute[73484]:       <entry name="serial">75ff316d-3957-421c-9b55-1744fc7d4cce</entry>
Aug 14 13:58:16 user nova-compute[73484]:       <entry name="uuid">75ff316d-3957-421c-9b55-1744fc7d4cce</entry>
Aug 14 13:58:16 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:58:16 user nova-compute[73484]:     </system>
Aug 14 13:58:16 user nova-compute[73484]:   </sysinfo>
Aug 14 13:58:16 user nova-compute[73484]:   <os>
Aug 14 13:58:16 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:58:16 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:58:16 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:58:16 user nova-compute[73484]:   </os>
Aug 14 13:58:16 user nova-compute[73484]:   <features>
Aug 14 13:58:16 user nova-compute[73484]:     <acpi/>
Aug 14 13:58:16 user nova-compute[73484]:     <apic/>
Aug 14 13:58:16 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:58:16 user nova-compute[73484]:   </features>
Aug 14 13:58:16 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:58:16 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:58:16 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:58:16 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:58:16 user nova-compute[73484]:   </clock>
Aug 14 13:58:16 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:58:16 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:58:16 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:58:16 user nova-compute[73484]:   </cpu>
Aug 14 13:58:16 user nova-compute[73484]:   <devices>
Aug 14 13:58:16 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:58:16 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:58:16 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/75ff316d-3957-421c-9b55-1744fc7d4cce/disk"/>
Aug 14 13:58:16 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:58:16 user nova-compute[73484]:     </disk>
Aug 14 13:58:16 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:58:16 user nova-compute[73484]:       <mac address="fa:16:3e:9a:6a:ec"/>
Aug 14 13:58:16 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:58:16 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:58:16 user nova-compute[73484]:       <target dev="tapacdc4fd3-cd"/>
Aug 14 13:58:16 user nova-compute[73484]:     </interface>
Aug 14 13:58:16 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:58:16 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/75ff316d-3957-421c-9b55-1744fc7d4cce/console.log" append="off"/>
Aug 14 13:58:16 user nova-compute[73484]:     </serial>
Aug 14 13:58:16 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:58:16 user nova-compute[73484]:     <video>
Aug 14 13:58:16 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:58:16 user nova-compute[73484]:     </video>
Aug 14 13:58:16 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:58:16 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:58:16 user nova-compute[73484]:     </rng>
Aug 14 13:58:16 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:58:16 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:58:16 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:58:16 user nova-compute[73484]:     </memballoon>
Aug 14 13:58:16 user nova-compute[73484]:   </devices>
Aug 14 13:58:16 user nova-compute[73484]: </domain>
Aug 14 13:58:16 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:58:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1538035053',display_name='tempest-VolumesActionsTest-instance-1538035053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1538035053',id=40,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a3a83ee8b254c66a0b9904abf8c65c5',ramdisk_id='',reservation_id='r-najilewt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1293487514',owner_user_name='tempest-VolumesActionsTest-1293487514-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:58:14Z,user_data=None,user_id='948dcb0982b745659f53c0d4d9a68a07',uuid=75ff316d-3957-421c-9b55-1744fc7d4cce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acdc4fd3-cd24-470a-b845-f4893b062cb1", "address": "fa:16:3e:9a:6a:ec", "network": {"id": "0579994b-5b06-4838-87f7-e83438382cdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419510355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3a83ee8b254c66a0b9904abf8c65c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacdc4fd3-cd", "ovs_interfaceid": "acdc4fd3-cd24-470a-b845-f4893b062cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Converting VIF {"id": "acdc4fd3-cd24-470a-b845-f4893b062cb1", "address": "fa:16:3e:9a:6a:ec", "network": {"id": "0579994b-5b06-4838-87f7-e83438382cdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419510355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3a83ee8b254c66a0b9904abf8c65c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacdc4fd3-cd", "ovs_interfaceid": "acdc4fd3-cd24-470a-b845-f4893b062cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:6a:ec,bridge_name='br-int',has_traffic_filtering=True,id=acdc4fd3-cd24-470a-b845-f4893b062cb1,network=Network(0579994b-5b06-4838-87f7-e83438382cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacdc4fd3-cd') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG os_vif [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:6a:ec,bridge_name='br-int',has_traffic_filtering=True,id=acdc4fd3-cd24-470a-b845-f4893b062cb1,network=Network(0579994b-5b06-4838-87f7-e83438382cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacdc4fd3-cd') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapacdc4fd3-cd, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapacdc4fd3-cd, col_values=(('external_ids', {'iface-id': 'acdc4fd3-cd24-470a-b845-f4893b062cb1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:6a:ec', 'vm-uuid': '75ff316d-3957-421c-9b55-1744fc7d4cce'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:16 user nova-compute[73484]: INFO os_vif [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:6a:ec,bridge_name='br-int',has_traffic_filtering=True,id=acdc4fd3-cd24-470a-b845-f4893b062cb1,network=Network(0579994b-5b06-4838-87f7-e83438382cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacdc4fd3-cd')
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:58:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] No VIF found with MAC fa:16:3e:9a:6a:ec, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:58:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:17 user nova-compute[73484]: DEBUG nova.network.neutron [req-d6e7f171-13fd-43cd-b3e3-71c385d8d473 req-4330a2ad-d4ed-4432-b751-c0c39006b975 service nova] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Updated VIF entry in instance network info cache for port acdc4fd3-cd24-470a-b845-f4893b062cb1. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:58:17 user nova-compute[73484]: DEBUG nova.network.neutron [req-d6e7f171-13fd-43cd-b3e3-71c385d8d473 req-4330a2ad-d4ed-4432-b751-c0c39006b975 service nova] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Updating instance_info_cache with network_info: [{"id": "acdc4fd3-cd24-470a-b845-f4893b062cb1", "address": "fa:16:3e:9a:6a:ec", "network": {"id": "0579994b-5b06-4838-87f7-e83438382cdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419510355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3a83ee8b254c66a0b9904abf8c65c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacdc4fd3-cd", "ovs_interfaceid": "acdc4fd3-cd24-470a-b845-f4893b062cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:58:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d6e7f171-13fd-43cd-b3e3-71c385d8d473 req-4330a2ad-d4ed-4432-b751-c0c39006b975 service nova] Releasing lock "refresh_cache-75ff316d-3957-421c-9b55-1744fc7d4cce" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:58:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-dc5571a2-2c7c-43cd-bc6b-e7559d2fbf04 req-74ece0e0-c5ef-4e10-9819-c8ffd79ba22d service nova] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Received event network-vif-plugged-acdc4fd3-cd24-470a-b845-f4893b062cb1 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:58:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-dc5571a2-2c7c-43cd-bc6b-e7559d2fbf04 req-74ece0e0-c5ef-4e10-9819-c8ffd79ba22d service nova] Acquiring lock "75ff316d-3957-421c-9b55-1744fc7d4cce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:58:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-dc5571a2-2c7c-43cd-bc6b-e7559d2fbf04 req-74ece0e0-c5ef-4e10-9819-c8ffd79ba22d service nova] Lock "75ff316d-3957-421c-9b55-1744fc7d4cce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:58:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-dc5571a2-2c7c-43cd-bc6b-e7559d2fbf04 req-74ece0e0-c5ef-4e10-9819-c8ffd79ba22d service nova] Lock "75ff316d-3957-421c-9b55-1744fc7d4cce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:58:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-dc5571a2-2c7c-43cd-bc6b-e7559d2fbf04 req-74ece0e0-c5ef-4e10-9819-c8ffd79ba22d service nova] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] No waiting events found dispatching network-vif-plugged-acdc4fd3-cd24-470a-b845-f4893b062cb1 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:58:18 user nova-compute[73484]: WARNING nova.compute.manager [req-dc5571a2-2c7c-43cd-bc6b-e7559d2fbf04 req-74ece0e0-c5ef-4e10-9819-c8ffd79ba22d service nova] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Received unexpected event network-vif-plugged-acdc4fd3-cd24-470a-b845-f4893b062cb1 for instance with vm_state building and task_state spawning.
Aug 14 13:58:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-407921d3-e8b4-4522-9b28-34839151a31c req-14308a69-f2f3-4311-8a0b-c3a09bb8efd8 service nova] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Received event network-vif-plugged-253e674d-b55e-4d07-a5f1-833901a27e9b {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:58:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-407921d3-e8b4-4522-9b28-34839151a31c req-14308a69-f2f3-4311-8a0b-c3a09bb8efd8 service nova] Acquiring lock "165b7234-2b91-482a-8532-5fc41e481e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:58:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-407921d3-e8b4-4522-9b28-34839151a31c req-14308a69-f2f3-4311-8a0b-c3a09bb8efd8 service nova] Lock "165b7234-2b91-482a-8532-5fc41e481e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:58:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-407921d3-e8b4-4522-9b28-34839151a31c req-14308a69-f2f3-4311-8a0b-c3a09bb8efd8 service nova] Lock "165b7234-2b91-482a-8532-5fc41e481e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:58:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-407921d3-e8b4-4522-9b28-34839151a31c req-14308a69-f2f3-4311-8a0b-c3a09bb8efd8 service nova] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] No waiting events found dispatching network-vif-plugged-253e674d-b55e-4d07-a5f1-833901a27e9b {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:58:18 user nova-compute[73484]: WARNING nova.compute.manager [req-407921d3-e8b4-4522-9b28-34839151a31c req-14308a69-f2f3-4311-8a0b-c3a09bb8efd8 service nova] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Received unexpected event network-vif-plugged-253e674d-b55e-4d07-a5f1-833901a27e9b for instance with vm_state building and task_state spawning.
Aug 14 13:58:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:18 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021498.9609022, 165b7234-2b91-482a-8532-5fc41e481e1e => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:58:18 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] VM Resumed (Lifecycle Event)
Aug 14 13:58:18 user nova-compute[73484]: DEBUG nova.compute.manager [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:58:18 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:58:18 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Instance spawned successfully.
Aug 14 13:58:18 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:58:18 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bDWENAhr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:58:19 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:58:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:58:19 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:58:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:58:19 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:58:19 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:58:19 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:58:19 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021498.9649022, 165b7234-2b91-482a-8532-5fc41e481e1e => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:58:19 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] VM Started (Lifecycle Event)
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef01a2d0-91c7-49e3-ba76-844345fd2aee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:58:19 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[853a3086-4fc3-4e89-a30b-9fb5e2009203]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c] added
Aug 14 13:58:19 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:19 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.152s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3880064f-415d-4199-843d-93be5fe42b32]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:19 user nova-compute[73484]: INFO nova.compute.manager [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Took 7.08 seconds to spawn the instance on the hypervisor.
Aug 14 13:58:19 user nova-compute[73484]: DEBUG nova.compute.manager [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef273a2-8ea7-4320-b61f-574683cdc4a3]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bDWENAhr {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bDWENAhr" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8a2119-a731-4f59-b75d-45e6d79ee372]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bDWENAhr'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d751eec5-9274-44cd-8085-2b2d1831d8ba]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54a64ea-02bb-4a29-81c1-a91636bb1af0]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)
Aug 14 13:58:19 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)
Aug 14 13:58:19 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:19 user nova-compute[73484]: INFO nova.compute.manager [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Took 7.89 seconds to build instance.
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d9a73c5d-063f-4815-b378-be13f6e02318 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "165b7234-2b91-482a-8532-5fc41e481e1e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.098s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9081ba59-b75d-471c-818f-1b05ff5b876a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c, portal: 172.16.0.220,3260]
Aug 14 13:58:19 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c, portal: 172.16.0.220,3260] successful.
Aug 14 13:58:19 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51739d5-7157-4f5d-8701-08d3093137b3]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[525a1e9e-a79a-4d2a-9096-794f5be9f89e]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)
Aug 14 13:58:19 user nova-compute[73484]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c (non-flash)
Aug 14 13:58:19 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)
Aug 14 13:58:19 user nova-compute[73484]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c (non-flash)
Aug 14 13:58:19 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.445s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1a3241-78fe-4016-a0a7-e9160dad17d9]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: None {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:58:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:20 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021500.3689752, 75ff316d-3957-421c-9b55-1744fc7d4cce => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:58:20 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] VM Resumed (Lifecycle Event)
Aug 14 13:58:20 user nova-compute[73484]: DEBUG nova.compute.manager [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:58:20 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:58:20 user nova-compute[73484]: DEBUG nova.compute.manager [req-f68a385d-ad68-4dbc-b450-fdd477f85205 req-16a51e26-3314-4908-9029-df8497ae85ac service nova] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Received event network-vif-plugged-acdc4fd3-cd24-470a-b845-f4893b062cb1 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:58:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f68a385d-ad68-4dbc-b450-fdd477f85205 req-16a51e26-3314-4908-9029-df8497ae85ac service nova] Acquiring lock "75ff316d-3957-421c-9b55-1744fc7d4cce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:58:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f68a385d-ad68-4dbc-b450-fdd477f85205 req-16a51e26-3314-4908-9029-df8497ae85ac service nova] Lock "75ff316d-3957-421c-9b55-1744fc7d4cce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:58:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f68a385d-ad68-4dbc-b450-fdd477f85205 req-16a51e26-3314-4908-9029-df8497ae85ac service nova] Lock "75ff316d-3957-421c-9b55-1744fc7d4cce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:58:20 user nova-compute[73484]: DEBUG nova.compute.manager [req-f68a385d-ad68-4dbc-b450-fdd477f85205 req-16a51e26-3314-4908-9029-df8497ae85ac service nova] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] No waiting events found dispatching network-vif-plugged-acdc4fd3-cd24-470a-b845-f4893b062cb1 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:58:20 user nova-compute[73484]: WARNING nova.compute.manager [req-f68a385d-ad68-4dbc-b450-fdd477f85205 req-16a51e26-3314-4908-9029-df8497ae85ac service nova] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Received unexpected event network-vif-plugged-acdc4fd3-cd24-470a-b845-f4893b062cb1 for instance with vm_state building and task_state spawning.
Aug 14 13:58:20 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:58:20 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Instance spawned successfully.
Aug 14 13:58:20 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:58:20 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:58:20 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:58:20 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:58:20 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:58:20 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:58:20 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:58:20 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:58:20 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:58:20 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021500.371757, 75ff316d-3957-421c-9b55-1744fc7d4cce => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:58:20 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] VM Started (Lifecycle Event)
Aug 14 13:58:20 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:58:20 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:58:20 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:58:20 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bDWENAhr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:58:20 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.481s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:58:20 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] <== connect_volume: return (1482ms) {'type': 'block', 'scsi_wwn': '23630366532383666', 'path': '/dev/sdc'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:58:20 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630366532383666', 'path': '/dev/sdc'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:58:20 user nova-compute[73484]: DEBUG nova.objects.instance [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lazy-loading 'flavor' on Instance uuid b6d97e05-3311-4372-90d7-b07004369a4d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:58:20 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:58:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "79d07235-a6fb-48ea-b2be-c140461e0cbb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:58:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "79d07235-a6fb-48ea-b2be-c140461e0cbb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:58:20 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 13:58:20 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:58:20 user nova-compute[73484]:   <source dev="/dev/sdc"/>
Aug 14 13:58:20 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:58:20 user nova-compute[73484]:   <serial>c9b10526-68fd-428c-95a5-7e9ee6d1ab0c</serial>
Aug 14 13:58:20 user nova-compute[73484]: </disk>
Aug 14 13:58:20 user nova-compute[73484]:  {{(pid=73484) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 13:58:20 user nova-compute[73484]: DEBUG nova.compute.manager [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 13:58:20 user nova-compute[73484]: INFO nova.compute.manager [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Took 6.87 seconds to spawn the instance on the hypervisor.
Aug 14 13:58:20 user nova-compute[73484]: DEBUG nova.compute.manager [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:58:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:58:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:58:20 user nova-compute[73484]: INFO nova.compute.manager [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Took 7.68 seconds to build instance.
Aug 14 13:58:20 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 13:58:20 user nova-compute[73484]: INFO nova.compute.claims [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Claim successful on node user
Aug 14 13:58:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-819cfe27-52fc-4d99-aebc-a8c1e3e44a2f tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "75ff316d-3957-421c-9b55-1744fc7d4cce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.791s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:58:21 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:58:21 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:58:21 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:58:21 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] No VIF found with MAC fa:16:3e:db:9d:8f, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:58:21 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:58:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:58:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 13:58:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1bf33472-e01e-46ac-a13f-59acdecbcbcc tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "b6d97e05-3311-4372-90d7-b07004369a4d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.739s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:58:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 13:58:21 user nova-compute[73484]: DEBUG nova.network.neutron [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 13:58:21 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 13:58:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 13:58:21 user nova-compute[73484]: DEBUG nova.policy [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce08ff2ccf9940259c0beb5ba8aba5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4707f4d9cd47c2b988af4fdaf685ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 13:58:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 13:58:21 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 13:58:21 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Creating image(s)
Aug 14 13:58:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "/opt/stack/data/nova/instances/79d07235-a6fb-48ea-b2be-c140461e0cbb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:58:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "/opt/stack/data/nova/instances/79d07235-a6fb-48ea-b2be-c140461e0cbb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:58:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "/opt/stack/data/nova/instances/79d07235-a6fb-48ea-b2be-c140461e0cbb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:58:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.191s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:58:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:58:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.209s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/79d07235-a6fb-48ea-b2be-c140461e0cbb/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/79d07235-a6fb-48ea-b2be-c140461e0cbb/disk 1073741824" returned: 0 in 0.095s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:58:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:22 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.202s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:22 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Checking if we can resize image /opt/stack/data/nova/instances/79d07235-a6fb-48ea-b2be-c140461e0cbb/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:58:22 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79d07235-a6fb-48ea-b2be-c140461e0cbb/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:22 user nova-compute[73484]: DEBUG nova.network.neutron [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Successfully created port: 13b6f45e-f6e7-43c5-9347-92e4fd59e9a8 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 13:58:22 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79d07235-a6fb-48ea-b2be-c140461e0cbb/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:22 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Cannot resize image /opt/stack/data/nova/instances/79d07235-a6fb-48ea-b2be-c140461e0cbb/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:58:22 user nova-compute[73484]: DEBUG nova.objects.instance [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lazy-loading 'migration_context' on Instance uuid 79d07235-a6fb-48ea-b2be-c140461e0cbb {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:58:22 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 13:58:22 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Ensure instance console log exists: /opt/stack/data/nova/instances/79d07235-a6fb-48ea-b2be-c140461e0cbb/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 13:58:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:58:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:58:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:58:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquiring lock "b6d97e05-3311-4372-90d7-b07004369a4d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:58:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "b6d97e05-3311-4372-90d7-b07004369a4d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:58:22 user nova-compute[73484]: INFO nova.compute.manager [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Detaching volume c9b10526-68fd-428c-95a5-7e9ee6d1ab0c
Aug 14 13:58:22 user nova-compute[73484]: INFO nova.virt.block_device [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Attempting to driver detach volume c9b10526-68fd-428c-95a5-7e9ee6d1ab0c from mountpoint /dev/vdb
Aug 14 13:58:22 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Attempting to detach device vdb from instance b6d97e05-3311-4372-90d7-b07004369a4d from the persistent domain config. {{(pid=73484) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 13:58:22 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:58:22 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:58:22 user nova-compute[73484]:   <source dev="/dev/sdc"/>
Aug 14 13:58:22 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:58:22 user nova-compute[73484]:   <serial>c9b10526-68fd-428c-95a5-7e9ee6d1ab0c</serial>
Aug 14 13:58:22 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 13:58:22 user nova-compute[73484]: </disk>
Aug 14 13:58:22 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:58:22 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Successfully detached device vdb from instance b6d97e05-3311-4372-90d7-b07004369a4d from the persistent domain config.
Aug 14 13:58:22 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b6d97e05-3311-4372-90d7-b07004369a4d from the live domain config. {{(pid=73484) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 13:58:22 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:58:22 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:58:22 user nova-compute[73484]:   <source dev="/dev/sdc"/>
Aug 14 13:58:22 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:58:22 user nova-compute[73484]:   <serial>c9b10526-68fd-428c-95a5-7e9ee6d1ab0c</serial>
Aug 14 13:58:22 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 13:58:22 user nova-compute[73484]: </disk>
Aug 14 13:58:22 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.network.neutron [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Successfully updated port: 13b6f45e-f6e7-43c5-9347-92e4fd59e9a8 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "refresh_cache-79d07235-a6fb-48ea-b2be-c140461e0cbb" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquired lock "refresh_cache-79d07235-a6fb-48ea-b2be-c140461e0cbb" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.network.neutron [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.compute.manager [req-ad10d50c-cc10-4e67-abb9-6b59e06b7a87 req-59bef8bc-2d83-4294-8120-0d9e43a06189 service nova] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Received event network-changed-13b6f45e-f6e7-43c5-9347-92e4fd59e9a8 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.compute.manager [req-ad10d50c-cc10-4e67-abb9-6b59e06b7a87 req-59bef8bc-2d83-4294-8120-0d9e43a06189 service nova] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Refreshing instance network info cache due to event network-changed-13b6f45e-f6e7-43c5-9347-92e4fd59e9a8. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ad10d50c-cc10-4e67-abb9-6b59e06b7a87 req-59bef8bc-2d83-4294-8120-0d9e43a06189 service nova] Acquiring lock "refresh_cache-79d07235-a6fb-48ea-b2be-c140461e0cbb" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.network.neutron [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Received event <DeviceRemovedEvent: 1692021503.325422, b6d97e05-3311-4372-90d7-b07004369a4d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73484) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b6d97e05-3311-4372-90d7-b07004369a4d {{(pid=73484) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 13:58:23 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Successfully detached device vdb from instance b6d97e05-3311-4372-90d7-b07004369a4d from the live domain config.
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bDWENAhr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:58:23 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:58:23 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1958f6a-7185-404c-8b04-69348cee52e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[02860699-dd34-4cd7-92b5-556b02a07b7f]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)
Aug 14 13:58:23 user nova-compute[73484]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c (non-flash)
Aug 14 13:58:23 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)
Aug 14 13:58:23 user nova-compute[73484]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c (non-flash)
Aug 14 13:58:23 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4585b3ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c'): ({'sdc'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Removing single pathed devices sdc {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b7ec1b-d8e9-4704-b739-3f5b8d4d202f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eecc59c-73b9-4d61-9d17-2c91965699ed]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Flushing IO for device /dev/sdc {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[21651b73-6593-4dd8-8ecb-a096a17dfd40]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.network.neutron [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Updating instance_info_cache with network_info: [{"id": "13b6f45e-f6e7-43c5-9347-92e4fd59e9a8", "address": "fa:16:3e:60:b7:8a", "network": {"id": "3458700f-a875-4968-8ae8-464e9ce8ab81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1812819141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4707f4d9cd47c2b988af4fdaf685ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b6f45e-f6", "ovs_interfaceid": "13b6f45e-f6e7-43c5-9347-92e4fd59e9a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c457e06f-1bbf-4d35-ac98-9d55bc8a70c7]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Releasing lock "refresh_cache-79d07235-a6fb-48ea-b2be-c140461e0cbb" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.compute.manager [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Instance network_info: |[{"id": "13b6f45e-f6e7-43c5-9347-92e4fd59e9a8", "address": "fa:16:3e:60:b7:8a", "network": {"id": "3458700f-a875-4968-8ae8-464e9ce8ab81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1812819141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4707f4d9cd47c2b988af4fdaf685ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b6f45e-f6", "ovs_interfaceid": "13b6f45e-f6e7-43c5-9347-92e4fd59e9a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ad10d50c-cc10-4e67-abb9-6b59e06b7a87 req-59bef8bc-2d83-4294-8120-0d9e43a06189 service nova] Acquired lock "refresh_cache-79d07235-a6fb-48ea-b2be-c140461e0cbb" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.network.neutron [req-ad10d50c-cc10-4e67-abb9-6b59e06b7a87 req-59bef8bc-2d83-4294-8120-0d9e43a06189 service nova] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Refreshing network info cache for port 13b6f45e-f6e7-43c5-9347-92e4fd59e9a8 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Start _get_guest_xml network_info=[{"id": "13b6f45e-f6e7-43c5-9347-92e4fd59e9a8", "address": "fa:16:3e:60:b7:8a", "network": {"id": "3458700f-a875-4968-8ae8-464e9ce8ab81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1812819141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4707f4d9cd47c2b988af4fdaf685ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b6f45e-f6", "ovs_interfaceid": "13b6f45e-f6e7-43c5-9347-92e4fd59e9a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:58:23 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:58:23 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c8cd13-638f-45d1-ab60-77b1e9d62dac]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1496503405',display_name='tempest-VolumesSnapshotTestJSON-instance-1496503405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1496503405',id=41,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDj8Za07wpL+F8xaTyj46HXRxVYcmtX8wHE5RHoivtDdSBP7umubK4EHqA+y9yRu29KRBYcKqjHvsCZ8bFnb3oiCvK3vKMpeczr7e++EP4V+zniO33dc4nnn0dpRLmA2uw==',key_name='tempest-keypair-50382677',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f4707f4d9cd47c2b988af4fdaf685ef',ramdisk_id='',reservation_id='r-s9r5c65s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1264452311',owner_user_name='tempest-VolumesSnapshotTestJSON-1264452311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:58:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce08ff2ccf9940259c0beb5ba8aba5d3',uuid=79d07235-a6fb-48ea-b2be-c140461e0cbb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13b6f45e-f6e7-43c5-9347-92e4fd59e9a8", "address": "fa:16:3e:60:b7:8a", "network": {"id": "3458700f-a875-4968-8ae8-464e9ce8ab81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1812819141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4707f4d9cd47c2b988af4fdaf685ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b6f45e-f6", "ovs_interfaceid": "13b6f45e-f6e7-43c5-9347-92e4fd59e9a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Converting VIF {"id": "13b6f45e-f6e7-43c5-9347-92e4fd59e9a8", "address": "fa:16:3e:60:b7:8a", "network": {"id": "3458700f-a875-4968-8ae8-464e9ce8ab81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1812819141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4707f4d9cd47c2b988af4fdaf685ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b6f45e-f6", "ovs_interfaceid": "13b6f45e-f6e7-43c5-9347-92e4fd59e9a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:b7:8a,bridge_name='br-int',has_traffic_filtering=True,id=13b6f45e-f6e7-43c5-9347-92e4fd59e9a8,network=Network(3458700f-a875-4968-8ae8-464e9ce8ab81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b6f45e-f6') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.objects.instance [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lazy-loading 'pci_devices' on Instance uuid 79d07235-a6fb-48ea-b2be-c140461e0cbb {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82b0652-bdbf-4fb3-a1b6-4db0e79f1154]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c, portal: 172.16.0.220,3260]
Aug 14 13:58:23 user nova-compute[73484]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c, portal: 172.16.0.220,3260] successful.
Aug 14 13:58:23 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:58:23 user nova-compute[73484]:   <uuid>79d07235-a6fb-48ea-b2be-c140461e0cbb</uuid>
Aug 14 13:58:23 user nova-compute[73484]:   <name>instance-00000029</name>
Aug 14 13:58:23 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:58:23 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:58:23 user nova-compute[73484]:   <metadata>
Aug 14 13:58:23 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:58:23 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:58:23 user nova-compute[73484]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1496503405</nova:name>
Aug 14 13:58:23 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:58:23</nova:creationTime>
Aug 14 13:58:23 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:58:23 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:58:23 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:58:23 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:58:23 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:58:23 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:58:23 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:58:23 user nova-compute[73484]:       <nova:owner>
Aug 14 13:58:23 user nova-compute[73484]:         <nova:user uuid="ce08ff2ccf9940259c0beb5ba8aba5d3">tempest-VolumesSnapshotTestJSON-1264452311-project-member</nova:user>
Aug 14 13:58:23 user nova-compute[73484]:         <nova:project uuid="7f4707f4d9cd47c2b988af4fdaf685ef">tempest-VolumesSnapshotTestJSON-1264452311</nova:project>
Aug 14 13:58:23 user nova-compute[73484]:       </nova:owner>
Aug 14 13:58:23 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 13:58:23 user nova-compute[73484]:       <nova:ports>
Aug 14 13:58:23 user nova-compute[73484]:         <nova:port uuid="13b6f45e-f6e7-43c5-9347-92e4fd59e9a8">
Aug 14 13:58:23 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 13:58:23 user nova-compute[73484]:         </nova:port>
Aug 14 13:58:23 user nova-compute[73484]:       </nova:ports>
Aug 14 13:58:23 user nova-compute[73484]:     </nova:instance>
Aug 14 13:58:23 user nova-compute[73484]:   </metadata>
Aug 14 13:58:23 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:58:23 user nova-compute[73484]:     <system>
Aug 14 13:58:23 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:58:23 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:58:23 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:58:23 user nova-compute[73484]:       <entry name="serial">79d07235-a6fb-48ea-b2be-c140461e0cbb</entry>
Aug 14 13:58:23 user nova-compute[73484]:       <entry name="uuid">79d07235-a6fb-48ea-b2be-c140461e0cbb</entry>
Aug 14 13:58:23 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:58:23 user nova-compute[73484]:     </system>
Aug 14 13:58:23 user nova-compute[73484]:   </sysinfo>
Aug 14 13:58:23 user nova-compute[73484]:   <os>
Aug 14 13:58:23 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:58:23 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:58:23 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:58:23 user nova-compute[73484]:   </os>
Aug 14 13:58:23 user nova-compute[73484]:   <features>
Aug 14 13:58:23 user nova-compute[73484]:     <acpi/>
Aug 14 13:58:23 user nova-compute[73484]:     <apic/>
Aug 14 13:58:23 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:58:23 user nova-compute[73484]:   </features>
Aug 14 13:58:23 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:58:23 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:58:23 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:58:23 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:58:23 user nova-compute[73484]:   </clock>
Aug 14 13:58:23 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:58:23 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:58:23 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:58:23 user nova-compute[73484]:   </cpu>
Aug 14 13:58:23 user nova-compute[73484]:   <devices>
Aug 14 13:58:23 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:58:23 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:58:23 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/79d07235-a6fb-48ea-b2be-c140461e0cbb/disk"/>
Aug 14 13:58:23 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:58:23 user nova-compute[73484]:     </disk>
Aug 14 13:58:23 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:58:23 user nova-compute[73484]:       <mac address="fa:16:3e:60:b7:8a"/>
Aug 14 13:58:23 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:58:23 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:58:23 user nova-compute[73484]:       <target dev="tap13b6f45e-f6"/>
Aug 14 13:58:23 user nova-compute[73484]:     </interface>
Aug 14 13:58:23 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:58:23 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/79d07235-a6fb-48ea-b2be-c140461e0cbb/console.log" append="off"/>
Aug 14 13:58:23 user nova-compute[73484]:     </serial>
Aug 14 13:58:23 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:58:23 user nova-compute[73484]:     <video>
Aug 14 13:58:23 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:58:23 user nova-compute[73484]:     </video>
Aug 14 13:58:23 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:58:23 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:58:23 user nova-compute[73484]:     </rng>
Aug 14 13:58:23 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:58:23 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:58:23 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:58:23 user nova-compute[73484]:     </memballoon>
Aug 14 13:58:23 user nova-compute[73484]:   </devices>
Aug 14 13:58:23 user nova-compute[73484]: </domain>
Aug 14 13:58:23 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1496503405',display_name='tempest-VolumesSnapshotTestJSON-instance-1496503405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1496503405',id=41,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDj8Za07wpL+F8xaTyj46HXRxVYcmtX8wHE5RHoivtDdSBP7umubK4EHqA+y9yRu29KRBYcKqjHvsCZ8bFnb3oiCvK3vKMpeczr7e++EP4V+zniO33dc4nnn0dpRLmA2uw==',key_name='tempest-keypair-50382677',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f4707f4d9cd47c2b988af4fdaf685ef',ramdisk_id='',reservation_id='r-s9r5c65s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1264452311',owner_user_name='tempest-VolumesSnapshotTestJSON-1264452311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:58:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce08ff2ccf9940259c0beb5ba8aba5d3',uuid=79d07235-a6fb-48ea-b2be-c140461e0cbb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13b6f45e-f6e7-43c5-9347-92e4fd59e9a8", "address": "fa:16:3e:60:b7:8a", "network": {"id": "3458700f-a875-4968-8ae8-464e9ce8ab81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1812819141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4707f4d9cd47c2b988af4fdaf685ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b6f45e-f6", "ovs_interfaceid": "13b6f45e-f6e7-43c5-9347-92e4fd59e9a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Converting VIF {"id": "13b6f45e-f6e7-43c5-9347-92e4fd59e9a8", "address": "fa:16:3e:60:b7:8a", "network": {"id": "3458700f-a875-4968-8ae8-464e9ce8ab81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1812819141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4707f4d9cd47c2b988af4fdaf685ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b6f45e-f6", "ovs_interfaceid": "13b6f45e-f6e7-43c5-9347-92e4fd59e9a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:b7:8a,bridge_name='br-int',has_traffic_filtering=True,id=13b6f45e-f6e7-43c5-9347-92e4fd59e9a8,network=Network(3458700f-a875-4968-8ae8-464e9ce8ab81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b6f45e-f6') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG os_vif [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:b7:8a,bridge_name='br-int',has_traffic_filtering=True,id=13b6f45e-f6e7-43c5-9347-92e4fd59e9a8,network=Network(3458700f-a875-4968-8ae8-464e9ce8ab81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b6f45e-f6') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9b10526-68fd-428c-95a5-7e9ee6d1ab0c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20ed03b-3eb3-4c4c-aa10-aba1864738bf]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] <== disconnect_volume: return (339ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13b6f45e-f6, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13b6f45e-f6, col_values=(('external_ids', {'iface-id': '13b6f45e-f6e7-43c5-9347-92e4fd59e9a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:b7:8a', 'vm-uuid': '79d07235-a6fb-48ea-b2be-c140461e0cbb'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:23 user nova-compute[73484]: INFO os_vif [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:b7:8a,bridge_name='br-int',has_traffic_filtering=True,id=13b6f45e-f6e7-43c5-9347-92e4fd59e9a8,network=Network(3458700f-a875-4968-8ae8-464e9ce8ab81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b6f45e-f6')
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:58:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] No VIF found with MAC fa:16:3e:60:b7:8a, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:58:24 user nova-compute[73484]: DEBUG nova.network.neutron [req-ad10d50c-cc10-4e67-abb9-6b59e06b7a87 req-59bef8bc-2d83-4294-8120-0d9e43a06189 service nova] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Updated VIF entry in instance network info cache for port 13b6f45e-f6e7-43c5-9347-92e4fd59e9a8. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:58:24 user nova-compute[73484]: DEBUG nova.network.neutron [req-ad10d50c-cc10-4e67-abb9-6b59e06b7a87 req-59bef8bc-2d83-4294-8120-0d9e43a06189 service nova] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Updating instance_info_cache with network_info: [{"id": "13b6f45e-f6e7-43c5-9347-92e4fd59e9a8", "address": "fa:16:3e:60:b7:8a", "network": {"id": "3458700f-a875-4968-8ae8-464e9ce8ab81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1812819141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4707f4d9cd47c2b988af4fdaf685ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b6f45e-f6", "ovs_interfaceid": "13b6f45e-f6e7-43c5-9347-92e4fd59e9a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:58:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ad10d50c-cc10-4e67-abb9-6b59e06b7a87 req-59bef8bc-2d83-4294-8120-0d9e43a06189 service nova] Releasing lock "refresh_cache-79d07235-a6fb-48ea-b2be-c140461e0cbb" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:58:24 user nova-compute[73484]: DEBUG nova.objects.instance [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lazy-loading 'flavor' on Instance uuid b6d97e05-3311-4372-90d7-b07004369a4d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:58:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-152dd36a-c74d-4bee-a2e3-c2e0b1ca33c8 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "b6d97e05-3311-4372-90d7-b07004369a4d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.824s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:58:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:25 user nova-compute[73484]: DEBUG nova.compute.manager [req-d7e21205-db9c-49a4-856f-e90f6e551b71 req-d5c90806-3ca8-47d7-9013-5eca71255ef0 service nova] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Received event network-vif-plugged-13b6f45e-f6e7-43c5-9347-92e4fd59e9a8 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:58:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d7e21205-db9c-49a4-856f-e90f6e551b71 req-d5c90806-3ca8-47d7-9013-5eca71255ef0 service nova] Acquiring lock "79d07235-a6fb-48ea-b2be-c140461e0cbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:58:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d7e21205-db9c-49a4-856f-e90f6e551b71 req-d5c90806-3ca8-47d7-9013-5eca71255ef0 service nova] Lock "79d07235-a6fb-48ea-b2be-c140461e0cbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:58:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d7e21205-db9c-49a4-856f-e90f6e551b71 req-d5c90806-3ca8-47d7-9013-5eca71255ef0 service nova] Lock "79d07235-a6fb-48ea-b2be-c140461e0cbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:58:25 user nova-compute[73484]: DEBUG nova.compute.manager [req-d7e21205-db9c-49a4-856f-e90f6e551b71 req-d5c90806-3ca8-47d7-9013-5eca71255ef0 service nova] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] No waiting events found dispatching network-vif-plugged-13b6f45e-f6e7-43c5-9347-92e4fd59e9a8 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:58:25 user nova-compute[73484]: WARNING nova.compute.manager [req-d7e21205-db9c-49a4-856f-e90f6e551b71 req-d5c90806-3ca8-47d7-9013-5eca71255ef0 service nova] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Received unexpected event network-vif-plugged-13b6f45e-f6e7-43c5-9347-92e4fd59e9a8 for instance with vm_state building and task_state spawning.
Aug 14 13:58:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:27 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021507.5394723, 79d07235-a6fb-48ea-b2be-c140461e0cbb => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:58:27 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] VM Resumed (Lifecycle Event)
Aug 14 13:58:27 user nova-compute[73484]: DEBUG nova.compute.manager [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:58:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 13:58:27 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Instance spawned successfully.
Aug 14 13:58:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 13:58:27 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:58:27 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:58:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:58:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:58:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:58:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:58:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:58:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 13:58:27 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:58:27 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021507.544083, 79d07235-a6fb-48ea-b2be-c140461e0cbb => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:58:27 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] VM Started (Lifecycle Event)
Aug 14 13:58:27 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:58:27 user nova-compute[73484]: DEBUG nova.compute.manager [req-c2c77cf6-5c48-4166-b716-de926bce7559 req-a746caa3-7863-4950-a5f7-2da17ab2095f service nova] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Received event network-vif-plugged-13b6f45e-f6e7-43c5-9347-92e4fd59e9a8 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:58:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c2c77cf6-5c48-4166-b716-de926bce7559 req-a746caa3-7863-4950-a5f7-2da17ab2095f service nova] Acquiring lock "79d07235-a6fb-48ea-b2be-c140461e0cbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:58:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c2c77cf6-5c48-4166-b716-de926bce7559 req-a746caa3-7863-4950-a5f7-2da17ab2095f service nova] Lock "79d07235-a6fb-48ea-b2be-c140461e0cbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:58:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c2c77cf6-5c48-4166-b716-de926bce7559 req-a746caa3-7863-4950-a5f7-2da17ab2095f service nova] Lock "79d07235-a6fb-48ea-b2be-c140461e0cbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:58:27 user nova-compute[73484]: DEBUG nova.compute.manager [req-c2c77cf6-5c48-4166-b716-de926bce7559 req-a746caa3-7863-4950-a5f7-2da17ab2095f service nova] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] No waiting events found dispatching network-vif-plugged-13b6f45e-f6e7-43c5-9347-92e4fd59e9a8 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:58:27 user nova-compute[73484]: WARNING nova.compute.manager [req-c2c77cf6-5c48-4166-b716-de926bce7559 req-a746caa3-7863-4950-a5f7-2da17ab2095f service nova] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Received unexpected event network-vif-plugged-13b6f45e-f6e7-43c5-9347-92e4fd59e9a8 for instance with vm_state building and task_state spawning.
Aug 14 13:58:27 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:58:27 user nova-compute[73484]: INFO nova.compute.manager [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Took 6.23 seconds to spawn the instance on the hypervisor.
Aug 14 13:58:27 user nova-compute[73484]: DEBUG nova.compute.manager [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:58:27 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 13:58:27 user nova-compute[73484]: INFO nova.compute.manager [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Took 7.09 seconds to build instance.
Aug 14 13:58:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-edd27765-df81-4a90-ada3-a48d84e7f383 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "79d07235-a6fb-48ea-b2be-c140461e0cbb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.228s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:58:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "a3282525-9822-4be9-8ef1-c213392c6267" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:58:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "a3282525-9822-4be9-8ef1-c213392c6267" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:58:46 user nova-compute[73484]: DEBUG nova.objects.instance [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lazy-loading 'flavor' on Instance uuid a3282525-9822-4be9-8ef1-c213392c6267 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:58:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "a3282525-9822-4be9-8ef1-c213392c6267" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:58:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "a3282525-9822-4be9-8ef1-c213392c6267" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:58:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "a3282525-9822-4be9-8ef1-c213392c6267" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:58:46 user nova-compute[73484]: INFO nova.compute.manager [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Attaching volume 95f3d908-0a47-45e1-8a2d-c9d8b5c6004a to /dev/vdb
Aug 14 13:58:46 user nova-compute[73484]: DEBUG os_brick.utils [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:58:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf69245-2f88-4fa8-8117-31623429f76a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[89abb50c-fb5a-411e-a4e4-0f97dbe65e22]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fe14a4-4a95-49b1-95fc-f89c7c30a77f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bdee43-5feb-4b39-b2fa-95facb5292b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:58:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 13:58:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 13:58:46 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 13:58:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef14472-31f2-4a4c-ac0c-53edc4654db6]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 13:58:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 13:58:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 13:58:46 user nova-compute[73484]: DEBUG os_brick.utils [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:58:46 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Updating existing volume attachment record: f7b3878c-d021-4643-962c-1280533d6c94 {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 13:58:46 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:58:46 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 13:58:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-b8a790d0-e5d0-4b78-8de4-36a58290b4ee" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:58:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-b8a790d0-e5d0-4b78-8de4-36a58290b4ee" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:58:46 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 13:58:47 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Updating instance_info_cache with network_info: [{"id": "b5ceef09-ab2f-4db8-8c7b-c239fc361daf", "address": "fa:16:3e:60:5a:aa", "network": {"id": "8f719ef2-7286-46f1-96e0-d08fd389db0e", "bridge": "br-int", "label": "tempest-TestStampPattern-1811054691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a442b6e525b4ae9ba256aa1c71e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ceef09-ab", "ovs_interfaceid": "b5ceef09-ab2f-4db8-8c7b-c239fc361daf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:58:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-b8a790d0-e5d0-4b78-8de4-36a58290b4ee" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:58:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 13:58:47 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:58:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:51 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:58:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:53 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:58:53 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:58:53 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 13:58:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFGWoBRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:58:55 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:58:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:58:55 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:58:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:58:55 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87feeab-ce76-47a8-99ca-08e47c2f917a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:58:55 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e111e69b-af49-4d3a-81c3-e2860c3e9d77]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a] added
Aug 14 13:58:55 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf045fc-b7fe-4e96-a037-f9caf1b65be9]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e784c7a-93b4-46c2-8c64-8ebaa6d96c5e]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lFGWoBRe {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lFGWoBRe" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[af84486f-c3f5-4895-9af1-d742814685b3]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lFGWoBRe'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[646fec86-d023-487f-9e71-39ca100f5f2a]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4dd1c14-d45d-4c99-aab9-725ebb697b82]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)
Aug 14 13:58:55 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)
Aug 14 13:58:55 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[881d2c5b-081d-4e5c-9bd9-ca1309f83238]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a, portal: 172.16.0.220,3260]
Aug 14 13:58:55 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a, portal: 172.16.0.220,3260] successful.
Aug 14 13:58:55 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1f0a45-3daa-4b8d-908a-90e765c8d1cd]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b559317e-b8f0-4a4c-9267-36aad2fcf01e]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)
Aug 14 13:58:55 user nova-compute[73484]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)
Aug 14 13:58:55 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)
Aug 14 13:58:55 user nova-compute[73484]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)
Aug 14 13:58:55 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cac0a1-8dc3-4400-9290-4323fcf91ea0]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:58:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFGWoBRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:58:56 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:58:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:58:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:58:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:58:56 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 13:58:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:58:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26338613466653761', 'path': '/dev/sdc'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:58:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338613466653761', 'path': '/dev/sdc'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:58:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79d07235-a6fb-48ea-b2be-c140461e0cbb/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:57 user nova-compute[73484]: DEBUG nova.objects.instance [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lazy-loading 'flavor' on Instance uuid a3282525-9822-4be9-8ef1-c213392c6267 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:58:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 13:58:57 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:58:57 user nova-compute[73484]:   <source dev="/dev/sdc"/>
Aug 14 13:58:57 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:58:57 user nova-compute[73484]:   <serial>95f3d908-0a47-45e1-8a2d-c9d8b5c6004a</serial>
Aug 14 13:58:57 user nova-compute[73484]: </disk>
Aug 14 13:58:57 user nova-compute[73484]:  {{(pid=73484) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 13:58:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79d07235-a6fb-48ea-b2be-c140461e0cbb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79d07235-a6fb-48ea-b2be-c140461e0cbb/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79d07235-a6fb-48ea-b2be-c140461e0cbb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:58:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 13:58:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] No VIF found with MAC fa:16:3e:2e:7e:05, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 13:58:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-3e9c259a-2e09-4ebb-a73e-3dc47990026c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "a3282525-9822-4be9-8ef1-c213392c6267" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.132s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:58:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/165b7234-2b91-482a-8532-5fc41e481e1e/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/165b7234-2b91-482a-8532-5fc41e481e1e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/165b7234-2b91-482a-8532-5fc41e481e1e/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/165b7234-2b91-482a-8532-5fc41e481e1e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d97e05-3311-4372-90d7-b07004369a4d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d97e05-3311-4372-90d7-b07004369a4d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d97e05-3311-4372-90d7-b07004369a4d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6d97e05-3311-4372-90d7-b07004369a4d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75ff316d-3957-421c-9b55-1744fc7d4cce/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:58:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:58:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75ff316d-3957-421c-9b55-1744fc7d4cce/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:58:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75ff316d-3957-421c-9b55-1744fc7d4cce/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75ff316d-3957-421c-9b55-1744fc7d4cce/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:00 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:59:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:00 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:59:01 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:59:01 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:59:01 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=7497MB free_disk=25.047115325927734GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 13:59:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:59:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:59:01 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 782c6142-757a-49ae-9292-787a7f1e8a23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:59:01 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 03255d24-b6fd-459c-8ac6-f9c4063b54b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:59:01 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance b8a790d0-e5d0-4b78-8de4-36a58290b4ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:59:01 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 14999671-dcc7-43fa-85ec-21cbcf12d21e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:59:01 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance b6d97e05-3311-4372-90d7-b07004369a4d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:59:01 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance a3282525-9822-4be9-8ef1-c213392c6267 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:59:01 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 165b7234-2b91-482a-8532-5fc41e481e1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:59:01 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 75ff316d-3957-421c-9b55-1744fc7d4cce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:59:01 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 79d07235-a6fb-48ea-b2be-c140461e0cbb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 13:59:01 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 13:59:01 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 13:59:01 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:59:01 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:59:01 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 13:59:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.399s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:59:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:04 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:59:04 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:59:04 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:59:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:07 user nova-compute[73484]: DEBUG nova.compute.manager [req-2f83c956-fb65-4201-8327-1b9da51318d9 req-7d6ad211-4ca3-4b58-a113-41dd11c7fd5b service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Received event network-changed-7ce35860-fbe8-4c2b-9697-bf867ebe5b39 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:59:07 user nova-compute[73484]: DEBUG nova.compute.manager [req-2f83c956-fb65-4201-8327-1b9da51318d9 req-7d6ad211-4ca3-4b58-a113-41dd11c7fd5b service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Refreshing instance network info cache due to event network-changed-7ce35860-fbe8-4c2b-9697-bf867ebe5b39. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:59:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2f83c956-fb65-4201-8327-1b9da51318d9 req-7d6ad211-4ca3-4b58-a113-41dd11c7fd5b service nova] Acquiring lock "refresh_cache-a3282525-9822-4be9-8ef1-c213392c6267" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:59:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2f83c956-fb65-4201-8327-1b9da51318d9 req-7d6ad211-4ca3-4b58-a113-41dd11c7fd5b service nova] Acquired lock "refresh_cache-a3282525-9822-4be9-8ef1-c213392c6267" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:59:07 user nova-compute[73484]: DEBUG nova.network.neutron [req-2f83c956-fb65-4201-8327-1b9da51318d9 req-7d6ad211-4ca3-4b58-a113-41dd11c7fd5b service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Refreshing network info cache for port 7ce35860-fbe8-4c2b-9697-bf867ebe5b39 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:59:08 user nova-compute[73484]: DEBUG nova.network.neutron [req-2f83c956-fb65-4201-8327-1b9da51318d9 req-7d6ad211-4ca3-4b58-a113-41dd11c7fd5b service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Updated VIF entry in instance network info cache for port 7ce35860-fbe8-4c2b-9697-bf867ebe5b39. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:59:08 user nova-compute[73484]: DEBUG nova.network.neutron [req-2f83c956-fb65-4201-8327-1b9da51318d9 req-7d6ad211-4ca3-4b58-a113-41dd11c7fd5b service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Updating instance_info_cache with network_info: [{"id": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "address": "fa:16:3e:2e:7e:05", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce35860-fb", "ovs_interfaceid": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:59:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2f83c956-fb65-4201-8327-1b9da51318d9 req-7d6ad211-4ca3-4b58-a113-41dd11c7fd5b service nova] Releasing lock "refresh_cache-a3282525-9822-4be9-8ef1-c213392c6267" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:59:08 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:09 user nova-compute[73484]: DEBUG nova.compute.manager [req-977d53f7-0c30-4b2d-819a-89a3746018aa req-9c7ed723-f680-46a9-ac47-fba75fcbf8a8 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Received event network-changed-7ce35860-fbe8-4c2b-9697-bf867ebe5b39 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:59:09 user nova-compute[73484]: DEBUG nova.compute.manager [req-977d53f7-0c30-4b2d-819a-89a3746018aa req-9c7ed723-f680-46a9-ac47-fba75fcbf8a8 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Refreshing instance network info cache due to event network-changed-7ce35860-fbe8-4c2b-9697-bf867ebe5b39. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:59:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-977d53f7-0c30-4b2d-819a-89a3746018aa req-9c7ed723-f680-46a9-ac47-fba75fcbf8a8 service nova] Acquiring lock "refresh_cache-a3282525-9822-4be9-8ef1-c213392c6267" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:59:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-977d53f7-0c30-4b2d-819a-89a3746018aa req-9c7ed723-f680-46a9-ac47-fba75fcbf8a8 service nova] Acquired lock "refresh_cache-a3282525-9822-4be9-8ef1-c213392c6267" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:59:09 user nova-compute[73484]: DEBUG nova.network.neutron [req-977d53f7-0c30-4b2d-819a-89a3746018aa req-9c7ed723-f680-46a9-ac47-fba75fcbf8a8 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Refreshing network info cache for port 7ce35860-fbe8-4c2b-9697-bf867ebe5b39 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:59:10 user nova-compute[73484]: DEBUG nova.network.neutron [req-977d53f7-0c30-4b2d-819a-89a3746018aa req-9c7ed723-f680-46a9-ac47-fba75fcbf8a8 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Updated VIF entry in instance network info cache for port 7ce35860-fbe8-4c2b-9697-bf867ebe5b39. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:59:10 user nova-compute[73484]: DEBUG nova.network.neutron [req-977d53f7-0c30-4b2d-819a-89a3746018aa req-9c7ed723-f680-46a9-ac47-fba75fcbf8a8 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Updating instance_info_cache with network_info: [{"id": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "address": "fa:16:3e:2e:7e:05", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce35860-fb", "ovs_interfaceid": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:59:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-977d53f7-0c30-4b2d-819a-89a3746018aa req-9c7ed723-f680-46a9-ac47-fba75fcbf8a8 service nova] Releasing lock "refresh_cache-a3282525-9822-4be9-8ef1-c213392c6267" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:59:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:14 user nova-compute[73484]: DEBUG nova.compute.manager [req-e0a53451-ed6a-4bd1-ae03-e1ca3a13c90f req-e0bfcd26-6de1-42c9-8b94-8d74636c6d4a service nova] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Received event network-changed-6fded38c-518a-453c-93db-d64ceebab4ba {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:59:14 user nova-compute[73484]: DEBUG nova.compute.manager [req-e0a53451-ed6a-4bd1-ae03-e1ca3a13c90f req-e0bfcd26-6de1-42c9-8b94-8d74636c6d4a service nova] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Refreshing instance network info cache due to event network-changed-6fded38c-518a-453c-93db-d64ceebab4ba. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:59:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e0a53451-ed6a-4bd1-ae03-e1ca3a13c90f req-e0bfcd26-6de1-42c9-8b94-8d74636c6d4a service nova] Acquiring lock "refresh_cache-b6d97e05-3311-4372-90d7-b07004369a4d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:59:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e0a53451-ed6a-4bd1-ae03-e1ca3a13c90f req-e0bfcd26-6de1-42c9-8b94-8d74636c6d4a service nova] Acquired lock "refresh_cache-b6d97e05-3311-4372-90d7-b07004369a4d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:59:14 user nova-compute[73484]: DEBUG nova.network.neutron [req-e0a53451-ed6a-4bd1-ae03-e1ca3a13c90f req-e0bfcd26-6de1-42c9-8b94-8d74636c6d4a service nova] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Refreshing network info cache for port 6fded38c-518a-453c-93db-d64ceebab4ba {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:59:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e317672d-8135-4113-ac43-98abdaacfb3d tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquiring lock "b6d97e05-3311-4372-90d7-b07004369a4d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:59:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e317672d-8135-4113-ac43-98abdaacfb3d tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "b6d97e05-3311-4372-90d7-b07004369a4d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:59:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e317672d-8135-4113-ac43-98abdaacfb3d tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquiring lock "b6d97e05-3311-4372-90d7-b07004369a4d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:59:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e317672d-8135-4113-ac43-98abdaacfb3d tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "b6d97e05-3311-4372-90d7-b07004369a4d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:59:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e317672d-8135-4113-ac43-98abdaacfb3d tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "b6d97e05-3311-4372-90d7-b07004369a4d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:59:14 user nova-compute[73484]: INFO nova.compute.manager [None req-e317672d-8135-4113-ac43-98abdaacfb3d tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Terminating instance
Aug 14 13:59:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-e317672d-8135-4113-ac43-98abdaacfb3d tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 13:59:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:14 user nova-compute[73484]: DEBUG nova.network.neutron [req-e0a53451-ed6a-4bd1-ae03-e1ca3a13c90f req-e0bfcd26-6de1-42c9-8b94-8d74636c6d4a service nova] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Updated VIF entry in instance network info cache for port 6fded38c-518a-453c-93db-d64ceebab4ba. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:59:14 user nova-compute[73484]: DEBUG nova.network.neutron [req-e0a53451-ed6a-4bd1-ae03-e1ca3a13c90f req-e0bfcd26-6de1-42c9-8b94-8d74636c6d4a service nova] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Updating instance_info_cache with network_info: [{"id": "6fded38c-518a-453c-93db-d64ceebab4ba", "address": "fa:16:3e:db:9d:8f", "network": {"id": "8f719ef2-7286-46f1-96e0-d08fd389db0e", "bridge": "br-int", "label": "tempest-TestStampPattern-1811054691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a442b6e525b4ae9ba256aa1c71e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fded38c-51", "ovs_interfaceid": "6fded38c-518a-453c-93db-d64ceebab4ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:59:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e0a53451-ed6a-4bd1-ae03-e1ca3a13c90f req-e0bfcd26-6de1-42c9-8b94-8d74636c6d4a service nova] Releasing lock "refresh_cache-b6d97e05-3311-4372-90d7-b07004369a4d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:59:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:14 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Instance destroyed successfully.
Aug 14 13:59:14 user nova-compute[73484]: DEBUG nova.objects.instance [None req-e317672d-8135-4113-ac43-98abdaacfb3d tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lazy-loading 'resources' on Instance uuid b6d97e05-3311-4372-90d7-b07004369a4d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:59:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-e317672d-8135-4113-ac43-98abdaacfb3d tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:56:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-938337146',display_name='tempest-TestStampPattern-server-938337146',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-938337146',id=37,image_ref='52c1cf71-1e8e-45b6-b6e6-339c42c7abb9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcHOndY4thu+Li/XG3hWqIOD4cGsaZ6per43xYR1P6MSwf1FXn+zuKlHDSmWjudBpUwpsq+XH3XDp8yg1o4KErin8MFeGY1rhZ0UCW+BGzI3wFo1KaDX12K6RUas0q53g==',key_name='tempest-TestStampPattern-1459796457',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:56:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a442b6e525b4ae9ba256aa1c71e1a94',ramdisk_id='',reservation_id='r-ta0xy2z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b8a790d0-e5d0-4b78-8de4-36a58290b4ee',image_min_disk='1',image_min_ram='0',image_owner_id='5a442b6e525b4ae9ba256aa1c71e1a94',image_owner_project_name='tempest-TestStampPattern-678241444',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-678241444-project-member',image_user_id='e9d4aa3f4ad04184bb6181332a6ef6e1',owner_project_name='tempest-TestStampPattern-678241444',owner_user_name='tempest-TestStampPattern-678241444-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:56:24Z,user_data=None,user_id='e9d4aa3f4ad04184bb6181332a6ef6e1',uuid=b6d97e05-3311-4372-90d7-b07004369a4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6fded38c-518a-453c-93db-d64ceebab4ba", "address": "fa:16:3e:db:9d:8f", "network": {"id": "8f719ef2-7286-46f1-96e0-d08fd389db0e", "bridge": "br-int", "label": "tempest-TestStampPattern-1811054691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a442b6e525b4ae9ba256aa1c71e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fded38c-51", "ovs_interfaceid": "6fded38c-518a-453c-93db-d64ceebab4ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:59:14 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-e317672d-8135-4113-ac43-98abdaacfb3d tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Converting VIF {"id": "6fded38c-518a-453c-93db-d64ceebab4ba", "address": "fa:16:3e:db:9d:8f", "network": {"id": "8f719ef2-7286-46f1-96e0-d08fd389db0e", "bridge": "br-int", "label": "tempest-TestStampPattern-1811054691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a442b6e525b4ae9ba256aa1c71e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fded38c-51", "ovs_interfaceid": "6fded38c-518a-453c-93db-d64ceebab4ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:59:14 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-e317672d-8135-4113-ac43-98abdaacfb3d tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:9d:8f,bridge_name='br-int',has_traffic_filtering=True,id=6fded38c-518a-453c-93db-d64ceebab4ba,network=Network(8f719ef2-7286-46f1-96e0-d08fd389db0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fded38c-51') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:59:14 user nova-compute[73484]: DEBUG os_vif [None req-e317672d-8135-4113-ac43-98abdaacfb3d tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:9d:8f,bridge_name='br-int',has_traffic_filtering=True,id=6fded38c-518a-453c-93db-d64ceebab4ba,network=Network(8f719ef2-7286-46f1-96e0-d08fd389db0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fded38c-51') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:59:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6fded38c-51, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:59:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:59:14 user nova-compute[73484]: INFO os_vif [None req-e317672d-8135-4113-ac43-98abdaacfb3d tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:9d:8f,bridge_name='br-int',has_traffic_filtering=True,id=6fded38c-518a-453c-93db-d64ceebab4ba,network=Network(8f719ef2-7286-46f1-96e0-d08fd389db0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fded38c-51')
Aug 14 13:59:14 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-e317672d-8135-4113-ac43-98abdaacfb3d tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Deleting instance files /opt/stack/data/nova/instances/b6d97e05-3311-4372-90d7-b07004369a4d_del
Aug 14 13:59:14 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-e317672d-8135-4113-ac43-98abdaacfb3d tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Deletion of /opt/stack/data/nova/instances/b6d97e05-3311-4372-90d7-b07004369a4d_del complete
Aug 14 13:59:14 user nova-compute[73484]: INFO nova.compute.manager [None req-e317672d-8135-4113-ac43-98abdaacfb3d tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 14 13:59:14 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-e317672d-8135-4113-ac43-98abdaacfb3d tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 13:59:14 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 13:59:14 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 13:59:15 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:59:15 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Took 0.42 seconds to deallocate network for instance.
Aug 14 13:59:15 user nova-compute[73484]: DEBUG nova.compute.manager [req-34e5eb24-3ef3-4e2a-a233-ed238ab8502b req-47243c5c-c190-45b4-9129-5ab8e0876e2b service nova] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Received event network-vif-deleted-6fded38c-518a-453c-93db-d64ceebab4ba {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:59:15 user nova-compute[73484]: INFO nova.compute.manager [req-34e5eb24-3ef3-4e2a-a233-ed238ab8502b req-47243c5c-c190-45b4-9129-5ab8e0876e2b service nova] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Neutron deleted interface 6fded38c-518a-453c-93db-d64ceebab4ba; detaching it from the instance and deleting it from the info cache
Aug 14 13:59:15 user nova-compute[73484]: DEBUG nova.network.neutron [req-34e5eb24-3ef3-4e2a-a233-ed238ab8502b req-47243c5c-c190-45b4-9129-5ab8e0876e2b service nova] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:59:15 user nova-compute[73484]: DEBUG nova.compute.manager [req-34e5eb24-3ef3-4e2a-a233-ed238ab8502b req-47243c5c-c190-45b4-9129-5ab8e0876e2b service nova] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Detach interface failed, port_id=6fded38c-518a-453c-93db-d64ceebab4ba, reason: Instance b6d97e05-3311-4372-90d7-b07004369a4d could not be found. {{(pid=73484) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 13:59:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e317672d-8135-4113-ac43-98abdaacfb3d tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:59:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e317672d-8135-4113-ac43-98abdaacfb3d tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:59:15 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-e317672d-8135-4113-ac43-98abdaacfb3d tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 13:59:15 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-e317672d-8135-4113-ac43-98abdaacfb3d tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 13:59:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "a3282525-9822-4be9-8ef1-c213392c6267" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:59:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "a3282525-9822-4be9-8ef1-c213392c6267" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:59:15 user nova-compute[73484]: INFO nova.compute.manager [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Rebooting instance
Aug 14 13:59:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e317672d-8135-4113-ac43-98abdaacfb3d tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:59:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "refresh_cache-a3282525-9822-4be9-8ef1-c213392c6267" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:59:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquired lock "refresh_cache-a3282525-9822-4be9-8ef1-c213392c6267" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:59:15 user nova-compute[73484]: DEBUG nova.network.neutron [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 13:59:15 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-e317672d-8135-4113-ac43-98abdaacfb3d tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Deleted allocations for instance b6d97e05-3311-4372-90d7-b07004369a4d
Aug 14 13:59:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e317672d-8135-4113-ac43-98abdaacfb3d tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "b6d97e05-3311-4372-90d7-b07004369a4d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.798s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:59:16 user nova-compute[73484]: DEBUG nova.compute.manager [req-6533ce77-0bd7-4ac8-b173-8748d03ad9f1 req-86d1914e-c8c0-4294-86fe-15661e1ff5c2 service nova] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Received event network-vif-unplugged-6fded38c-518a-453c-93db-d64ceebab4ba {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:59:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6533ce77-0bd7-4ac8-b173-8748d03ad9f1 req-86d1914e-c8c0-4294-86fe-15661e1ff5c2 service nova] Acquiring lock "b6d97e05-3311-4372-90d7-b07004369a4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:59:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6533ce77-0bd7-4ac8-b173-8748d03ad9f1 req-86d1914e-c8c0-4294-86fe-15661e1ff5c2 service nova] Lock "b6d97e05-3311-4372-90d7-b07004369a4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:59:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6533ce77-0bd7-4ac8-b173-8748d03ad9f1 req-86d1914e-c8c0-4294-86fe-15661e1ff5c2 service nova] Lock "b6d97e05-3311-4372-90d7-b07004369a4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:59:16 user nova-compute[73484]: DEBUG nova.compute.manager [req-6533ce77-0bd7-4ac8-b173-8748d03ad9f1 req-86d1914e-c8c0-4294-86fe-15661e1ff5c2 service nova] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] No waiting events found dispatching network-vif-unplugged-6fded38c-518a-453c-93db-d64ceebab4ba {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:59:16 user nova-compute[73484]: WARNING nova.compute.manager [req-6533ce77-0bd7-4ac8-b173-8748d03ad9f1 req-86d1914e-c8c0-4294-86fe-15661e1ff5c2 service nova] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Received unexpected event network-vif-unplugged-6fded38c-518a-453c-93db-d64ceebab4ba for instance with vm_state deleted and task_state None.
Aug 14 13:59:16 user nova-compute[73484]: DEBUG nova.compute.manager [req-6533ce77-0bd7-4ac8-b173-8748d03ad9f1 req-86d1914e-c8c0-4294-86fe-15661e1ff5c2 service nova] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Received event network-vif-plugged-6fded38c-518a-453c-93db-d64ceebab4ba {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:59:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6533ce77-0bd7-4ac8-b173-8748d03ad9f1 req-86d1914e-c8c0-4294-86fe-15661e1ff5c2 service nova] Acquiring lock "b6d97e05-3311-4372-90d7-b07004369a4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:59:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6533ce77-0bd7-4ac8-b173-8748d03ad9f1 req-86d1914e-c8c0-4294-86fe-15661e1ff5c2 service nova] Lock "b6d97e05-3311-4372-90d7-b07004369a4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:59:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6533ce77-0bd7-4ac8-b173-8748d03ad9f1 req-86d1914e-c8c0-4294-86fe-15661e1ff5c2 service nova] Lock "b6d97e05-3311-4372-90d7-b07004369a4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:59:16 user nova-compute[73484]: DEBUG nova.compute.manager [req-6533ce77-0bd7-4ac8-b173-8748d03ad9f1 req-86d1914e-c8c0-4294-86fe-15661e1ff5c2 service nova] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] No waiting events found dispatching network-vif-plugged-6fded38c-518a-453c-93db-d64ceebab4ba {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:59:16 user nova-compute[73484]: WARNING nova.compute.manager [req-6533ce77-0bd7-4ac8-b173-8748d03ad9f1 req-86d1914e-c8c0-4294-86fe-15661e1ff5c2 service nova] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Received unexpected event network-vif-plugged-6fded38c-518a-453c-93db-d64ceebab4ba for instance with vm_state deleted and task_state None.
Aug 14 13:59:16 user nova-compute[73484]: DEBUG nova.network.neutron [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Updating instance_info_cache with network_info: [{"id": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "address": "fa:16:3e:2e:7e:05", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce35860-fb", "ovs_interfaceid": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:59:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Releasing lock "refresh_cache-a3282525-9822-4be9-8ef1-c213392c6267" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:59:16 user nova-compute[73484]: DEBUG nova.compute.manager [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:59:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:17 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Instance destroyed successfully.
Aug 14 13:59:17 user nova-compute[73484]: DEBUG nova.objects.instance [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lazy-loading 'resources' on Instance uuid a3282525-9822-4be9-8ef1-c213392c6267 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:56:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1008126369',display_name='tempest-TestMinimumBasicScenario-server-1008126369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1008126369',id=38,image_ref='7e9f7742-c3f5-492c-b4c8-212072532633',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4a8pn3Vvu6dQiHnUjxe5S47vZZcNV7BZnNmiXptsYleB+jhejPspwALEfKvnpz0zOvOfgUo98QUeJ8MA0+PLeMfsNuk9i0SCfN25RGVr1raXPMKT0/tB3wEblrXP1NQA==',key_name='tempest-TestMinimumBasicScenario-229925239',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:56:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1934a2112a584b82a20c4ae8c13a70db',ramdisk_id='',reservation_id='r-dafyuxae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7e9f7742-c3f5-492c-b4c8-212072532633',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-227652473',owner_user_name='tempest-TestMinimumBasicScenario-227652473-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:59:16Z,user_data=None,user_id='be2ee7c7641d4d0892cc3bc03f8340f1',uuid=a3282525-9822-4be9-8ef1-c213392c6267,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "address": "fa:16:3e:2e:7e:05", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce35860-fb", "ovs_interfaceid": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Converting VIF {"id": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "address": "fa:16:3e:2e:7e:05", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce35860-fb", "ovs_interfaceid": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:7e:05,bridge_name='br-int',has_traffic_filtering=True,id=7ce35860-fbe8-4c2b-9697-bf867ebe5b39,network=Network(b63f0a71-864e-4b2c-9602-fd57c50c5501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce35860-fb') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_vif [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:7e:05,bridge_name='br-int',has_traffic_filtering=True,id=7ce35860-fbe8-4c2b-9697-bf867ebe5b39,network=Network(b63f0a71-864e-4b2c-9602-fd57c50c5501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce35860-fb') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ce35860-fb, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:59:17 user nova-compute[73484]: INFO os_vif [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:7e:05,bridge_name='br-int',has_traffic_filtering=True,id=7ce35860-fbe8-4c2b-9697-bf867ebe5b39,network=Network(b63f0a71-864e-4b2c-9602-fd57c50c5501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce35860-fb')
Aug 14 13:59:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFGWoBRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:59:17 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe6c548-6575-4416-b517-25806b4c05a3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[744aee2d-41a3-44cb-9780-ef20df0ebb5e]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)
Aug 14 13:59:17 user nova-compute[73484]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)
Aug 14 13:59:17 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)
Aug 14 13:59:17 user nova-compute[73484]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)
Aug 14 13:59:17 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc47849e170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a'): ({'sdc'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Removing single pathed devices sdc {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8d34f5-e364-4ded-b412-96957712f0c0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b6bd37-cb69-4197-8322-c2557fb93808]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Flushing IO for device /dev/sdc {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7df1fbc-0b29-4d86-a9d4-cb3c3d89b757]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0edc3b-9c1f-4925-a55c-3c5e1425afb6]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4601fb28-bcab-4c2d-9807-d56075adf341]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG nova.compute.manager [req-5de8699d-8fac-4a6f-b42e-7bab0090f9d7 req-3b02ce28-be10-4fce-91be-ab16a4dbb735 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Received event network-vif-unplugged-7ce35860-fbe8-4c2b-9697-bf867ebe5b39 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5de8699d-8fac-4a6f-b42e-7bab0090f9d7 req-3b02ce28-be10-4fce-91be-ab16a4dbb735 service nova] Acquiring lock "a3282525-9822-4be9-8ef1-c213392c6267-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5de8699d-8fac-4a6f-b42e-7bab0090f9d7 req-3b02ce28-be10-4fce-91be-ab16a4dbb735 service nova] Lock "a3282525-9822-4be9-8ef1-c213392c6267-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5de8699d-8fac-4a6f-b42e-7bab0090f9d7 req-3b02ce28-be10-4fce-91be-ab16a4dbb735 service nova] Lock "a3282525-9822-4be9-8ef1-c213392c6267-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG nova.compute.manager [req-5de8699d-8fac-4a6f-b42e-7bab0090f9d7 req-3b02ce28-be10-4fce-91be-ab16a4dbb735 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] No waiting events found dispatching network-vif-unplugged-7ce35860-fbe8-4c2b-9697-bf867ebe5b39 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:59:17 user nova-compute[73484]: WARNING nova.compute.manager [req-5de8699d-8fac-4a6f-b42e-7bab0090f9d7 req-3b02ce28-be10-4fce-91be-ab16a4dbb735 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Received unexpected event network-vif-unplugged-7ce35860-fbe8-4c2b-9697-bf867ebe5b39 for instance with vm_state active and task_state reboot_started_hard.
Aug 14 13:59:17 user nova-compute[73484]: DEBUG nova.compute.manager [req-5de8699d-8fac-4a6f-b42e-7bab0090f9d7 req-3b02ce28-be10-4fce-91be-ab16a4dbb735 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Received event network-vif-plugged-7ce35860-fbe8-4c2b-9697-bf867ebe5b39 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5de8699d-8fac-4a6f-b42e-7bab0090f9d7 req-3b02ce28-be10-4fce-91be-ab16a4dbb735 service nova] Acquiring lock "a3282525-9822-4be9-8ef1-c213392c6267-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5de8699d-8fac-4a6f-b42e-7bab0090f9d7 req-3b02ce28-be10-4fce-91be-ab16a4dbb735 service nova] Lock "a3282525-9822-4be9-8ef1-c213392c6267-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-5de8699d-8fac-4a6f-b42e-7bab0090f9d7 req-3b02ce28-be10-4fce-91be-ab16a4dbb735 service nova] Lock "a3282525-9822-4be9-8ef1-c213392c6267-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG nova.compute.manager [req-5de8699d-8fac-4a6f-b42e-7bab0090f9d7 req-3b02ce28-be10-4fce-91be-ab16a4dbb735 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] No waiting events found dispatching network-vif-plugged-7ce35860-fbe8-4c2b-9697-bf867ebe5b39 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:59:17 user nova-compute[73484]: WARNING nova.compute.manager [req-5de8699d-8fac-4a6f-b42e-7bab0090f9d7 req-3b02ce28-be10-4fce-91be-ab16a4dbb735 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Received unexpected event network-vif-plugged-7ce35860-fbe8-4c2b-9697-bf867ebe5b39 for instance with vm_state active and task_state reboot_started_hard.
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[69466617-853c-4659-9995-bbc1cc77ec4e]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a, portal: 172.16.0.220,3260]
Aug 14 13:59:17 user nova-compute[73484]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a, portal: 172.16.0.220,3260] successful.
Aug 14 13:59:17 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e699964-15a3-458c-a154-8ac695bb819e]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.256s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] <== disconnect_volume: return (257ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Start _get_guest_xml network_info=[{"id": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "address": "fa:16:3e:2e:7e:05", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce35860-fb", "ovs_interfaceid": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7e9f7742-c3f5-492c-b4c8-212072532633,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '7e9f7742-c3f5-492c-b4c8-212072532633'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f7b3878c-d021-4643-962c-1280533d6c94', 'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFGWoBRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'a3282525-9822-4be9-8ef1-c213392c6267', 'attached_at': '', 'detached_at': '', 'volume_id': '95f3d908-0a47-45e1-8a2d-c9d8b5c6004a', 'serial': '95f3d908-0a47-45e1-8a2d-c9d8b5c6004a'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 13:59:17 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:59:17 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 13:59:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7e9f7742-c3f5-492c-b4c8-212072532633,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG nova.objects.instance [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lazy-loading 'vcpu_model' on Instance uuid a3282525-9822-4be9-8ef1-c213392c6267 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFGWoBRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:59:17 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:59:17 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:59:17 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f751599-0abf-4fa3-b3ba-0f9a2d2036bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 13:59:17 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de1d2e0-c2d9-42a7-b4b1-ade8d987b13b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a] added
Aug 14 13:59:17 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cf41a9-50f6-42d4-be47-fd41c7213d13]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[95dbe6fc-2385-4718-a2a9-a580fabad281]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lFGWoBRe {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lFGWoBRe" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae2b57a-56d7-4aaf-ae6b-7a3fa9cd86b5]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lFGWoBRe'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd656046-998f-44d2-a0a0-079a06072d42]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74679b3-29de-4ccc-a84b-55b1238155dc]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)
Aug 14 13:59:17 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)
Aug 14 13:59:17 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d10b4e8-295e-49fe-82ca-4d4dfa83bf17]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a, portal: 172.16.0.220,3260]
Aug 14 13:59:17 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a, portal: 172.16.0.220,3260] successful.
Aug 14 13:59:17 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7df9b35-ec2a-434a-b867-250733642de0]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4c823e-a844-451a-b02b-539240ea91dd]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)
Aug 14 13:59:17 user nova-compute[73484]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)
Aug 14 13:59:17 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)
Aug 14 13:59:17 user nova-compute[73484]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)
Aug 14 13:59:17 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d6bc1d-de67-4b70-92ee-fdfe4520b2a4]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 13:59:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFGWoBRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 13:59:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:59:18 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26338613466653761', 'path': '/dev/sdc'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:59:18 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338613466653761', 'path': '/dev/sdc'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 13:59:18 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:56:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1008126369',display_name='tempest-TestMinimumBasicScenario-server-1008126369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1008126369',id=38,image_ref='7e9f7742-c3f5-492c-b4c8-212072532633',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4a8pn3Vvu6dQiHnUjxe5S47vZZcNV7BZnNmiXptsYleB+jhejPspwALEfKvnpz0zOvOfgUo98QUeJ8MA0+PLeMfsNuk9i0SCfN25RGVr1raXPMKT0/tB3wEblrXP1NQA==',key_name='tempest-TestMinimumBasicScenario-229925239',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:56:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1934a2112a584b82a20c4ae8c13a70db',ramdisk_id='',reservation_id='r-dafyuxae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7e9f7742-c3f5-492c-b4c8-212072532633',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-227652473',owner_user_name='tempest-TestMinimumBasicScenario-227652473-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:59:16Z,user_data=None,user_id='be2ee7c7641d4d0892cc3bc03f8340f1',uuid=a3282525-9822-4be9-8ef1-c213392c6267,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "address": "fa:16:3e:2e:7e:05", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce35860-fb", "ovs_interfaceid": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 13:59:18 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Converting VIF {"id": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "address": "fa:16:3e:2e:7e:05", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce35860-fb", "ovs_interfaceid": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:59:18 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:7e:05,bridge_name='br-int',has_traffic_filtering=True,id=7ce35860-fbe8-4c2b-9697-bf867ebe5b39,network=Network(b63f0a71-864e-4b2c-9602-fd57c50c5501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce35860-fb') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:59:18 user nova-compute[73484]: DEBUG nova.objects.instance [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lazy-loading 'pci_devices' on Instance uuid a3282525-9822-4be9-8ef1-c213392c6267 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:59:18 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] End _get_guest_xml xml=<domain type="kvm">
Aug 14 13:59:18 user nova-compute[73484]:   <uuid>a3282525-9822-4be9-8ef1-c213392c6267</uuid>
Aug 14 13:59:18 user nova-compute[73484]:   <name>instance-00000026</name>
Aug 14 13:59:18 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 13:59:18 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 13:59:18 user nova-compute[73484]:   <metadata>
Aug 14 13:59:18 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 13:59:18 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 13:59:18 user nova-compute[73484]:       <nova:name>tempest-TestMinimumBasicScenario-server-1008126369</nova:name>
Aug 14 13:59:18 user nova-compute[73484]:       <nova:creationTime>2023-08-14 13:59:17</nova:creationTime>
Aug 14 13:59:18 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 13:59:18 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 13:59:18 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 13:59:18 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 13:59:18 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 13:59:18 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 13:59:18 user nova-compute[73484]:       </nova:flavor>
Aug 14 13:59:18 user nova-compute[73484]:       <nova:owner>
Aug 14 13:59:18 user nova-compute[73484]:         <nova:user uuid="be2ee7c7641d4d0892cc3bc03f8340f1">tempest-TestMinimumBasicScenario-227652473-project-member</nova:user>
Aug 14 13:59:18 user nova-compute[73484]:         <nova:project uuid="1934a2112a584b82a20c4ae8c13a70db">tempest-TestMinimumBasicScenario-227652473</nova:project>
Aug 14 13:59:18 user nova-compute[73484]:       </nova:owner>
Aug 14 13:59:18 user nova-compute[73484]:       <nova:root type="image" uuid="7e9f7742-c3f5-492c-b4c8-212072532633"/>
Aug 14 13:59:18 user nova-compute[73484]:       <nova:ports>
Aug 14 13:59:18 user nova-compute[73484]:         <nova:port uuid="7ce35860-fbe8-4c2b-9697-bf867ebe5b39">
Aug 14 13:59:18 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 13:59:18 user nova-compute[73484]:         </nova:port>
Aug 14 13:59:18 user nova-compute[73484]:       </nova:ports>
Aug 14 13:59:18 user nova-compute[73484]:     </nova:instance>
Aug 14 13:59:18 user nova-compute[73484]:   </metadata>
Aug 14 13:59:18 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 13:59:18 user nova-compute[73484]:     <system>
Aug 14 13:59:18 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 13:59:18 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 13:59:18 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 13:59:18 user nova-compute[73484]:       <entry name="serial">a3282525-9822-4be9-8ef1-c213392c6267</entry>
Aug 14 13:59:18 user nova-compute[73484]:       <entry name="uuid">a3282525-9822-4be9-8ef1-c213392c6267</entry>
Aug 14 13:59:18 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 13:59:18 user nova-compute[73484]:     </system>
Aug 14 13:59:18 user nova-compute[73484]:   </sysinfo>
Aug 14 13:59:18 user nova-compute[73484]:   <os>
Aug 14 13:59:18 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 13:59:18 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 13:59:18 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 13:59:18 user nova-compute[73484]:   </os>
Aug 14 13:59:18 user nova-compute[73484]:   <features>
Aug 14 13:59:18 user nova-compute[73484]:     <acpi/>
Aug 14 13:59:18 user nova-compute[73484]:     <apic/>
Aug 14 13:59:18 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 13:59:18 user nova-compute[73484]:   </features>
Aug 14 13:59:18 user nova-compute[73484]:   <clock offset="utc">
Aug 14 13:59:18 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 13:59:18 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 13:59:18 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 13:59:18 user nova-compute[73484]:   </clock>
Aug 14 13:59:18 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 13:59:18 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 13:59:18 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 13:59:18 user nova-compute[73484]:   </cpu>
Aug 14 13:59:18 user nova-compute[73484]:   <devices>
Aug 14 13:59:18 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 13:59:18 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 13:59:18 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk"/>
Aug 14 13:59:18 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 13:59:18 user nova-compute[73484]:     </disk>
Aug 14 13:59:18 user nova-compute[73484]:     <disk type="block" device="disk">
Aug 14 13:59:18 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:59:18 user nova-compute[73484]:       <source dev="/dev/sdc"/>
Aug 14 13:59:18 user nova-compute[73484]:       <target dev="vdb" bus="virtio"/>
Aug 14 13:59:18 user nova-compute[73484]:       <serial>95f3d908-0a47-45e1-8a2d-c9d8b5c6004a</serial>
Aug 14 13:59:18 user nova-compute[73484]:     </disk>
Aug 14 13:59:18 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 13:59:18 user nova-compute[73484]:       <mac address="fa:16:3e:2e:7e:05"/>
Aug 14 13:59:18 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:59:18 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 13:59:18 user nova-compute[73484]:       <target dev="tap7ce35860-fb"/>
Aug 14 13:59:18 user nova-compute[73484]:     </interface>
Aug 14 13:59:18 user nova-compute[73484]:     <serial type="pty">
Aug 14 13:59:18 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/console.log" append="off"/>
Aug 14 13:59:18 user nova-compute[73484]:     </serial>
Aug 14 13:59:18 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 13:59:18 user nova-compute[73484]:     <video>
Aug 14 13:59:18 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 13:59:18 user nova-compute[73484]:     </video>
Aug 14 13:59:18 user nova-compute[73484]:     <rng model="virtio">
Aug 14 13:59:18 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 13:59:18 user nova-compute[73484]:     </rng>
Aug 14 13:59:18 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 13:59:18 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 13:59:18 user nova-compute[73484]:       <stats period="10"/>
Aug 14 13:59:18 user nova-compute[73484]:     </memballoon>
Aug 14 13:59:18 user nova-compute[73484]:   </devices>
Aug 14 13:59:18 user nova-compute[73484]: </domain>
Aug 14 13:59:18 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 13:59:18 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:59:19 user nova-compute[73484]: DEBUG nova.objects.instance [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lazy-loading 'trusted_certs' on Instance uuid a3282525-9822-4be9-8ef1-c213392c6267 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:59:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3fb9741552644df917dbf6ea1872c0b98835be1 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3fb9741552644df917dbf6ea1872c0b98835be1 --force-share --output=json" returned: 0 in 0.179s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:19 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 13:59:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:19 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Cannot resize image /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 13:59:19 user nova-compute[73484]: DEBUG nova.objects.instance [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lazy-loading 'migration_context' on Instance uuid a3282525-9822-4be9-8ef1-c213392c6267 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:59:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:56:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1008126369',display_name='tempest-TestMinimumBasicScenario-server-1008126369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1008126369',id=38,image_ref='7e9f7742-c3f5-492c-b4c8-212072532633',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4a8pn3Vvu6dQiHnUjxe5S47vZZcNV7BZnNmiXptsYleB+jhejPspwALEfKvnpz0zOvOfgUo98QUeJ8MA0+PLeMfsNuk9i0SCfN25RGVr1raXPMKT0/tB3wEblrXP1NQA==',key_name='tempest-TestMinimumBasicScenario-229925239',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:56:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='1934a2112a584b82a20c4ae8c13a70db',ramdisk_id='',reservation_id='r-dafyuxae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7e9f7742-c3f5-492c-b4c8-212072532633',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-227652473',owner_user_name='tempest-TestMinimumBasicScenario-227652473-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T13:59:16Z,user_data=None,user_id='be2ee7c7641d4d0892cc3bc03f8340f1',uuid=a3282525-9822-4be9-8ef1-c213392c6267,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "address": "fa:16:3e:2e:7e:05", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce35860-fb", "ovs_interfaceid": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 13:59:19 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Converting VIF {"id": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "address": "fa:16:3e:2e:7e:05", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce35860-fb", "ovs_interfaceid": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 13:59:19 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:7e:05,bridge_name='br-int',has_traffic_filtering=True,id=7ce35860-fbe8-4c2b-9697-bf867ebe5b39,network=Network(b63f0a71-864e-4b2c-9602-fd57c50c5501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce35860-fb') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 13:59:19 user nova-compute[73484]: DEBUG os_vif [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:7e:05,bridge_name='br-int',has_traffic_filtering=True,id=7ce35860-fbe8-4c2b-9697-bf867ebe5b39,network=Network(b63f0a71-864e-4b2c-9602-fd57c50c5501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce35860-fb') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 13:59:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:59:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 13:59:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ce35860-fb, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:59:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7ce35860-fb, col_values=(('external_ids', {'iface-id': '7ce35860-fbe8-4c2b-9697-bf867ebe5b39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:7e:05', 'vm-uuid': 'a3282525-9822-4be9-8ef1-c213392c6267'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 13:59:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:59:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:19 user nova-compute[73484]: INFO os_vif [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:7e:05,bridge_name='br-int',has_traffic_filtering=True,id=7ce35860-fbe8-4c2b-9697-bf867ebe5b39,network=Network(b63f0a71-864e-4b2c-9602-fd57c50c5501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce35860-fb')
Aug 14 13:59:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:21 user nova-compute[73484]: DEBUG nova.compute.manager [req-7cb1b65b-d1dc-453a-8999-3261a505bc51 req-66817d3f-f2a0-479e-9891-5f6ef34675cc service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Received event network-vif-plugged-7ce35860-fbe8-4c2b-9697-bf867ebe5b39 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:59:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-7cb1b65b-d1dc-453a-8999-3261a505bc51 req-66817d3f-f2a0-479e-9891-5f6ef34675cc service nova] Acquiring lock "a3282525-9822-4be9-8ef1-c213392c6267-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:59:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-7cb1b65b-d1dc-453a-8999-3261a505bc51 req-66817d3f-f2a0-479e-9891-5f6ef34675cc service nova] Lock "a3282525-9822-4be9-8ef1-c213392c6267-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:59:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-7cb1b65b-d1dc-453a-8999-3261a505bc51 req-66817d3f-f2a0-479e-9891-5f6ef34675cc service nova] Lock "a3282525-9822-4be9-8ef1-c213392c6267-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:59:21 user nova-compute[73484]: DEBUG nova.compute.manager [req-7cb1b65b-d1dc-453a-8999-3261a505bc51 req-66817d3f-f2a0-479e-9891-5f6ef34675cc service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] No waiting events found dispatching network-vif-plugged-7ce35860-fbe8-4c2b-9697-bf867ebe5b39 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:59:21 user nova-compute[73484]: WARNING nova.compute.manager [req-7cb1b65b-d1dc-453a-8999-3261a505bc51 req-66817d3f-f2a0-479e-9891-5f6ef34675cc service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Received unexpected event network-vif-plugged-7ce35860-fbe8-4c2b-9697-bf867ebe5b39 for instance with vm_state active and task_state reboot_started_hard.
Aug 14 13:59:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Removed pending event for a3282525-9822-4be9-8ef1-c213392c6267 due to event {{(pid=73484) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 13:59:23 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021563.2502248, a3282525-9822-4be9-8ef1-c213392c6267 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:59:23 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a3282525-9822-4be9-8ef1-c213392c6267] VM Resumed (Lifecycle Event)
Aug 14 13:59:23 user nova-compute[73484]: DEBUG nova.compute.manager [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 13:59:23 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Instance rebooted successfully.
Aug 14 13:59:23 user nova-compute[73484]: DEBUG nova.compute.manager [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:59:23 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:59:23 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:59:23 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a3282525-9822-4be9-8ef1-c213392c6267] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 14 13:59:23 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021563.2522628, a3282525-9822-4be9-8ef1-c213392c6267 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:59:23 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a3282525-9822-4be9-8ef1-c213392c6267] VM Started (Lifecycle Event)
Aug 14 13:59:23 user nova-compute[73484]: DEBUG nova.compute.manager [req-063c7508-eac5-459b-920f-795b71ae5a96 req-af77b0a0-5bfd-4bc7-be5b-9c4917eeca87 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Received event network-vif-plugged-7ce35860-fbe8-4c2b-9697-bf867ebe5b39 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:59:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-063c7508-eac5-459b-920f-795b71ae5a96 req-af77b0a0-5bfd-4bc7-be5b-9c4917eeca87 service nova] Acquiring lock "a3282525-9822-4be9-8ef1-c213392c6267-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:59:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-063c7508-eac5-459b-920f-795b71ae5a96 req-af77b0a0-5bfd-4bc7-be5b-9c4917eeca87 service nova] Lock "a3282525-9822-4be9-8ef1-c213392c6267-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:59:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-063c7508-eac5-459b-920f-795b71ae5a96 req-af77b0a0-5bfd-4bc7-be5b-9c4917eeca87 service nova] Lock "a3282525-9822-4be9-8ef1-c213392c6267-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:59:23 user nova-compute[73484]: DEBUG nova.compute.manager [req-063c7508-eac5-459b-920f-795b71ae5a96 req-af77b0a0-5bfd-4bc7-be5b-9c4917eeca87 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] No waiting events found dispatching network-vif-plugged-7ce35860-fbe8-4c2b-9697-bf867ebe5b39 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 13:59:23 user nova-compute[73484]: WARNING nova.compute.manager [req-063c7508-eac5-459b-920f-795b71ae5a96 req-af77b0a0-5bfd-4bc7-be5b-9c4917eeca87 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Received unexpected event network-vif-plugged-7ce35860-fbe8-4c2b-9697-bf867ebe5b39 for instance with vm_state active and task_state reboot_started_hard.
Aug 14 13:59:23 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:59:23 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 13:59:23 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a3282525-9822-4be9-8ef1-c213392c6267] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 14 13:59:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-533d580d-3ef3-4349-a9d5-f11af89cf738 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "a3282525-9822-4be9-8ef1-c213392c6267" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.647s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:59:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:29 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692021554.8568027, b6d97e05-3311-4372-90d7-b07004369a4d => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 13:59:29 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] VM Stopped (Lifecycle Event)
Aug 14 13:59:29 user nova-compute[73484]: DEBUG nova.compute.manager [None req-eeaef626-0fb2-46a2-89fe-da401db29052 None None] [instance: b6d97e05-3311-4372-90d7-b07004369a4d] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 13:59:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:59:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:59:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 13:59:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:59:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 13:59:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 13:59:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:45 user nova-compute[73484]: DEBUG nova.compute.manager [req-1866e8c9-5881-4270-9494-ac1877e47d61 req-4c20d8dc-7ad0-4a9c-9579-440944f9e3d0 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Received event network-changed-0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:59:45 user nova-compute[73484]: DEBUG nova.compute.manager [req-1866e8c9-5881-4270-9494-ac1877e47d61 req-4c20d8dc-7ad0-4a9c-9579-440944f9e3d0 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Refreshing instance network info cache due to event network-changed-0259d05a-9595-41f7-839d-28df692755fb. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:59:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1866e8c9-5881-4270-9494-ac1877e47d61 req-4c20d8dc-7ad0-4a9c-9579-440944f9e3d0 service nova] Acquiring lock "refresh_cache-14999671-dcc7-43fa-85ec-21cbcf12d21e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:59:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1866e8c9-5881-4270-9494-ac1877e47d61 req-4c20d8dc-7ad0-4a9c-9579-440944f9e3d0 service nova] Acquired lock "refresh_cache-14999671-dcc7-43fa-85ec-21cbcf12d21e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:59:45 user nova-compute[73484]: DEBUG nova.network.neutron [req-1866e8c9-5881-4270-9494-ac1877e47d61 req-4c20d8dc-7ad0-4a9c-9579-440944f9e3d0 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Refreshing network info cache for port 0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG nova.network.neutron [req-1866e8c9-5881-4270-9494-ac1877e47d61 req-4c20d8dc-7ad0-4a9c-9579-440944f9e3d0 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Updated VIF entry in instance network info cache for port 0259d05a-9595-41f7-839d-28df692755fb. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG nova.network.neutron [req-1866e8c9-5881-4270-9494-ac1877e47d61 req-4c20d8dc-7ad0-4a9c-9579-440944f9e3d0 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Updating instance_info_cache with network_info: [{"id": "0259d05a-9595-41f7-839d-28df692755fb", "address": "fa:16:3e:d5:7f:13", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0259d05a-95", "ovs_interfaceid": "0259d05a-9595-41f7-839d-28df692755fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "14999671-dcc7-43fa-85ec-21cbcf12d21e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1866e8c9-5881-4270-9494-ac1877e47d61 req-4c20d8dc-7ad0-4a9c-9579-440944f9e3d0 service nova] Releasing lock "refresh_cache-14999671-dcc7-43fa-85ec-21cbcf12d21e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:59:46 user nova-compute[73484]: INFO nova.compute.manager [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Detaching volume 241c2b81-26d1-4419-9710-d0add57160e5
Aug 14 13:59:46 user nova-compute[73484]: INFO nova.virt.block_device [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Attempting to driver detach volume 241c2b81-26d1-4419-9710-d0add57160e5 from mountpoint /dev/vdb
Aug 14 13:59:46 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Attempting to detach device vdb from instance 14999671-dcc7-43fa-85ec-21cbcf12d21e from the persistent domain config. {{(pid=73484) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:59:46 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:59:46 user nova-compute[73484]:   <source dev="/dev/sdb"/>
Aug 14 13:59:46 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:59:46 user nova-compute[73484]:   <serial>241c2b81-26d1-4419-9710-d0add57160e5</serial>
Aug 14 13:59:46 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 13:59:46 user nova-compute[73484]: </disk>
Aug 14 13:59:46 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:59:46 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Successfully detached device vdb from instance 14999671-dcc7-43fa-85ec-21cbcf12d21e from the persistent domain config.
Aug 14 13:59:46 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 14999671-dcc7-43fa-85ec-21cbcf12d21e from the live domain config. {{(pid=73484) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 13:59:46 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 13:59:46 user nova-compute[73484]:   <source dev="/dev/sdb"/>
Aug 14 13:59:46 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 13:59:46 user nova-compute[73484]:   <serial>241c2b81-26d1-4419-9710-d0add57160e5</serial>
Aug 14 13:59:46 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 13:59:46 user nova-compute[73484]: </disk>
Aug 14 13:59:46 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Received event <DeviceRemovedEvent: 1692021586.7977703, 14999671-dcc7-43fa-85ec-21cbcf12d21e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73484) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 14999671-dcc7-43fa-85ec-21cbcf12d21e {{(pid=73484) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 13:59:46 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Successfully detached device vdb from instance 14999671-dcc7-43fa-85ec-21cbcf12d21e from the live domain config.
Aug 14 13:59:46 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QflVkRMh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 13:59:46 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 13:59:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1666ea85-007a-4714-a353-ff4bc8d27272]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[88195db7-48db-481c-bd05-b61ef957e931]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)
Aug 14 13:59:46 user nova-compute[73484]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)
Aug 14 13:59:46 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 (non-flash)
Aug 14 13:59:46 user nova-compute[73484]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)
Aug 14 13:59:46 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc45865a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5'): ({'sdb'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Removing single pathed devices sdb {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9af1bf1-b147-4a4f-b4a2-b7da77cbbf73]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-14999671-dcc7-43fa-85ec-21cbcf12d21e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-14999671-dcc7-43fa-85ec-21cbcf12d21e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7702c27e-1e99-4b93-bdc0-26cd126014cb]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Flushing IO for device /dev/sdb {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba63f3e-86f1-4d8e-a9d1-c5021e49c15c]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3794c4d5-b659-4d02-a514-172fceae5916]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] SCSI volumes sdb have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 13:59:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:47 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a598fc57-9dfa-4769-b920-c8b7a1fc700c]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:59:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:59:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:47 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7224121-d61b-4e55-9f7e-050417da1a45]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:59:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5, portal: 172.16.0.220,3260]
Aug 14 13:59:47 user nova-compute[73484]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5, portal: 172.16.0.220,3260] successful.
Aug 14 13:59:47 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:59:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241c2b81-26d1-4419-9710-d0add57160e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:47 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f236678-104f-4bff-b2b1-dd445eb8089e]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 13:59:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 13:59:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 13:59:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] <== disconnect_volume: return (283ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 13:59:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 13:59:47 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Updating instance_info_cache with network_info: [{"id": "0259d05a-9595-41f7-839d-28df692755fb", "address": "fa:16:3e:d5:7f:13", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0259d05a-95", "ovs_interfaceid": "0259d05a-9595-41f7-839d-28df692755fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:59:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-14999671-dcc7-43fa-85ec-21cbcf12d21e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:59:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 13:59:47 user nova-compute[73484]: DEBUG nova.compute.manager [req-103c4f51-7452-444d-b147-80abcf23427a req-8bec6029-c36d-4f6a-a52b-695561e59ff3 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Received event network-changed-0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 13:59:47 user nova-compute[73484]: DEBUG nova.compute.manager [req-103c4f51-7452-444d-b147-80abcf23427a req-8bec6029-c36d-4f6a-a52b-695561e59ff3 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Refreshing instance network info cache due to event network-changed-0259d05a-9595-41f7-839d-28df692755fb. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 13:59:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-103c4f51-7452-444d-b147-80abcf23427a req-8bec6029-c36d-4f6a-a52b-695561e59ff3 service nova] Acquiring lock "refresh_cache-14999671-dcc7-43fa-85ec-21cbcf12d21e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 13:59:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-103c4f51-7452-444d-b147-80abcf23427a req-8bec6029-c36d-4f6a-a52b-695561e59ff3 service nova] Acquired lock "refresh_cache-14999671-dcc7-43fa-85ec-21cbcf12d21e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 13:59:47 user nova-compute[73484]: DEBUG nova.network.neutron [req-103c4f51-7452-444d-b147-80abcf23427a req-8bec6029-c36d-4f6a-a52b-695561e59ff3 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Refreshing network info cache for port 0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 13:59:47 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:59:47 user nova-compute[73484]: DEBUG nova.objects.instance [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'flavor' on Instance uuid 14999671-dcc7-43fa-85ec-21cbcf12d21e {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 13:59:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1699ff8e-bd54-4b09-a405-a00f18aca485 tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.689s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:59:48 user nova-compute[73484]: DEBUG nova.network.neutron [req-103c4f51-7452-444d-b147-80abcf23427a req-8bec6029-c36d-4f6a-a52b-695561e59ff3 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Updated VIF entry in instance network info cache for port 0259d05a-9595-41f7-839d-28df692755fb. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 13:59:48 user nova-compute[73484]: DEBUG nova.network.neutron [req-103c4f51-7452-444d-b147-80abcf23427a req-8bec6029-c36d-4f6a-a52b-695561e59ff3 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Updating instance_info_cache with network_info: [{"id": "0259d05a-9595-41f7-839d-28df692755fb", "address": "fa:16:3e:d5:7f:13", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0259d05a-95", "ovs_interfaceid": "0259d05a-9595-41f7-839d-28df692755fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 13:59:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-103c4f51-7452-444d-b147-80abcf23427a req-8bec6029-c36d-4f6a-a52b-695561e59ff3 service nova] Releasing lock "refresh_cache-14999671-dcc7-43fa-85ec-21cbcf12d21e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 13:59:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:53 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:59:53 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:59:53 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 13:59:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:54 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:59:56 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:59:56 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 13:59:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 13:59:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 13:59:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 13:59:56 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 13:59:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79d07235-a6fb-48ea-b2be-c140461e0cbb/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79d07235-a6fb-48ea-b2be-c140461e0cbb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79d07235-a6fb-48ea-b2be-c140461e0cbb/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79d07235-a6fb-48ea-b2be-c140461e0cbb/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/165b7234-2b91-482a-8532-5fc41e481e1e/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/165b7234-2b91-482a-8532-5fc41e481e1e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/165b7234-2b91-482a-8532-5fc41e481e1e/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/165b7234-2b91-482a-8532-5fc41e481e1e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75ff316d-3957-421c-9b55-1744fc7d4cce/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75ff316d-3957-421c-9b55-1744fc7d4cce/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75ff316d-3957-421c-9b55-1744fc7d4cce/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75ff316d-3957-421c-9b55-1744fc7d4cce/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 13:59:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 13:59:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 13:59:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 13:59:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:00 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:00:00 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:00:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=7722MB free_disk=25.045841217041016GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 14:00:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:00:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:00:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 782c6142-757a-49ae-9292-787a7f1e8a23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:00:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 03255d24-b6fd-459c-8ac6-f9c4063b54b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:00:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance b8a790d0-e5d0-4b78-8de4-36a58290b4ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:00:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 14999671-dcc7-43fa-85ec-21cbcf12d21e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:00:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance a3282525-9822-4be9-8ef1-c213392c6267 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:00:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 165b7234-2b91-482a-8532-5fc41e481e1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:00:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 75ff316d-3957-421c-9b55-1744fc7d4cce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:00:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 79d07235-a6fb-48ea-b2be-c140461e0cbb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:00:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 14:00:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 14:00:01 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:00:01 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:00:01 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 14:00:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:00:02 user nova-compute[73484]: DEBUG nova.compute.manager [req-2fb90cb1-9b60-4bc5-97a7-3a60ec3bf541 req-fa050871-de52-4e42-8392-87b8ac9859f2 service nova] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Received event network-changed-253e674d-b55e-4d07-a5f1-833901a27e9b {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:00:02 user nova-compute[73484]: DEBUG nova.compute.manager [req-2fb90cb1-9b60-4bc5-97a7-3a60ec3bf541 req-fa050871-de52-4e42-8392-87b8ac9859f2 service nova] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Refreshing instance network info cache due to event network-changed-253e674d-b55e-4d07-a5f1-833901a27e9b. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:00:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2fb90cb1-9b60-4bc5-97a7-3a60ec3bf541 req-fa050871-de52-4e42-8392-87b8ac9859f2 service nova] Acquiring lock "refresh_cache-165b7234-2b91-482a-8532-5fc41e481e1e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:00:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2fb90cb1-9b60-4bc5-97a7-3a60ec3bf541 req-fa050871-de52-4e42-8392-87b8ac9859f2 service nova] Acquired lock "refresh_cache-165b7234-2b91-482a-8532-5fc41e481e1e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:00:02 user nova-compute[73484]: DEBUG nova.network.neutron [req-2fb90cb1-9b60-4bc5-97a7-3a60ec3bf541 req-fa050871-de52-4e42-8392-87b8ac9859f2 service nova] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Refreshing network info cache for port 253e674d-b55e-4d07-a5f1-833901a27e9b {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:00:02 user nova-compute[73484]: DEBUG nova.network.neutron [req-2fb90cb1-9b60-4bc5-97a7-3a60ec3bf541 req-fa050871-de52-4e42-8392-87b8ac9859f2 service nova] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Updated VIF entry in instance network info cache for port 253e674d-b55e-4d07-a5f1-833901a27e9b. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:00:02 user nova-compute[73484]: DEBUG nova.network.neutron [req-2fb90cb1-9b60-4bc5-97a7-3a60ec3bf541 req-fa050871-de52-4e42-8392-87b8ac9859f2 service nova] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Updating instance_info_cache with network_info: [{"id": "253e674d-b55e-4d07-a5f1-833901a27e9b", "address": "fa:16:3e:d1:78:40", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap253e674d-b5", "ovs_interfaceid": "253e674d-b55e-4d07-a5f1-833901a27e9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:00:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2fb90cb1-9b60-4bc5-97a7-3a60ec3bf541 req-fa050871-de52-4e42-8392-87b8ac9859f2 service nova] Releasing lock "refresh_cache-165b7234-2b91-482a-8532-5fc41e481e1e" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:00:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6f3df72a-05cb-4715-bc0d-4bf619d16c85 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Acquiring lock "75ff316d-3957-421c-9b55-1744fc7d4cce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:00:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6f3df72a-05cb-4715-bc0d-4bf619d16c85 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "75ff316d-3957-421c-9b55-1744fc7d4cce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:00:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6f3df72a-05cb-4715-bc0d-4bf619d16c85 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Acquiring lock "75ff316d-3957-421c-9b55-1744fc7d4cce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:00:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6f3df72a-05cb-4715-bc0d-4bf619d16c85 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "75ff316d-3957-421c-9b55-1744fc7d4cce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:00:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6f3df72a-05cb-4715-bc0d-4bf619d16c85 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "75ff316d-3957-421c-9b55-1744fc7d4cce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:00:03 user nova-compute[73484]: INFO nova.compute.manager [None req-6f3df72a-05cb-4715-bc0d-4bf619d16c85 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Terminating instance
Aug 14 14:00:03 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6f3df72a-05cb-4715-bc0d-4bf619d16c85 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 14:00:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:04 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Instance destroyed successfully.
Aug 14 14:00:04 user nova-compute[73484]: DEBUG nova.objects.instance [None req-6f3df72a-05cb-4715-bc0d-4bf619d16c85 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lazy-loading 'resources' on Instance uuid 75ff316d-3957-421c-9b55-1744fc7d4cce {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:00:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-6f3df72a-05cb-4715-bc0d-4bf619d16c85 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:58:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1538035053',display_name='tempest-VolumesActionsTest-instance-1538035053',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1538035053',id=40,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:58:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a3a83ee8b254c66a0b9904abf8c65c5',ramdisk_id='',reservation_id='r-najilewt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1293487514',owner_user_name='tempest-VolumesActionsTest-1293487514-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:58:21Z,user_data=None,user_id='948dcb0982b745659f53c0d4d9a68a07',uuid=75ff316d-3957-421c-9b55-1744fc7d4cce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "acdc4fd3-cd24-470a-b845-f4893b062cb1", "address": "fa:16:3e:9a:6a:ec", "network": {"id": "0579994b-5b06-4838-87f7-e83438382cdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419510355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3a83ee8b254c66a0b9904abf8c65c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacdc4fd3-cd", "ovs_interfaceid": "acdc4fd3-cd24-470a-b845-f4893b062cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 14:00:04 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-6f3df72a-05cb-4715-bc0d-4bf619d16c85 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Converting VIF {"id": "acdc4fd3-cd24-470a-b845-f4893b062cb1", "address": "fa:16:3e:9a:6a:ec", "network": {"id": "0579994b-5b06-4838-87f7-e83438382cdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419510355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3a83ee8b254c66a0b9904abf8c65c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacdc4fd3-cd", "ovs_interfaceid": "acdc4fd3-cd24-470a-b845-f4893b062cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:00:04 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-6f3df72a-05cb-4715-bc0d-4bf619d16c85 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:6a:ec,bridge_name='br-int',has_traffic_filtering=True,id=acdc4fd3-cd24-470a-b845-f4893b062cb1,network=Network(0579994b-5b06-4838-87f7-e83438382cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacdc4fd3-cd') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:00:04 user nova-compute[73484]: DEBUG os_vif [None req-6f3df72a-05cb-4715-bc0d-4bf619d16c85 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:6a:ec,bridge_name='br-int',has_traffic_filtering=True,id=acdc4fd3-cd24-470a-b845-f4893b062cb1,network=Network(0579994b-5b06-4838-87f7-e83438382cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacdc4fd3-cd') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 14:00:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapacdc4fd3-cd, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:00:04 user nova-compute[73484]: DEBUG nova.compute.manager [req-adaf4caa-5803-492f-b827-36cda3d8f026 req-a7a5cfa2-ba7f-4bb0-8882-8816e100e1d2 service nova] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Received event network-vif-unplugged-acdc4fd3-cd24-470a-b845-f4893b062cb1 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:00:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-adaf4caa-5803-492f-b827-36cda3d8f026 req-a7a5cfa2-ba7f-4bb0-8882-8816e100e1d2 service nova] Acquiring lock "75ff316d-3957-421c-9b55-1744fc7d4cce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:00:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-adaf4caa-5803-492f-b827-36cda3d8f026 req-a7a5cfa2-ba7f-4bb0-8882-8816e100e1d2 service nova] Lock "75ff316d-3957-421c-9b55-1744fc7d4cce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:00:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-adaf4caa-5803-492f-b827-36cda3d8f026 req-a7a5cfa2-ba7f-4bb0-8882-8816e100e1d2 service nova] Lock "75ff316d-3957-421c-9b55-1744fc7d4cce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:00:04 user nova-compute[73484]: DEBUG nova.compute.manager [req-adaf4caa-5803-492f-b827-36cda3d8f026 req-a7a5cfa2-ba7f-4bb0-8882-8816e100e1d2 service nova] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] No waiting events found dispatching network-vif-unplugged-acdc4fd3-cd24-470a-b845-f4893b062cb1 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:00:04 user nova-compute[73484]: DEBUG nova.compute.manager [req-adaf4caa-5803-492f-b827-36cda3d8f026 req-a7a5cfa2-ba7f-4bb0-8882-8816e100e1d2 service nova] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Received event network-vif-unplugged-acdc4fd3-cd24-470a-b845-f4893b062cb1 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 14:00:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:00:04 user nova-compute[73484]: INFO os_vif [None req-6f3df72a-05cb-4715-bc0d-4bf619d16c85 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:6a:ec,bridge_name='br-int',has_traffic_filtering=True,id=acdc4fd3-cd24-470a-b845-f4893b062cb1,network=Network(0579994b-5b06-4838-87f7-e83438382cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacdc4fd3-cd')
Aug 14 14:00:04 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-6f3df72a-05cb-4715-bc0d-4bf619d16c85 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Deleting instance files /opt/stack/data/nova/instances/75ff316d-3957-421c-9b55-1744fc7d4cce_del
Aug 14 14:00:04 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-6f3df72a-05cb-4715-bc0d-4bf619d16c85 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Deletion of /opt/stack/data/nova/instances/75ff316d-3957-421c-9b55-1744fc7d4cce_del complete
Aug 14 14:00:04 user nova-compute[73484]: INFO nova.compute.manager [None req-6f3df72a-05cb-4715-bc0d-4bf619d16c85 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Took 0.83 seconds to destroy the instance on the hypervisor.
Aug 14 14:00:04 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-6f3df72a-05cb-4715-bc0d-4bf619d16c85 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 14:00:04 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 14:00:04 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 14:00:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:04 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:00:04 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Took 0.60 seconds to deallocate network for instance.
Aug 14 14:00:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6f3df72a-05cb-4715-bc0d-4bf619d16c85 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:00:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6f3df72a-05cb-4715-bc0d-4bf619d16c85 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:00:05 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6f3df72a-05cb-4715-bc0d-4bf619d16c85 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:00:05 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6f3df72a-05cb-4715-bc0d-4bf619d16c85 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:00:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6f3df72a-05cb-4715-bc0d-4bf619d16c85 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:00:05 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-6f3df72a-05cb-4715-bc0d-4bf619d16c85 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Deleted allocations for instance 75ff316d-3957-421c-9b55-1744fc7d4cce
Aug 14 14:00:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6f3df72a-05cb-4715-bc0d-4bf619d16c85 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "75ff316d-3957-421c-9b55-1744fc7d4cce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.941s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:00:06 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:00:06 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:00:06 user nova-compute[73484]: DEBUG nova.compute.manager [req-399e7256-5fd5-47f9-8bc7-e032ff74ed05 req-bbfafd87-65d5-4170-85cd-473b68297017 service nova] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Received event network-vif-plugged-acdc4fd3-cd24-470a-b845-f4893b062cb1 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:00:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-399e7256-5fd5-47f9-8bc7-e032ff74ed05 req-bbfafd87-65d5-4170-85cd-473b68297017 service nova] Acquiring lock "75ff316d-3957-421c-9b55-1744fc7d4cce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:00:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-399e7256-5fd5-47f9-8bc7-e032ff74ed05 req-bbfafd87-65d5-4170-85cd-473b68297017 service nova] Lock "75ff316d-3957-421c-9b55-1744fc7d4cce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:00:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-399e7256-5fd5-47f9-8bc7-e032ff74ed05 req-bbfafd87-65d5-4170-85cd-473b68297017 service nova] Lock "75ff316d-3957-421c-9b55-1744fc7d4cce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:00:06 user nova-compute[73484]: DEBUG nova.compute.manager [req-399e7256-5fd5-47f9-8bc7-e032ff74ed05 req-bbfafd87-65d5-4170-85cd-473b68297017 service nova] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] No waiting events found dispatching network-vif-plugged-acdc4fd3-cd24-470a-b845-f4893b062cb1 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:00:06 user nova-compute[73484]: WARNING nova.compute.manager [req-399e7256-5fd5-47f9-8bc7-e032ff74ed05 req-bbfafd87-65d5-4170-85cd-473b68297017 service nova] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Received unexpected event network-vif-plugged-acdc4fd3-cd24-470a-b845-f4893b062cb1 for instance with vm_state deleted and task_state None.
Aug 14 14:00:06 user nova-compute[73484]: DEBUG nova.compute.manager [req-399e7256-5fd5-47f9-8bc7-e032ff74ed05 req-bbfafd87-65d5-4170-85cd-473b68297017 service nova] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Received event network-vif-deleted-acdc4fd3-cd24-470a-b845-f4893b062cb1 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:00:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "165b7234-2b91-482a-8532-5fc41e481e1e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:00:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "165b7234-2b91-482a-8532-5fc41e481e1e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:00:06 user nova-compute[73484]: DEBUG nova.objects.instance [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lazy-loading 'flavor' on Instance uuid 165b7234-2b91-482a-8532-5fc41e481e1e {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:00:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "165b7234-2b91-482a-8532-5fc41e481e1e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:00:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "165b7234-2b91-482a-8532-5fc41e481e1e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:00:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "165b7234-2b91-482a-8532-5fc41e481e1e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:00:07 user nova-compute[73484]: INFO nova.compute.manager [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Attaching volume 20c4f3b8-0219-425a-a1c4-20a4312bc278 to /dev/vdb
Aug 14 14:00:07 user nova-compute[73484]: DEBUG os_brick.utils [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:00:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:07 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[23440bb1-26a6-4326-b255-2f4343291bf4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:07 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c011d583-add3-401c-b2b5-755184f96750]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:07 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6af242-9fc4-41e3-8ea5-bee18f95aaef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:07 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d0d614-a8fc-4743-8f14-fed841c9450a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:00:07 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 14:00:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:00:07 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 14:00:07 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1038837d-739d-411b-93e6-6dec39b78ee3]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:07 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 14:00:07 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 14:00:07 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 14:00:07 user nova-compute[73484]: DEBUG os_brick.utils [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:00:07 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Updating existing volume attachment record: bccf2b74-358f-4eec-a43a-58561ff011a0 {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 14:00:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:11 user nova-compute[73484]: DEBUG nova.compute.manager [req-74a4b5b0-f01d-4e25-896c-b439fb72199d req-64206107-89f2-44d9-b338-c8748af982be service nova] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Received event network-changed-13b6f45e-f6e7-43c5-9347-92e4fd59e9a8 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:00:11 user nova-compute[73484]: DEBUG nova.compute.manager [req-74a4b5b0-f01d-4e25-896c-b439fb72199d req-64206107-89f2-44d9-b338-c8748af982be service nova] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Refreshing instance network info cache due to event network-changed-13b6f45e-f6e7-43c5-9347-92e4fd59e9a8. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:00:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-74a4b5b0-f01d-4e25-896c-b439fb72199d req-64206107-89f2-44d9-b338-c8748af982be service nova] Acquiring lock "refresh_cache-79d07235-a6fb-48ea-b2be-c140461e0cbb" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:00:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-74a4b5b0-f01d-4e25-896c-b439fb72199d req-64206107-89f2-44d9-b338-c8748af982be service nova] Acquired lock "refresh_cache-79d07235-a6fb-48ea-b2be-c140461e0cbb" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:00:11 user nova-compute[73484]: DEBUG nova.network.neutron [req-74a4b5b0-f01d-4e25-896c-b439fb72199d req-64206107-89f2-44d9-b338-c8748af982be service nova] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Refreshing network info cache for port 13b6f45e-f6e7-43c5-9347-92e4fd59e9a8 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:00:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "79d07235-a6fb-48ea-b2be-c140461e0cbb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:00:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "79d07235-a6fb-48ea-b2be-c140461e0cbb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:00:11 user nova-compute[73484]: DEBUG nova.objects.instance [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lazy-loading 'flavor' on Instance uuid 79d07235-a6fb-48ea-b2be-c140461e0cbb {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:00:11 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Ignoring supplied device name: /dev/vdb
Aug 14 14:00:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "79d07235-a6fb-48ea-b2be-c140461e0cbb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:00:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "79d07235-a6fb-48ea-b2be-c140461e0cbb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:00:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "79d07235-a6fb-48ea-b2be-c140461e0cbb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:00:12 user nova-compute[73484]: INFO nova.compute.manager [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Attaching volume 98e0e7b2-367d-434a-961a-4a83cb98f5a5 to /dev/vdb
Aug 14 14:00:12 user nova-compute[73484]: DEBUG os_brick.utils [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:00:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:12 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[400cbd21-9339-452d-a1f5-c932a8209d04]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:12 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3edd87-d2be-4b85-a1f3-e4ec33e0a77a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:12 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4febae7a-af47-4b72-9a79-49b81e13dfac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:12 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4886ca-d827-4997-963d-9af9dec33324]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:00:12 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 14:00:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:00:12 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 14:00:12 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d870606-7040-4f68-b828-cf951e47abfd]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:12 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 14:00:12 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 14:00:12 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 14:00:12 user nova-compute[73484]: DEBUG os_brick.utils [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:00:12 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Updating existing volume attachment record: 4024e1cf-f4cd-4d22-a9de-73c619f17faf {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 14:00:12 user nova-compute[73484]: DEBUG nova.network.neutron [req-74a4b5b0-f01d-4e25-896c-b439fb72199d req-64206107-89f2-44d9-b338-c8748af982be service nova] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Updated VIF entry in instance network info cache for port 13b6f45e-f6e7-43c5-9347-92e4fd59e9a8. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:00:12 user nova-compute[73484]: DEBUG nova.network.neutron [req-74a4b5b0-f01d-4e25-896c-b439fb72199d req-64206107-89f2-44d9-b338-c8748af982be service nova] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Updating instance_info_cache with network_info: [{"id": "13b6f45e-f6e7-43c5-9347-92e4fd59e9a8", "address": "fa:16:3e:60:b7:8a", "network": {"id": "3458700f-a875-4968-8ae8-464e9ce8ab81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1812819141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4707f4d9cd47c2b988af4fdaf685ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b6f45e-f6", "ovs_interfaceid": "13b6f45e-f6e7-43c5-9347-92e4fd59e9a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:00:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-74a4b5b0-f01d-4e25-896c-b439fb72199d req-64206107-89f2-44d9-b338-c8748af982be service nova] Releasing lock "refresh_cache-79d07235-a6fb-48ea-b2be-c140461e0cbb" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:00:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTDfMIFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:00:16 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:00:16 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:00:16 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:00:16 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:00:16 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b8e513-ec37-46ba-8c3b-4bc90c5f18ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 14:00:16 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278 -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dfcec1-0317-423f-9a6a-acceb3201f1a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278] added
Aug 14 14:00:16 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5242799-4942-4e2b-aba2-d38038211c59]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0644b56-07fe-48d5-aa6a-647ffb5d7656]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cTDfMIFX {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cTDfMIFX" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e5612e-4b42-4c14-9177-4dce09d74e7a]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cTDfMIFX'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65e9aed-1605-43a9-8c1d-ddc43406bc65]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b6140c-a214-4e7d-b803-fb9ee9e9a311]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)
Aug 14 14:00:16 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)
Aug 14 14:00:16 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278 -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e782bbc6-cf36-4c37-853f-a83be61acbf7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278, portal: 172.16.0.220,3260]
Aug 14 14:00:16 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278, portal: 172.16.0.220,3260] successful.
Aug 14 14:00:16 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fd8355-7a1f-4278-9daa-145dce222d12]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[285310ea-7d4e-4c90-a964-320c63a6fc58]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)
Aug 14 14:00:16 user nova-compute[73484]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278 (non-flash)
Aug 14 14:00:16 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)
Aug 14 14:00:16 user nova-compute[73484]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278 (non-flash)
Aug 14 14:00:16 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0dc63d-2256-4c27-8c9d-f5f606ca4939]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTDfMIFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG nova.compute.manager [req-2392bf5b-2709-4916-88e8-7b6a9807a122 req-7dff8336-738e-4e90-9f55-c490ad9a0e43 service nova] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Received event network-changed-b5ceef09-ab2f-4db8-8c7b-c239fc361daf {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG nova.compute.manager [req-2392bf5b-2709-4916-88e8-7b6a9807a122 req-7dff8336-738e-4e90-9f55-c490ad9a0e43 service nova] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Refreshing instance network info cache due to event network-changed-b5ceef09-ab2f-4db8-8c7b-c239fc361daf. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2392bf5b-2709-4916-88e8-7b6a9807a122 req-7dff8336-738e-4e90-9f55-c490ad9a0e43 service nova] Acquiring lock "refresh_cache-b8a790d0-e5d0-4b78-8de4-36a58290b4ee" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2392bf5b-2709-4916-88e8-7b6a9807a122 req-7dff8336-738e-4e90-9f55-c490ad9a0e43 service nova] Acquired lock "refresh_cache-b8a790d0-e5d0-4b78-8de4-36a58290b4ee" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG nova.network.neutron [req-2392bf5b-2709-4916-88e8-7b6a9807a122 req-7dff8336-738e-4e90-9f55-c490ad9a0e43 service nova] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Refreshing network info cache for port b5ceef09-ab2f-4db8-8c7b-c239fc361daf {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-389fb434-8ab1-437a-979d-69f36c8c40f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquiring lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-389fb434-8ab1-437a-979d-69f36c8c40f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-389fb434-8ab1-437a-979d-69f36c8c40f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquiring lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-389fb434-8ab1-437a-979d-69f36c8c40f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-389fb434-8ab1-437a-979d-69f36c8c40f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:00:16 user nova-compute[73484]: INFO nova.compute.manager [None req-389fb434-8ab1-437a-979d-69f36c8c40f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Terminating instance
Aug 14 14:00:16 user nova-compute[73484]: DEBUG nova.compute.manager [None req-389fb434-8ab1-437a-979d-69f36c8c40f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:17 user nova-compute[73484]: DEBUG nova.network.neutron [req-2392bf5b-2709-4916-88e8-7b6a9807a122 req-7dff8336-738e-4e90-9f55-c490ad9a0e43 service nova] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Updated VIF entry in instance network info cache for port b5ceef09-ab2f-4db8-8c7b-c239fc361daf. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:00:17 user nova-compute[73484]: DEBUG nova.network.neutron [req-2392bf5b-2709-4916-88e8-7b6a9807a122 req-7dff8336-738e-4e90-9f55-c490ad9a0e43 service nova] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Updating instance_info_cache with network_info: [{"id": "b5ceef09-ab2f-4db8-8c7b-c239fc361daf", "address": "fa:16:3e:60:5a:aa", "network": {"id": "8f719ef2-7286-46f1-96e0-d08fd389db0e", "bridge": "br-int", "label": "tempest-TestStampPattern-1811054691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a442b6e525b4ae9ba256aa1c71e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ceef09-ab", "ovs_interfaceid": "b5ceef09-ab2f-4db8-8c7b-c239fc361daf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:00:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2392bf5b-2709-4916-88e8-7b6a9807a122 req-7dff8336-738e-4e90-9f55-c490ad9a0e43 service nova] Releasing lock "refresh_cache-b8a790d0-e5d0-4b78-8de4-36a58290b4ee" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:00:17 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Instance destroyed successfully.
Aug 14 14:00:17 user nova-compute[73484]: DEBUG nova.objects.instance [None req-389fb434-8ab1-437a-979d-69f36c8c40f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lazy-loading 'resources' on Instance uuid b8a790d0-e5d0-4b78-8de4-36a58290b4ee {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:00:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-389fb434-8ab1-437a-979d-69f36c8c40f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1407297266',display_name='tempest-TestStampPattern-server-1407297266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1407297266',id=34,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcHOndY4thu+Li/XG3hWqIOD4cGsaZ6per43xYR1P6MSwf1FXn+zuKlHDSmWjudBpUwpsq+XH3XDp8yg1o4KErin8MFeGY1rhZ0UCW+BGzI3wFo1KaDX12K6RUas0q53g==',key_name='tempest-TestStampPattern-1459796457',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:53:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a442b6e525b4ae9ba256aa1c71e1a94',ramdisk_id='',reservation_id='r-fn3so310',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-678241444',owner_user_name='tempest-TestStampPattern-678241444-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:56:13Z,user_data=None,user_id='e9d4aa3f4ad04184bb6181332a6ef6e1',uuid=b8a790d0-e5d0-4b78-8de4-36a58290b4ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5ceef09-ab2f-4db8-8c7b-c239fc361daf", "address": "fa:16:3e:60:5a:aa", "network": {"id": "8f719ef2-7286-46f1-96e0-d08fd389db0e", "bridge": "br-int", "label": "tempest-TestStampPattern-1811054691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a442b6e525b4ae9ba256aa1c71e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ceef09-ab", "ovs_interfaceid": "b5ceef09-ab2f-4db8-8c7b-c239fc361daf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 14:00:17 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-389fb434-8ab1-437a-979d-69f36c8c40f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Converting VIF {"id": "b5ceef09-ab2f-4db8-8c7b-c239fc361daf", "address": "fa:16:3e:60:5a:aa", "network": {"id": "8f719ef2-7286-46f1-96e0-d08fd389db0e", "bridge": "br-int", "label": "tempest-TestStampPattern-1811054691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a442b6e525b4ae9ba256aa1c71e1a94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5ceef09-ab", "ovs_interfaceid": "b5ceef09-ab2f-4db8-8c7b-c239fc361daf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:00:17 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-389fb434-8ab1-437a-979d-69f36c8c40f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:5a:aa,bridge_name='br-int',has_traffic_filtering=True,id=b5ceef09-ab2f-4db8-8c7b-c239fc361daf,network=Network(8f719ef2-7286-46f1-96e0-d08fd389db0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ceef09-ab') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:00:17 user nova-compute[73484]: DEBUG os_vif [None req-389fb434-8ab1-437a-979d-69f36c8c40f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:5a:aa,bridge_name='br-int',has_traffic_filtering=True,id=b5ceef09-ab2f-4db8-8c7b-c239fc361daf,network=Network(8f719ef2-7286-46f1-96e0-d08fd389db0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ceef09-ab') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 14:00:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5ceef09-ab, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:00:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:00:17 user nova-compute[73484]: INFO os_vif [None req-389fb434-8ab1-437a-979d-69f36c8c40f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:5a:aa,bridge_name='br-int',has_traffic_filtering=True,id=b5ceef09-ab2f-4db8-8c7b-c239fc361daf,network=Network(8f719ef2-7286-46f1-96e0-d08fd389db0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5ceef09-ab')
Aug 14 14:00:17 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-389fb434-8ab1-437a-979d-69f36c8c40f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Deleting instance files /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee_del
Aug 14 14:00:17 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-389fb434-8ab1-437a-979d-69f36c8c40f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Deletion of /opt/stack/data/nova/instances/b8a790d0-e5d0-4b78-8de4-36a58290b4ee_del complete
Aug 14 14:00:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:00:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26437386337376531', 'path': '/dev/sdb'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:00:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437386337376531', 'path': '/dev/sdb'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 14:00:17 user nova-compute[73484]: DEBUG nova.objects.instance [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lazy-loading 'flavor' on Instance uuid 165b7234-2b91-482a-8532-5fc41e481e1e {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:00:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 14:00:17 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:00:17 user nova-compute[73484]:   <source dev="/dev/sdb"/>
Aug 14 14:00:17 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 14:00:17 user nova-compute[73484]:   <serial>20c4f3b8-0219-425a-a1c4-20a4312bc278</serial>
Aug 14 14:00:17 user nova-compute[73484]: </disk>
Aug 14 14:00:17 user nova-compute[73484]:  {{(pid=73484) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 14:00:17 user nova-compute[73484]: INFO nova.compute.manager [None req-389fb434-8ab1-437a-979d-69f36c8c40f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 14 14:00:17 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-389fb434-8ab1-437a-979d-69f36c8c40f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 14:00:17 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 14:00:17 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 14:00:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:00:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:00:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] No VIF found with MAC fa:16:3e:d1:78:40, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:00:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-ae471783-d82d-4eb5-9e22-a68dc8220326 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "165b7234-2b91-482a-8532-5fc41e481e1e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.819s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:00:18 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:00:18 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Took 0.57 seconds to deallocate network for instance.
Aug 14 14:00:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-38be9784-80b1-4110-9e3d-b440e1eaf9f4 req-11a51bcd-203b-451d-a83d-d89b9c89ed5d service nova] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Received event network-vif-deleted-b5ceef09-ab2f-4db8-8c7b-c239fc361daf {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:00:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-389fb434-8ab1-437a-979d-69f36c8c40f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:00:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-389fb434-8ab1-437a-979d-69f36c8c40f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:00:18 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-389fb434-8ab1-437a-979d-69f36c8c40f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:00:18 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-389fb434-8ab1-437a-979d-69f36c8c40f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:00:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-389fb434-8ab1-437a-979d-69f36c8c40f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.250s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:00:18 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-389fb434-8ab1-437a-979d-69f36c8c40f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Deleted allocations for instance b8a790d0-e5d0-4b78-8de4-36a58290b4ee
Aug 14 14:00:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-389fb434-8ab1-437a-979d-69f36c8c40f6 tempest-TestStampPattern-678241444 tempest-TestStampPattern-678241444-project-member] Lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.982s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:00:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-46878120-9f0a-48be-9380-204b8fda2574 req-0a7922a7-fee9-4c5c-98b6-1d71148c2ae5 service nova] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Received event network-vif-unplugged-b5ceef09-ab2f-4db8-8c7b-c239fc361daf {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:00:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-46878120-9f0a-48be-9380-204b8fda2574 req-0a7922a7-fee9-4c5c-98b6-1d71148c2ae5 service nova] Acquiring lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:00:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-46878120-9f0a-48be-9380-204b8fda2574 req-0a7922a7-fee9-4c5c-98b6-1d71148c2ae5 service nova] Lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:00:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-46878120-9f0a-48be-9380-204b8fda2574 req-0a7922a7-fee9-4c5c-98b6-1d71148c2ae5 service nova] Lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:00:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-46878120-9f0a-48be-9380-204b8fda2574 req-0a7922a7-fee9-4c5c-98b6-1d71148c2ae5 service nova] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] No waiting events found dispatching network-vif-unplugged-b5ceef09-ab2f-4db8-8c7b-c239fc361daf {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:00:18 user nova-compute[73484]: WARNING nova.compute.manager [req-46878120-9f0a-48be-9380-204b8fda2574 req-0a7922a7-fee9-4c5c-98b6-1d71148c2ae5 service nova] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Received unexpected event network-vif-unplugged-b5ceef09-ab2f-4db8-8c7b-c239fc361daf for instance with vm_state deleted and task_state None.
Aug 14 14:00:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-46878120-9f0a-48be-9380-204b8fda2574 req-0a7922a7-fee9-4c5c-98b6-1d71148c2ae5 service nova] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Received event network-vif-plugged-b5ceef09-ab2f-4db8-8c7b-c239fc361daf {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:00:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-46878120-9f0a-48be-9380-204b8fda2574 req-0a7922a7-fee9-4c5c-98b6-1d71148c2ae5 service nova] Acquiring lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:00:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-46878120-9f0a-48be-9380-204b8fda2574 req-0a7922a7-fee9-4c5c-98b6-1d71148c2ae5 service nova] Lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:00:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-46878120-9f0a-48be-9380-204b8fda2574 req-0a7922a7-fee9-4c5c-98b6-1d71148c2ae5 service nova] Lock "b8a790d0-e5d0-4b78-8de4-36a58290b4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:00:18 user nova-compute[73484]: DEBUG nova.compute.manager [req-46878120-9f0a-48be-9380-204b8fda2574 req-0a7922a7-fee9-4c5c-98b6-1d71148c2ae5 service nova] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] No waiting events found dispatching network-vif-plugged-b5ceef09-ab2f-4db8-8c7b-c239fc361daf {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:00:18 user nova-compute[73484]: WARNING nova.compute.manager [req-46878120-9f0a-48be-9380-204b8fda2574 req-0a7922a7-fee9-4c5c-98b6-1d71148c2ae5 service nova] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Received unexpected event network-vif-plugged-b5ceef09-ab2f-4db8-8c7b-c239fc361daf for instance with vm_state deleted and task_state None.
Aug 14 14:00:19 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692021604.2088392, 75ff316d-3957-421c-9b55-1744fc7d4cce => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:00:19 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] VM Stopped (Lifecycle Event)
Aug 14 14:00:19 user nova-compute[73484]: DEBUG nova.compute.manager [None req-f9ae3025-14da-49a7-af7d-4eb91a6dc5b1 None None] [instance: 75ff316d-3957-421c-9b55-1744fc7d4cce] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:00:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "165b7234-2b91-482a-8532-5fc41e481e1e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:00:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "165b7234-2b91-482a-8532-5fc41e481e1e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:00:19 user nova-compute[73484]: INFO nova.compute.manager [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Detaching volume 20c4f3b8-0219-425a-a1c4-20a4312bc278
Aug 14 14:00:19 user nova-compute[73484]: INFO nova.virt.block_device [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Attempting to driver detach volume 20c4f3b8-0219-425a-a1c4-20a4312bc278 from mountpoint /dev/vdb
Aug 14 14:00:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Attempting to detach device vdb from instance 165b7234-2b91-482a-8532-5fc41e481e1e from the persistent domain config. {{(pid=73484) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 14:00:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 14:00:19 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:00:19 user nova-compute[73484]:   <source dev="/dev/sdb"/>
Aug 14 14:00:19 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 14:00:19 user nova-compute[73484]:   <serial>20c4f3b8-0219-425a-a1c4-20a4312bc278</serial>
Aug 14 14:00:19 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 14:00:19 user nova-compute[73484]: </disk>
Aug 14 14:00:19 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 14:00:19 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Successfully detached device vdb from instance 165b7234-2b91-482a-8532-5fc41e481e1e from the persistent domain config.
Aug 14 14:00:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 165b7234-2b91-482a-8532-5fc41e481e1e from the live domain config. {{(pid=73484) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 14:00:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 14:00:19 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:00:19 user nova-compute[73484]:   <source dev="/dev/sdb"/>
Aug 14 14:00:19 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 14:00:19 user nova-compute[73484]:   <serial>20c4f3b8-0219-425a-a1c4-20a4312bc278</serial>
Aug 14 14:00:19 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 14:00:19 user nova-compute[73484]: </disk>
Aug 14 14:00:19 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 14:00:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Received event <DeviceRemovedEvent: 1692021619.9732466, 165b7234-2b91-482a-8532-5fc41e481e1e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73484) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 14:00:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 165b7234-2b91-482a-8532-5fc41e481e1e {{(pid=73484) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 14:00:19 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Successfully detached device vdb from instance 165b7234-2b91-482a-8532-5fc41e481e1e from the live domain config.
Aug 14 14:00:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 14:00:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTDfMIFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:00:19 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:00:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:00:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:00:19 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 14:00:19 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[77212eeb-48e4-43d1-b97e-ac5d3c5af6f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c70f602-814f-4a5c-9763-65088097b19c]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)
Aug 14 14:00:20 user nova-compute[73484]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278 (non-flash)
Aug 14 14:00:20 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)
Aug 14 14:00:20 user nova-compute[73484]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278 (non-flash)
Aug 14 14:00:20 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4586505e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278'): ({'sdb'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Removing single pathed devices sdb {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cf1cdd-88f9-4dd9-9949-819d4d81a2fc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[808a5b15-ad16-414f-8d02-d6a117ef4b28]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Flushing IO for device /dev/sdb {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f6f21e-7a8b-412f-9cd2-08bbd1782754]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f24c2cb-7a4d-4b76-99ed-fb33c8695f7f]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] SCSI volumes sdb have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e756aece-0105-48af-8cfd-048b2171b5b5]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278 -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c24e77f-49ed-4065-a6e7-00641f0fa766]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278, portal: 172.16.0.220,3260]
Aug 14 14:00:20 user nova-compute[73484]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278, portal: 172.16.0.220,3260] successful.
Aug 14 14:00:20 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278 -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20c4f3b8-0219-425a-a1c4-20a4312bc278 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[366bf40f-616a-490c-9e6b-dbd63c0f4d5d]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] <== disconnect_volume: return (270ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:00:20 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG nova.objects.instance [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lazy-loading 'flavor' on Instance uuid 165b7234-2b91-482a-8532-5fc41e481e1e {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c2a159d1-5a16-48d4-980a-ec15ab962ff9 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "165b7234-2b91-482a-8532-5fc41e481e1e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.698s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrBeWZNO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:00:21 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:00:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:00:21 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:00:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:00:21 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0772d1b-f255-4857-8b40-b5653cd092b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 14:00:21 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[98941022-7734-48fe-bc21-fe1858f86265]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5] added
Aug 14 14:00:21 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dfe0e9-bf47-405a-ba5b-0ce862b460dc]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b77dc7-8ca5-4fda-aae3-b9c6d778a7b5]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zrBeWZNO {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zrBeWZNO" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09ff50b-8413-4967-88f7-8837fd0947fe]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zrBeWZNO'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[78553c82-dba4-467d-b5a8-e9c0d2376ed0]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c77fab-1011-491b-809d-dace859f5a69]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)
Aug 14 14:00:21 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)
Aug 14 14:00:21 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5 -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93c31aa-3d34-426f-b57b-35949fd78b1f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5, portal: 172.16.0.220,3260]
Aug 14 14:00:21 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5, portal: 172.16.0.220,3260] successful.
Aug 14 14:00:21 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03fc097-8609-4b79-8d6e-76ded4359a16]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4a2306-fde3-41d0-92f9-8854f381af97]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)
Aug 14 14:00:21 user nova-compute[73484]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5 (non-flash)
Aug 14 14:00:21 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)
Aug 14 14:00:21 user nova-compute[73484]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5 (non-flash)
Aug 14 14:00:21 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b533664a-15eb-45b1-8cd1-94a0c6c27af1]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 14:00:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrBeWZNO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 14:00:22 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:22 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:00:22 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23437383666326338', 'path': '/dev/sdb'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:00:22 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437383666326338', 'path': '/dev/sdb'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 14:00:22 user nova-compute[73484]: DEBUG nova.objects.instance [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lazy-loading 'flavor' on Instance uuid 79d07235-a6fb-48ea-b2be-c140461e0cbb {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:00:22 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 14:00:22 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:00:22 user nova-compute[73484]:   <source dev="/dev/sdb"/>
Aug 14 14:00:22 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 14:00:22 user nova-compute[73484]:   <serial>98e0e7b2-367d-434a-961a-4a83cb98f5a5</serial>
Aug 14 14:00:22 user nova-compute[73484]: </disk>
Aug 14 14:00:22 user nova-compute[73484]:  {{(pid=73484) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 14:00:22 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:00:22 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:00:22 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] No VIF found with MAC fa:16:3e:60:b7:8a, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:00:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0dc33d18-fddb-4fbe-a1f1-6b226ca97c7e tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "79d07235-a6fb-48ea-b2be-c140461e0cbb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.875s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:00:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:00:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:32 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692021617.2485886, b8a790d0-e5d0-4b78-8de4-36a58290b4ee => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:00:32 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] VM Stopped (Lifecycle Event)
Aug 14 14:00:32 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a118a177-3036-4a20-a198-d6dbee527c69 None None] [instance: b8a790d0-e5d0-4b78-8de4-36a58290b4ee] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:00:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d5d8a9eb-254f-4212-89ac-131cea0f684f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "14999671-dcc7-43fa-85ec-21cbcf12d21e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:00:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d5d8a9eb-254f-4212-89ac-131cea0f684f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:00:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d5d8a9eb-254f-4212-89ac-131cea0f684f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:00:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d5d8a9eb-254f-4212-89ac-131cea0f684f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:00:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d5d8a9eb-254f-4212-89ac-131cea0f684f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:00:36 user nova-compute[73484]: INFO nova.compute.manager [None req-d5d8a9eb-254f-4212-89ac-131cea0f684f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Terminating instance
Aug 14 14:00:36 user nova-compute[73484]: DEBUG nova.compute.manager [None req-d5d8a9eb-254f-4212-89ac-131cea0f684f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 14:00:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:36 user nova-compute[73484]: DEBUG nova.compute.manager [req-07f18d7c-c80a-4cb1-9301-8c3856d9f290 req-bc6dc7e2-1d10-4a8a-a0bc-fd0119324a5a service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Received event network-vif-unplugged-0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:00:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-07f18d7c-c80a-4cb1-9301-8c3856d9f290 req-bc6dc7e2-1d10-4a8a-a0bc-fd0119324a5a service nova] Acquiring lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:00:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-07f18d7c-c80a-4cb1-9301-8c3856d9f290 req-bc6dc7e2-1d10-4a8a-a0bc-fd0119324a5a service nova] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:00:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-07f18d7c-c80a-4cb1-9301-8c3856d9f290 req-bc6dc7e2-1d10-4a8a-a0bc-fd0119324a5a service nova] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:00:36 user nova-compute[73484]: DEBUG nova.compute.manager [req-07f18d7c-c80a-4cb1-9301-8c3856d9f290 req-bc6dc7e2-1d10-4a8a-a0bc-fd0119324a5a service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] No waiting events found dispatching network-vif-unplugged-0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:00:36 user nova-compute[73484]: DEBUG nova.compute.manager [req-07f18d7c-c80a-4cb1-9301-8c3856d9f290 req-bc6dc7e2-1d10-4a8a-a0bc-fd0119324a5a service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Received event network-vif-unplugged-0259d05a-9595-41f7-839d-28df692755fb for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 14:00:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:37 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Instance destroyed successfully.
Aug 14 14:00:37 user nova-compute[73484]: DEBUG nova.objects.instance [None req-d5d8a9eb-254f-4212-89ac-131cea0f684f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'resources' on Instance uuid 14999671-dcc7-43fa-85ec-21cbcf12d21e {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:00:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-d5d8a9eb-254f-4212-89ac-131cea0f684f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:53:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1791866722',display_name='tempest-ServerRescueNegativeTestJSON-server-1791866722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1791866722',id=35,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3FYahLoEeUzNQJsn+wqCzTl530H2uPDPATXW4sHxE7PqRzLmegfqzUhGXPfxcf8H5RdoHzVzXWdXYqXzLUllkhrrm06OkmmRQEVmYHqQEwUs5b1Jjk2rMUzKxmZrvCqg==',key_name='tempest-keypair-476477973',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:56:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f4df46bcfb843b7ac6c17d106703950',ramdisk_id='',reservation_id='r-zkhhqpeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-496474583',owner_user_name='tempest-ServerRescueNegativeTestJSON-496474583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:57:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45d86b9371024e3d95ece74ccb2c37d9',uuid=14999671-dcc7-43fa-85ec-21cbcf12d21e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0259d05a-9595-41f7-839d-28df692755fb", "address": "fa:16:3e:d5:7f:13", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0259d05a-95", "ovs_interfaceid": "0259d05a-9595-41f7-839d-28df692755fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 14:00:37 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-d5d8a9eb-254f-4212-89ac-131cea0f684f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Converting VIF {"id": "0259d05a-9595-41f7-839d-28df692755fb", "address": "fa:16:3e:d5:7f:13", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0259d05a-95", "ovs_interfaceid": "0259d05a-9595-41f7-839d-28df692755fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:00:37 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-d5d8a9eb-254f-4212-89ac-131cea0f684f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:7f:13,bridge_name='br-int',has_traffic_filtering=True,id=0259d05a-9595-41f7-839d-28df692755fb,network=Network(cad53782-5ecf-4140-b113-62e807bf87df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0259d05a-95') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:00:37 user nova-compute[73484]: DEBUG os_vif [None req-d5d8a9eb-254f-4212-89ac-131cea0f684f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:7f:13,bridge_name='br-int',has_traffic_filtering=True,id=0259d05a-9595-41f7-839d-28df692755fb,network=Network(cad53782-5ecf-4140-b113-62e807bf87df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0259d05a-95') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 14:00:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0259d05a-95, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:00:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:00:37 user nova-compute[73484]: INFO os_vif [None req-d5d8a9eb-254f-4212-89ac-131cea0f684f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:7f:13,bridge_name='br-int',has_traffic_filtering=True,id=0259d05a-9595-41f7-839d-28df692755fb,network=Network(cad53782-5ecf-4140-b113-62e807bf87df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0259d05a-95')
Aug 14 14:00:37 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-d5d8a9eb-254f-4212-89ac-131cea0f684f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Deleting instance files /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e_del
Aug 14 14:00:37 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-d5d8a9eb-254f-4212-89ac-131cea0f684f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Deletion of /opt/stack/data/nova/instances/14999671-dcc7-43fa-85ec-21cbcf12d21e_del complete
Aug 14 14:00:37 user nova-compute[73484]: INFO nova.compute.manager [None req-d5d8a9eb-254f-4212-89ac-131cea0f684f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 14 14:00:37 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-d5d8a9eb-254f-4212-89ac-131cea0f684f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 14:00:37 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 14:00:37 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 14:00:38 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:00:38 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Took 1.02 seconds to deallocate network for instance.
Aug 14 14:00:38 user nova-compute[73484]: DEBUG nova.compute.manager [req-488816be-a8a4-42c9-8a86-313095f5cf3a req-1e4f7855-6a81-461e-b83a-956936a57d1d service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Received event network-vif-deleted-0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:00:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d5d8a9eb-254f-4212-89ac-131cea0f684f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:00:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d5d8a9eb-254f-4212-89ac-131cea0f684f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:00:38 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-d5d8a9eb-254f-4212-89ac-131cea0f684f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:00:38 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-d5d8a9eb-254f-4212-89ac-131cea0f684f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:00:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d5d8a9eb-254f-4212-89ac-131cea0f684f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:00:38 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-d5d8a9eb-254f-4212-89ac-131cea0f684f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Deleted allocations for instance 14999671-dcc7-43fa-85ec-21cbcf12d21e
Aug 14 14:00:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d5d8a9eb-254f-4212-89ac-131cea0f684f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.286s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:00:38 user nova-compute[73484]: DEBUG nova.compute.manager [req-1cf0f9b0-077e-462e-beef-62afd1162a8c req-a879d494-102f-47f4-b965-3d30d098ea90 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Received event network-vif-plugged-0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:00:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1cf0f9b0-077e-462e-beef-62afd1162a8c req-a879d494-102f-47f4-b965-3d30d098ea90 service nova] Acquiring lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:00:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1cf0f9b0-077e-462e-beef-62afd1162a8c req-a879d494-102f-47f4-b965-3d30d098ea90 service nova] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:00:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1cf0f9b0-077e-462e-beef-62afd1162a8c req-a879d494-102f-47f4-b965-3d30d098ea90 service nova] Lock "14999671-dcc7-43fa-85ec-21cbcf12d21e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:00:38 user nova-compute[73484]: DEBUG nova.compute.manager [req-1cf0f9b0-077e-462e-beef-62afd1162a8c req-a879d494-102f-47f4-b965-3d30d098ea90 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] No waiting events found dispatching network-vif-plugged-0259d05a-9595-41f7-839d-28df692755fb {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:00:38 user nova-compute[73484]: WARNING nova.compute.manager [req-1cf0f9b0-077e-462e-beef-62afd1162a8c req-a879d494-102f-47f4-b965-3d30d098ea90 service nova] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Received unexpected event network-vif-plugged-0259d05a-9595-41f7-839d-28df692755fb for instance with vm_state deleted and task_state None.
Aug 14 14:00:42 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:47 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:00:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 14:00:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Didn't find any instances for network info cache update. {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 14:00:49 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:00:52 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692021637.334132, 14999671-dcc7-43fa-85ec-21cbcf12d21e => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:00:52 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] VM Stopped (Lifecycle Event)
Aug 14 14:00:52 user nova-compute[73484]: DEBUG nova.compute.manager [None req-b799d6b1-9737-43a8-8090-bc4111056cde None None] [instance: 14999671-dcc7-43fa-85ec-21cbcf12d21e] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:00:52 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:00:53 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:00:54 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:00:54 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:00:54 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 14:00:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Acquiring lock "1f76f07a-33c6-466e-9008-a31589f5c870" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:00:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "1f76f07a-33c6-466e-9008-a31589f5c870" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:00:55 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 14:00:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:00:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:00:55 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 14:00:55 user nova-compute[73484]: INFO nova.compute.claims [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Claim successful on node user
Aug 14 14:00:55 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:00:55 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:00:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.293s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:00:55 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 14:00:55 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 14:00:55 user nova-compute[73484]: DEBUG nova.network.neutron [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 14:00:55 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 14:00:55 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 14:00:55 user nova-compute[73484]: DEBUG nova.policy [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '948dcb0982b745659f53c0d4d9a68a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3a83ee8b254c66a0b9904abf8c65c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 14:00:55 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 14:00:55 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 14:00:55 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Creating image(s)
Aug 14 14:00:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Acquiring lock "/opt/stack/data/nova/instances/1f76f07a-33c6-466e-9008-a31589f5c870/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:00:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "/opt/stack/data/nova/instances/1f76f07a-33c6-466e-9008-a31589f5c870/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:00:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "/opt/stack/data/nova/instances/1f76f07a-33c6-466e-9008-a31589f5c870/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:00:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.182s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:00:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:00:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.174s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/1f76f07a-33c6-466e-9008-a31589f5c870/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/1f76f07a-33c6-466e-9008-a31589f5c870/disk 1073741824" returned: 0 in 0.051s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:00:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:56 user nova-compute[73484]: DEBUG nova.network.neutron [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Successfully created port: 41a9a017-ad62-448b-b319-0cf66bc85dba {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 14:00:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.204s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:56 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1f76f07a-33c6-466e-9008-a31589f5c870/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 14:00:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f76f07a-33c6-466e-9008-a31589f5c870/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f76f07a-33c6-466e-9008-a31589f5c870/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:56 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Cannot resize image /opt/stack/data/nova/instances/1f76f07a-33c6-466e-9008-a31589f5c870/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 14:00:56 user nova-compute[73484]: DEBUG nova.objects.instance [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lazy-loading 'migration_context' on Instance uuid 1f76f07a-33c6-466e-9008-a31589f5c870 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:00:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 14:00:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Ensure instance console log exists: /opt/stack/data/nova/instances/1f76f07a-33c6-466e-9008-a31589f5c870/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 14:00:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:00:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:00:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:00:56 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:00:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:00:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:00:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:00:56 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79d07235-a6fb-48ea-b2be-c140461e0cbb/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79d07235-a6fb-48ea-b2be-c140461e0cbb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79d07235-a6fb-48ea-b2be-c140461e0cbb/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79d07235-a6fb-48ea-b2be-c140461e0cbb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG nova.network.neutron [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Successfully updated port: 41a9a017-ad62-448b-b319-0cf66bc85dba {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Acquiring lock "refresh_cache-1f76f07a-33c6-466e-9008-a31589f5c870" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Acquired lock "refresh_cache-1f76f07a-33c6-466e-9008-a31589f5c870" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG nova.network.neutron [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG nova.compute.manager [req-d5ecf065-400a-4603-bcae-208e78f380a4 req-b20afea9-1c7c-4d64-9e6f-86a00d6a944e service nova] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Received event network-changed-41a9a017-ad62-448b-b319-0cf66bc85dba {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG nova.compute.manager [req-d5ecf065-400a-4603-bcae-208e78f380a4 req-b20afea9-1c7c-4d64-9e6f-86a00d6a944e service nova] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Refreshing instance network info cache due to event network-changed-41a9a017-ad62-448b-b319-0cf66bc85dba. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d5ecf065-400a-4603-bcae-208e78f380a4 req-b20afea9-1c7c-4d64-9e6f-86a00d6a944e service nova] Acquiring lock "refresh_cache-1f76f07a-33c6-466e-9008-a31589f5c870" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG nova.network.neutron [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG nova.network.neutron [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Updating instance_info_cache with network_info: [{"id": "41a9a017-ad62-448b-b319-0cf66bc85dba", "address": "fa:16:3e:e3:10:da", "network": {"id": "0579994b-5b06-4838-87f7-e83438382cdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419510355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3a83ee8b254c66a0b9904abf8c65c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a9a017-ad", "ovs_interfaceid": "41a9a017-ad62-448b-b319-0cf66bc85dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Releasing lock "refresh_cache-1f76f07a-33c6-466e-9008-a31589f5c870" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Instance network_info: |[{"id": "41a9a017-ad62-448b-b319-0cf66bc85dba", "address": "fa:16:3e:e3:10:da", "network": {"id": "0579994b-5b06-4838-87f7-e83438382cdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419510355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3a83ee8b254c66a0b9904abf8c65c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a9a017-ad", "ovs_interfaceid": "41a9a017-ad62-448b-b319-0cf66bc85dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d5ecf065-400a-4603-bcae-208e78f380a4 req-b20afea9-1c7c-4d64-9e6f-86a00d6a944e service nova] Acquired lock "refresh_cache-1f76f07a-33c6-466e-9008-a31589f5c870" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG nova.network.neutron [req-d5ecf065-400a-4603-bcae-208e78f380a4 req-b20afea9-1c7c-4d64-9e6f-86a00d6a944e service nova] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Refreshing network info cache for port 41a9a017-ad62-448b-b319-0cf66bc85dba {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Start _get_guest_xml network_info=[{"id": "41a9a017-ad62-448b-b319-0cf66bc85dba", "address": "fa:16:3e:e3:10:da", "network": {"id": "0579994b-5b06-4838-87f7-e83438382cdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419510355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3a83ee8b254c66a0b9904abf8c65c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a9a017-ad", "ovs_interfaceid": "41a9a017-ad62-448b-b319-0cf66bc85dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 14:00:57 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:00:57 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:00:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 14:00:57 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-302972027',display_name='tempest-VolumesActionsTest-instance-302972027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-302972027',id=42,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a3a83ee8b254c66a0b9904abf8c65c5',ramdisk_id='',reservation_id='r-62e2gwnp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1293487514',owner_user_name='tempest-VolumesActionsTest-1293487514-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:00:56Z,user_data=None,user_id='948dcb0982b745659f53c0d4d9a68a07',uuid=1f76f07a-33c6-466e-9008-a31589f5c870,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41a9a017-ad62-448b-b319-0cf66bc85dba", "address": "fa:16:3e:e3:10:da", "network": {"id": "0579994b-5b06-4838-87f7-e83438382cdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419510355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3a83ee8b254c66a0b9904abf8c65c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a9a017-ad", "ovs_interfaceid": "41a9a017-ad62-448b-b319-0cf66bc85dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Converting VIF {"id": "41a9a017-ad62-448b-b319-0cf66bc85dba", "address": "fa:16:3e:e3:10:da", "network": {"id": "0579994b-5b06-4838-87f7-e83438382cdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419510355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3a83ee8b254c66a0b9904abf8c65c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a9a017-ad", "ovs_interfaceid": "41a9a017-ad62-448b-b319-0cf66bc85dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:10:da,bridge_name='br-int',has_traffic_filtering=True,id=41a9a017-ad62-448b-b319-0cf66bc85dba,network=Network(0579994b-5b06-4838-87f7-e83438382cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a9a017-ad') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG nova.objects.instance [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f76f07a-33c6-466e-9008-a31589f5c870 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] End _get_guest_xml xml=<domain type="kvm">
Aug 14 14:00:58 user nova-compute[73484]:   <uuid>1f76f07a-33c6-466e-9008-a31589f5c870</uuid>
Aug 14 14:00:58 user nova-compute[73484]:   <name>instance-0000002a</name>
Aug 14 14:00:58 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 14:00:58 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 14:00:58 user nova-compute[73484]:   <metadata>
Aug 14 14:00:58 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 14:00:58 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 14:00:58 user nova-compute[73484]:       <nova:name>tempest-VolumesActionsTest-instance-302972027</nova:name>
Aug 14 14:00:58 user nova-compute[73484]:       <nova:creationTime>2023-08-14 14:00:57</nova:creationTime>
Aug 14 14:00:58 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 14:00:58 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 14:00:58 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 14:00:58 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 14:00:58 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 14:00:58 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 14:00:58 user nova-compute[73484]:       </nova:flavor>
Aug 14 14:00:58 user nova-compute[73484]:       <nova:owner>
Aug 14 14:00:58 user nova-compute[73484]:         <nova:user uuid="948dcb0982b745659f53c0d4d9a68a07">tempest-VolumesActionsTest-1293487514-project-member</nova:user>
Aug 14 14:00:58 user nova-compute[73484]:         <nova:project uuid="8a3a83ee8b254c66a0b9904abf8c65c5">tempest-VolumesActionsTest-1293487514</nova:project>
Aug 14 14:00:58 user nova-compute[73484]:       </nova:owner>
Aug 14 14:00:58 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 14:00:58 user nova-compute[73484]:       <nova:ports>
Aug 14 14:00:58 user nova-compute[73484]:         <nova:port uuid="41a9a017-ad62-448b-b319-0cf66bc85dba">
Aug 14 14:00:58 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 14:00:58 user nova-compute[73484]:         </nova:port>
Aug 14 14:00:58 user nova-compute[73484]:       </nova:ports>
Aug 14 14:00:58 user nova-compute[73484]:     </nova:instance>
Aug 14 14:00:58 user nova-compute[73484]:   </metadata>
Aug 14 14:00:58 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 14:00:58 user nova-compute[73484]:     <system>
Aug 14 14:00:58 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 14:00:58 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 14:00:58 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 14:00:58 user nova-compute[73484]:       <entry name="serial">1f76f07a-33c6-466e-9008-a31589f5c870</entry>
Aug 14 14:00:58 user nova-compute[73484]:       <entry name="uuid">1f76f07a-33c6-466e-9008-a31589f5c870</entry>
Aug 14 14:00:58 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 14:00:58 user nova-compute[73484]:     </system>
Aug 14 14:00:58 user nova-compute[73484]:   </sysinfo>
Aug 14 14:00:58 user nova-compute[73484]:   <os>
Aug 14 14:00:58 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 14:00:58 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 14:00:58 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 14:00:58 user nova-compute[73484]:   </os>
Aug 14 14:00:58 user nova-compute[73484]:   <features>
Aug 14 14:00:58 user nova-compute[73484]:     <acpi/>
Aug 14 14:00:58 user nova-compute[73484]:     <apic/>
Aug 14 14:00:58 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 14:00:58 user nova-compute[73484]:   </features>
Aug 14 14:00:58 user nova-compute[73484]:   <clock offset="utc">
Aug 14 14:00:58 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 14:00:58 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 14:00:58 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 14:00:58 user nova-compute[73484]:   </clock>
Aug 14 14:00:58 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 14:00:58 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 14:00:58 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 14:00:58 user nova-compute[73484]:   </cpu>
Aug 14 14:00:58 user nova-compute[73484]:   <devices>
Aug 14 14:00:58 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 14:00:58 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 14:00:58 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/1f76f07a-33c6-466e-9008-a31589f5c870/disk"/>
Aug 14 14:00:58 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 14:00:58 user nova-compute[73484]:     </disk>
Aug 14 14:00:58 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 14:00:58 user nova-compute[73484]:       <mac address="fa:16:3e:e3:10:da"/>
Aug 14 14:00:58 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 14:00:58 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 14:00:58 user nova-compute[73484]:       <target dev="tap41a9a017-ad"/>
Aug 14 14:00:58 user nova-compute[73484]:     </interface>
Aug 14 14:00:58 user nova-compute[73484]:     <serial type="pty">
Aug 14 14:00:58 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/1f76f07a-33c6-466e-9008-a31589f5c870/console.log" append="off"/>
Aug 14 14:00:58 user nova-compute[73484]:     </serial>
Aug 14 14:00:58 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 14:00:58 user nova-compute[73484]:     <video>
Aug 14 14:00:58 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 14:00:58 user nova-compute[73484]:     </video>
Aug 14 14:00:58 user nova-compute[73484]:     <rng model="virtio">
Aug 14 14:00:58 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 14:00:58 user nova-compute[73484]:     </rng>
Aug 14 14:00:58 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 14:00:58 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 14:00:58 user nova-compute[73484]:       <stats period="10"/>
Aug 14 14:00:58 user nova-compute[73484]:     </memballoon>
Aug 14 14:00:58 user nova-compute[73484]:   </devices>
Aug 14 14:00:58 user nova-compute[73484]: </domain>
Aug 14 14:00:58 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-302972027',display_name='tempest-VolumesActionsTest-instance-302972027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-302972027',id=42,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a3a83ee8b254c66a0b9904abf8c65c5',ramdisk_id='',reservation_id='r-62e2gwnp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1293487514',owner_user_name='tempest-VolumesActionsTest-1293487514-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:00:56Z,user_data=None,user_id='948dcb0982b745659f53c0d4d9a68a07',uuid=1f76f07a-33c6-466e-9008-a31589f5c870,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41a9a017-ad62-448b-b319-0cf66bc85dba", "address": "fa:16:3e:e3:10:da", "network": {"id": "0579994b-5b06-4838-87f7-e83438382cdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419510355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3a83ee8b254c66a0b9904abf8c65c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a9a017-ad", "ovs_interfaceid": "41a9a017-ad62-448b-b319-0cf66bc85dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Converting VIF {"id": "41a9a017-ad62-448b-b319-0cf66bc85dba", "address": "fa:16:3e:e3:10:da", "network": {"id": "0579994b-5b06-4838-87f7-e83438382cdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419510355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3a83ee8b254c66a0b9904abf8c65c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a9a017-ad", "ovs_interfaceid": "41a9a017-ad62-448b-b319-0cf66bc85dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:10:da,bridge_name='br-int',has_traffic_filtering=True,id=41a9a017-ad62-448b-b319-0cf66bc85dba,network=Network(0579994b-5b06-4838-87f7-e83438382cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a9a017-ad') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG os_vif [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:10:da,bridge_name='br-int',has_traffic_filtering=True,id=41a9a017-ad62-448b-b319-0cf66bc85dba,network=Network(0579994b-5b06-4838-87f7-e83438382cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a9a017-ad') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41a9a017-ad, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap41a9a017-ad, col_values=(('external_ids', {'iface-id': '41a9a017-ad62-448b-b319-0cf66bc85dba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:10:da', 'vm-uuid': '1f76f07a-33c6-466e-9008-a31589f5c870'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:58 user nova-compute[73484]: INFO os_vif [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:10:da,bridge_name='br-int',has_traffic_filtering=True,id=41a9a017-ad62-448b-b319-0cf66bc85dba,network=Network(0579994b-5b06-4838-87f7-e83438382cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a9a017-ad')
Aug 14 14:00:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/165b7234-2b91-482a-8532-5fc41e481e1e/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] No VIF found with MAC fa:16:3e:e3:10:da, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/165b7234-2b91-482a-8532-5fc41e481e1e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/165b7234-2b91-482a-8532-5fc41e481e1e/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG nova.network.neutron [req-d5ecf065-400a-4603-bcae-208e78f380a4 req-b20afea9-1c7c-4d64-9e6f-86a00d6a944e service nova] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Updated VIF entry in instance network info cache for port 41a9a017-ad62-448b-b319-0cf66bc85dba. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG nova.network.neutron [req-d5ecf065-400a-4603-bcae-208e78f380a4 req-b20afea9-1c7c-4d64-9e6f-86a00d6a944e service nova] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Updating instance_info_cache with network_info: [{"id": "41a9a017-ad62-448b-b319-0cf66bc85dba", "address": "fa:16:3e:e3:10:da", "network": {"id": "0579994b-5b06-4838-87f7-e83438382cdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419510355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3a83ee8b254c66a0b9904abf8c65c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a9a017-ad", "ovs_interfaceid": "41a9a017-ad62-448b-b319-0cf66bc85dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d5ecf065-400a-4603-bcae-208e78f380a4 req-b20afea9-1c7c-4d64-9e6f-86a00d6a944e service nova] Releasing lock "refresh_cache-1f76f07a-33c6-466e-9008-a31589f5c870" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/165b7234-2b91-482a-8532-5fc41e481e1e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "79d07235-a6fb-48ea-b2be-c140461e0cbb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:00:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "79d07235-a6fb-48ea-b2be-c140461e0cbb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:00:59 user nova-compute[73484]: INFO nova.compute.manager [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Detaching volume 98e0e7b2-367d-434a-961a-4a83cb98f5a5
Aug 14 14:00:59 user nova-compute[73484]: INFO nova.virt.block_device [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Attempting to driver detach volume 98e0e7b2-367d-434a-961a-4a83cb98f5a5 from mountpoint /dev/vdb
Aug 14 14:00:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "79d07235-a6fb-48ea-b2be-c140461e0cbb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:00:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Attempting to detach device vdb from instance 79d07235-a6fb-48ea-b2be-c140461e0cbb from the persistent domain config. {{(pid=73484) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 14:00:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 14:00:59 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:00:59 user nova-compute[73484]:   <source dev="/dev/sdb"/>
Aug 14 14:00:59 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 14:00:59 user nova-compute[73484]:   <serial>98e0e7b2-367d-434a-961a-4a83cb98f5a5</serial>
Aug 14 14:00:59 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 14:00:59 user nova-compute[73484]: </disk>
Aug 14 14:00:59 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 14:00:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 14:00:59 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Successfully detached device vdb from instance 79d07235-a6fb-48ea-b2be-c140461e0cbb from the persistent domain config.
Aug 14 14:00:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 79d07235-a6fb-48ea-b2be-c140461e0cbb from the live domain config. {{(pid=73484) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 14:00:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 14:00:59 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:00:59 user nova-compute[73484]:   <source dev="/dev/sdb"/>
Aug 14 14:00:59 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 14:00:59 user nova-compute[73484]:   <serial>98e0e7b2-367d-434a-961a-4a83cb98f5a5</serial>
Aug 14 14:00:59 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 14:00:59 user nova-compute[73484]: </disk>
Aug 14 14:00:59 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 14:00:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:00:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Received event <DeviceRemovedEvent: 1692021659.8716598, 79d07235-a6fb-48ea-b2be-c140461e0cbb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73484) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 14:00:59 user nova-compute[73484]: DEBUG nova.compute.manager [req-c3d1251f-6138-47ff-be6a-de4e24d7b727 req-668d6ca7-2e1e-401a-8630-95ae16faa542 service nova] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Received event network-vif-plugged-41a9a017-ad62-448b-b319-0cf66bc85dba {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:00:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c3d1251f-6138-47ff-be6a-de4e24d7b727 req-668d6ca7-2e1e-401a-8630-95ae16faa542 service nova] Acquiring lock "1f76f07a-33c6-466e-9008-a31589f5c870-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:00:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c3d1251f-6138-47ff-be6a-de4e24d7b727 req-668d6ca7-2e1e-401a-8630-95ae16faa542 service nova] Lock "1f76f07a-33c6-466e-9008-a31589f5c870-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:00:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c3d1251f-6138-47ff-be6a-de4e24d7b727 req-668d6ca7-2e1e-401a-8630-95ae16faa542 service nova] Lock "1f76f07a-33c6-466e-9008-a31589f5c870-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:00:59 user nova-compute[73484]: DEBUG nova.compute.manager [req-c3d1251f-6138-47ff-be6a-de4e24d7b727 req-668d6ca7-2e1e-401a-8630-95ae16faa542 service nova] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] No waiting events found dispatching network-vif-plugged-41a9a017-ad62-448b-b319-0cf66bc85dba {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:00:59 user nova-compute[73484]: WARNING nova.compute.manager [req-c3d1251f-6138-47ff-be6a-de4e24d7b727 req-668d6ca7-2e1e-401a-8630-95ae16faa542 service nova] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Received unexpected event network-vif-plugged-41a9a017-ad62-448b-b319-0cf66bc85dba for instance with vm_state building and task_state spawning.
Aug 14 14:00:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 79d07235-a6fb-48ea-b2be-c140461e0cbb {{(pid=73484) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 14:00:59 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Successfully detached device vdb from instance 79d07235-a6fb-48ea-b2be-c140461e0cbb from the live domain config.
Aug 14 14:00:59 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:00:59 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:00:59 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=8183MB free_disk=25.216693878173828GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 14:00:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:00:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:00:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 14:00:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrBeWZNO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:00:59 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:00:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:00:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:00:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 14:00:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e41a5f-711a-4e74-87f4-5aa031174c0e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:00:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:00:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19b5fb1-bc5a-4ad1-a6d0-a7f3cef54150]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:00:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)
Aug 14 14:00:59 user nova-compute[73484]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5 (non-flash)
Aug 14 14:00:59 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:00:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)
Aug 14 14:00:59 user nova-compute[73484]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5 (non-flash)
Aug 14 14:00:59 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:00:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc478676680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5'): ({'sdb'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Removing single pathed devices sdb {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[99260a9d-5a37-4ea7-b0c2-cf39698d6bd1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 782c6142-757a-49ae-9292-787a7f1e8a23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 03255d24-b6fd-459c-8ac6-f9c4063b54b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance a3282525-9822-4be9-8ef1-c213392c6267 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 165b7234-2b91-482a-8532-5fc41e481e1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 79d07235-a6fb-48ea-b2be-c140461e0cbb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 1f76f07a-33c6-466e-9008-a31589f5c870 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefd3163-c88f-4c48-860d-4e9eb18536d5]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Flushing IO for device /dev/sdb {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f107338-748c-4377-8a51-ed1afac99421]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.073s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c83c104-9ddb-41af-80e2-fa775147606d]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] SCSI volumes sdb have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a489768-b2b6-4561-891d-6980817bdd99]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5 -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3163f88-add5-43b3-a92d-02a948dc2b5e]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5, portal: 172.16.0.220,3260]
Aug 14 14:01:00 user nova-compute[73484]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5, portal: 172.16.0.220,3260] successful.
Aug 14 14:01:00 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5 -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b286e3e2-161c-4873-8375-893ff4981bf3]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] <== disconnect_volume: return (359ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 14:01:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.398s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG nova.objects.instance [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lazy-loading 'flavor' on Instance uuid 79d07235-a6fb-48ea-b2be-c140461e0cbb {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7fd95361-2012-4ce9-91d3-6e7727536981 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "79d07235-a6fb-48ea-b2be-c140461e0cbb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.037s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "79d07235-a6fb-48ea-b2be-c140461e0cbb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.932s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "79d07235-a6fb-48ea-b2be-c140461e0cbb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "79d07235-a6fb-48ea-b2be-c140461e0cbb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "79d07235-a6fb-48ea-b2be-c140461e0cbb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:01:01 user nova-compute[73484]: INFO nova.compute.manager [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Terminating instance
Aug 14 14:01:01 user nova-compute[73484]: DEBUG nova.compute.manager [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG nova.compute.manager [req-cdb5941f-49ca-4f5f-8f78-5cc9b2fc3cc2 req-086f28c1-d530-4ec1-a9f3-b7c233d91802 service nova] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Received event network-vif-plugged-41a9a017-ad62-448b-b319-0cf66bc85dba {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-cdb5941f-49ca-4f5f-8f78-5cc9b2fc3cc2 req-086f28c1-d530-4ec1-a9f3-b7c233d91802 service nova] Acquiring lock "1f76f07a-33c6-466e-9008-a31589f5c870-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-cdb5941f-49ca-4f5f-8f78-5cc9b2fc3cc2 req-086f28c1-d530-4ec1-a9f3-b7c233d91802 service nova] Lock "1f76f07a-33c6-466e-9008-a31589f5c870-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-cdb5941f-49ca-4f5f-8f78-5cc9b2fc3cc2 req-086f28c1-d530-4ec1-a9f3-b7c233d91802 service nova] Lock "1f76f07a-33c6-466e-9008-a31589f5c870-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG nova.compute.manager [req-cdb5941f-49ca-4f5f-8f78-5cc9b2fc3cc2 req-086f28c1-d530-4ec1-a9f3-b7c233d91802 service nova] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] No waiting events found dispatching network-vif-plugged-41a9a017-ad62-448b-b319-0cf66bc85dba {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:01:01 user nova-compute[73484]: WARNING nova.compute.manager [req-cdb5941f-49ca-4f5f-8f78-5cc9b2fc3cc2 req-086f28c1-d530-4ec1-a9f3-b7c233d91802 service nova] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Received unexpected event network-vif-plugged-41a9a017-ad62-448b-b319-0cf66bc85dba for instance with vm_state building and task_state spawning.
Aug 14 14:01:01 user nova-compute[73484]: DEBUG nova.compute.manager [req-cdb5941f-49ca-4f5f-8f78-5cc9b2fc3cc2 req-086f28c1-d530-4ec1-a9f3-b7c233d91802 service nova] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Received event network-vif-unplugged-13b6f45e-f6e7-43c5-9347-92e4fd59e9a8 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-cdb5941f-49ca-4f5f-8f78-5cc9b2fc3cc2 req-086f28c1-d530-4ec1-a9f3-b7c233d91802 service nova] Acquiring lock "79d07235-a6fb-48ea-b2be-c140461e0cbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-cdb5941f-49ca-4f5f-8f78-5cc9b2fc3cc2 req-086f28c1-d530-4ec1-a9f3-b7c233d91802 service nova] Lock "79d07235-a6fb-48ea-b2be-c140461e0cbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-cdb5941f-49ca-4f5f-8f78-5cc9b2fc3cc2 req-086f28c1-d530-4ec1-a9f3-b7c233d91802 service nova] Lock "79d07235-a6fb-48ea-b2be-c140461e0cbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG nova.compute.manager [req-cdb5941f-49ca-4f5f-8f78-5cc9b2fc3cc2 req-086f28c1-d530-4ec1-a9f3-b7c233d91802 service nova] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] No waiting events found dispatching network-vif-unplugged-13b6f45e-f6e7-43c5-9347-92e4fd59e9a8 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG nova.compute.manager [req-cdb5941f-49ca-4f5f-8f78-5cc9b2fc3cc2 req-086f28c1-d530-4ec1-a9f3-b7c233d91802 service nova] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Received event network-vif-unplugged-13b6f45e-f6e7-43c5-9347-92e4fd59e9a8 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG nova.compute.manager [req-cdb5941f-49ca-4f5f-8f78-5cc9b2fc3cc2 req-086f28c1-d530-4ec1-a9f3-b7c233d91802 service nova] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Received event network-vif-plugged-13b6f45e-f6e7-43c5-9347-92e4fd59e9a8 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-cdb5941f-49ca-4f5f-8f78-5cc9b2fc3cc2 req-086f28c1-d530-4ec1-a9f3-b7c233d91802 service nova] Acquiring lock "79d07235-a6fb-48ea-b2be-c140461e0cbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-cdb5941f-49ca-4f5f-8f78-5cc9b2fc3cc2 req-086f28c1-d530-4ec1-a9f3-b7c233d91802 service nova] Lock "79d07235-a6fb-48ea-b2be-c140461e0cbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-cdb5941f-49ca-4f5f-8f78-5cc9b2fc3cc2 req-086f28c1-d530-4ec1-a9f3-b7c233d91802 service nova] Lock "79d07235-a6fb-48ea-b2be-c140461e0cbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG nova.compute.manager [req-cdb5941f-49ca-4f5f-8f78-5cc9b2fc3cc2 req-086f28c1-d530-4ec1-a9f3-b7c233d91802 service nova] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] No waiting events found dispatching network-vif-plugged-13b6f45e-f6e7-43c5-9347-92e4fd59e9a8 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:01:01 user nova-compute[73484]: WARNING nova.compute.manager [req-cdb5941f-49ca-4f5f-8f78-5cc9b2fc3cc2 req-086f28c1-d530-4ec1-a9f3-b7c233d91802 service nova] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Received unexpected event network-vif-plugged-13b6f45e-f6e7-43c5-9347-92e4fd59e9a8 for instance with vm_state active and task_state deleting.
Aug 14 14:01:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:01 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Instance destroyed successfully.
Aug 14 14:01:01 user nova-compute[73484]: DEBUG nova.objects.instance [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lazy-loading 'resources' on Instance uuid 79d07235-a6fb-48ea-b2be-c140461e0cbb {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1496503405',display_name='tempest-VolumesSnapshotTestJSON-instance-1496503405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1496503405',id=41,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDj8Za07wpL+F8xaTyj46HXRxVYcmtX8wHE5RHoivtDdSBP7umubK4EHqA+y9yRu29KRBYcKqjHvsCZ8bFnb3oiCvK3vKMpeczr7e++EP4V+zniO33dc4nnn0dpRLmA2uw==',key_name='tempest-keypair-50382677',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:58:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f4707f4d9cd47c2b988af4fdaf685ef',ramdisk_id='',reservation_id='r-s9r5c65s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1264452311',owner_user_name='tempest-VolumesSnapshotTestJSON-1264452311-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:58:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce08ff2ccf9940259c0beb5ba8aba5d3',uuid=79d07235-a6fb-48ea-b2be-c140461e0cbb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13b6f45e-f6e7-43c5-9347-92e4fd59e9a8", "address": "fa:16:3e:60:b7:8a", "network": {"id": "3458700f-a875-4968-8ae8-464e9ce8ab81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1812819141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4707f4d9cd47c2b988af4fdaf685ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b6f45e-f6", "ovs_interfaceid": "13b6f45e-f6e7-43c5-9347-92e4fd59e9a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Converting VIF {"id": "13b6f45e-f6e7-43c5-9347-92e4fd59e9a8", "address": "fa:16:3e:60:b7:8a", "network": {"id": "3458700f-a875-4968-8ae8-464e9ce8ab81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1812819141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4707f4d9cd47c2b988af4fdaf685ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b6f45e-f6", "ovs_interfaceid": "13b6f45e-f6e7-43c5-9347-92e4fd59e9a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:b7:8a,bridge_name='br-int',has_traffic_filtering=True,id=13b6f45e-f6e7-43c5-9347-92e4fd59e9a8,network=Network(3458700f-a875-4968-8ae8-464e9ce8ab81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b6f45e-f6') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG os_vif [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:b7:8a,bridge_name='br-int',has_traffic_filtering=True,id=13b6f45e-f6e7-43c5-9347-92e4fd59e9a8,network=Network(3458700f-a875-4968-8ae8-464e9ce8ab81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b6f45e-f6') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13b6f45e-f6, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:01:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:01:02 user nova-compute[73484]: INFO os_vif [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:b7:8a,bridge_name='br-int',has_traffic_filtering=True,id=13b6f45e-f6e7-43c5-9347-92e4fd59e9a8,network=Network(3458700f-a875-4968-8ae8-464e9ce8ab81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b6f45e-f6')
Aug 14 14:01:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrBeWZNO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:01:02 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:01:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98e0e7b2-367d-434a-961a-4a83cb98f5a5', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[495d60fd-538f-4dce-9038-8e4f6fe70358]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[5581e8d3-eda3-4474-9934-190a26b84ad4]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)
Aug 14 14:01:02 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)
Aug 14 14:01:02 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4583ca560>, {}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Disconnecting from: [] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.045s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] <== disconnect_volume: return (46ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 14:01:02 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Deleting instance files /opt/stack/data/nova/instances/79d07235-a6fb-48ea-b2be-c140461e0cbb_del
Aug 14 14:01:02 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Deletion of /opt/stack/data/nova/instances/79d07235-a6fb-48ea-b2be-c140461e0cbb_del complete
Aug 14 14:01:02 user nova-compute[73484]: INFO nova.compute.manager [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 14 14:01:02 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021662.229002, 1f76f07a-33c6-466e-9008-a31589f5c870 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:01:02 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] VM Resumed (Lifecycle Event)
Aug 14 14:01:02 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 14:01:02 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Instance spawned successfully.
Aug 14 14:01:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:01:02 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:01:02 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021662.231878, 1f76f07a-33c6-466e-9008-a31589f5c870 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:01:02 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] VM Started (Lifecycle Event)
Aug 14 14:01:02 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:01:02 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:01:02 user nova-compute[73484]: INFO nova.compute.manager [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Took 6.39 seconds to spawn the instance on the hypervisor.
Aug 14 14:01:02 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:01:02 user nova-compute[73484]: INFO nova.compute.manager [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Took 7.00 seconds to build instance.
Aug 14 14:01:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0546d972-fc84-48ad-9b0d-6c39a6539616 tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "1f76f07a-33c6-466e-9008-a31589f5c870" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.088s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:01:02 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:01:03 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:01:03 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Took 1.54 seconds to deallocate network for instance.
Aug 14 14:01:03 user nova-compute[73484]: WARNING nova.volume.cinder [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Attachment 4024e1cf-f4cd-4d22-a9de-73c619f17faf does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 4024e1cf-f4cd-4d22-a9de-73c619f17faf. (HTTP 404) (Request-ID: req-4a377016-9271-42dc-adea-76b766571583)
Aug 14 14:01:03 user nova-compute[73484]: INFO nova.compute.manager [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Took 0.04 seconds to detach 1 volumes for instance.
Aug 14 14:01:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:01:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:01:03 user nova-compute[73484]: DEBUG nova.compute.manager [req-6fc40609-3ebf-43e2-ae85-03a87cd1e662 req-0b3f2624-62b6-42a7-830c-932994f37154 service nova] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Received event network-vif-deleted-13b6f45e-f6e7-43c5-9347-92e4fd59e9a8 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:01:04 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:01:04 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:01:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:01:04 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Deleted allocations for instance 79d07235-a6fb-48ea-b2be-c140461e0cbb
Aug 14 14:01:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9b78fea8-8385-419a-83af-b5cc73ef40c2 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "79d07235-a6fb-48ea-b2be-c140461e0cbb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.079s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:01:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:06 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:01:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:07 user nova-compute[73484]: DEBUG nova.compute.manager [req-73a1217a-3a85-4f7b-934d-3d07276c8e6b req-2a3d526c-a28e-4ae6-973f-e3629e8fcc71 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Received event network-changed-7ce35860-fbe8-4c2b-9697-bf867ebe5b39 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:01:07 user nova-compute[73484]: DEBUG nova.compute.manager [req-73a1217a-3a85-4f7b-934d-3d07276c8e6b req-2a3d526c-a28e-4ae6-973f-e3629e8fcc71 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Refreshing instance network info cache due to event network-changed-7ce35860-fbe8-4c2b-9697-bf867ebe5b39. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:01:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-73a1217a-3a85-4f7b-934d-3d07276c8e6b req-2a3d526c-a28e-4ae6-973f-e3629e8fcc71 service nova] Acquiring lock "refresh_cache-a3282525-9822-4be9-8ef1-c213392c6267" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:01:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-73a1217a-3a85-4f7b-934d-3d07276c8e6b req-2a3d526c-a28e-4ae6-973f-e3629e8fcc71 service nova] Acquired lock "refresh_cache-a3282525-9822-4be9-8ef1-c213392c6267" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:01:07 user nova-compute[73484]: DEBUG nova.network.neutron [req-73a1217a-3a85-4f7b-934d-3d07276c8e6b req-2a3d526c-a28e-4ae6-973f-e3629e8fcc71 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Refreshing network info cache for port 7ce35860-fbe8-4c2b-9697-bf867ebe5b39 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:01:08 user nova-compute[73484]: DEBUG nova.network.neutron [req-73a1217a-3a85-4f7b-934d-3d07276c8e6b req-2a3d526c-a28e-4ae6-973f-e3629e8fcc71 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Updated VIF entry in instance network info cache for port 7ce35860-fbe8-4c2b-9697-bf867ebe5b39. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:01:08 user nova-compute[73484]: DEBUG nova.network.neutron [req-73a1217a-3a85-4f7b-934d-3d07276c8e6b req-2a3d526c-a28e-4ae6-973f-e3629e8fcc71 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Updating instance_info_cache with network_info: [{"id": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "address": "fa:16:3e:2e:7e:05", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce35860-fb", "ovs_interfaceid": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:01:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-73a1217a-3a85-4f7b-934d-3d07276c8e6b req-2a3d526c-a28e-4ae6-973f-e3629e8fcc71 service nova] Releasing lock "refresh_cache-a3282525-9822-4be9-8ef1-c213392c6267" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:01:08 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:08 user nova-compute[73484]: DEBUG nova.compute.manager [req-7cfa8f1f-5302-499d-981c-5a512d5d3a9a req-d0e2c689-429e-4a7e-b0cd-63671f9e1ac1 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Received event network-changed-7ce35860-fbe8-4c2b-9697-bf867ebe5b39 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:01:08 user nova-compute[73484]: DEBUG nova.compute.manager [req-7cfa8f1f-5302-499d-981c-5a512d5d3a9a req-d0e2c689-429e-4a7e-b0cd-63671f9e1ac1 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Refreshing instance network info cache due to event network-changed-7ce35860-fbe8-4c2b-9697-bf867ebe5b39. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:01:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-7cfa8f1f-5302-499d-981c-5a512d5d3a9a req-d0e2c689-429e-4a7e-b0cd-63671f9e1ac1 service nova] Acquiring lock "refresh_cache-a3282525-9822-4be9-8ef1-c213392c6267" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:01:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-7cfa8f1f-5302-499d-981c-5a512d5d3a9a req-d0e2c689-429e-4a7e-b0cd-63671f9e1ac1 service nova] Acquired lock "refresh_cache-a3282525-9822-4be9-8ef1-c213392c6267" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:01:08 user nova-compute[73484]: DEBUG nova.network.neutron [req-7cfa8f1f-5302-499d-981c-5a512d5d3a9a req-d0e2c689-429e-4a7e-b0cd-63671f9e1ac1 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Refreshing network info cache for port 7ce35860-fbe8-4c2b-9697-bf867ebe5b39 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "a3282525-9822-4be9-8ef1-c213392c6267" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "a3282525-9822-4be9-8ef1-c213392c6267" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:01:09 user nova-compute[73484]: INFO nova.compute.manager [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Detaching volume 95f3d908-0a47-45e1-8a2d-c9d8b5c6004a
Aug 14 14:01:09 user nova-compute[73484]: INFO nova.virt.block_device [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Attempting to driver detach volume 95f3d908-0a47-45e1-8a2d-c9d8b5c6004a from mountpoint /dev/vdb
Aug 14 14:01:09 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Attempting to detach device vdb from instance a3282525-9822-4be9-8ef1-c213392c6267 from the persistent domain config. {{(pid=73484) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 14:01:09 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:01:09 user nova-compute[73484]:   <source dev="/dev/sdc"/>
Aug 14 14:01:09 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 14:01:09 user nova-compute[73484]:   <serial>95f3d908-0a47-45e1-8a2d-c9d8b5c6004a</serial>
Aug 14 14:01:09 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 14:01:09 user nova-compute[73484]: </disk>
Aug 14 14:01:09 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 14:01:09 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Successfully detached device vdb from instance a3282525-9822-4be9-8ef1-c213392c6267 from the persistent domain config.
Aug 14 14:01:09 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a3282525-9822-4be9-8ef1-c213392c6267 from the live domain config. {{(pid=73484) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 14:01:09 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:01:09 user nova-compute[73484]:   <source dev="/dev/sdc"/>
Aug 14 14:01:09 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 14:01:09 user nova-compute[73484]:   <serial>95f3d908-0a47-45e1-8a2d-c9d8b5c6004a</serial>
Aug 14 14:01:09 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 14:01:09 user nova-compute[73484]: </disk>
Aug 14 14:01:09 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG nova.network.neutron [req-7cfa8f1f-5302-499d-981c-5a512d5d3a9a req-d0e2c689-429e-4a7e-b0cd-63671f9e1ac1 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Updated VIF entry in instance network info cache for port 7ce35860-fbe8-4c2b-9697-bf867ebe5b39. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG nova.network.neutron [req-7cfa8f1f-5302-499d-981c-5a512d5d3a9a req-d0e2c689-429e-4a7e-b0cd-63671f9e1ac1 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Updating instance_info_cache with network_info: [{"id": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "address": "fa:16:3e:2e:7e:05", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce35860-fb", "ovs_interfaceid": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-7cfa8f1f-5302-499d-981c-5a512d5d3a9a req-d0e2c689-429e-4a7e-b0cd-63671f9e1ac1 service nova] Releasing lock "refresh_cache-a3282525-9822-4be9-8ef1-c213392c6267" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-14812348-ec62-4799-9205-8e156073dbb5 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "165b7234-2b91-482a-8532-5fc41e481e1e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-14812348-ec62-4799-9205-8e156073dbb5 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "165b7234-2b91-482a-8532-5fc41e481e1e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-14812348-ec62-4799-9205-8e156073dbb5 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "165b7234-2b91-482a-8532-5fc41e481e1e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-14812348-ec62-4799-9205-8e156073dbb5 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "165b7234-2b91-482a-8532-5fc41e481e1e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-14812348-ec62-4799-9205-8e156073dbb5 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "165b7234-2b91-482a-8532-5fc41e481e1e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:01:09 user nova-compute[73484]: INFO nova.compute.manager [None req-14812348-ec62-4799-9205-8e156073dbb5 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Terminating instance
Aug 14 14:01:09 user nova-compute[73484]: DEBUG nova.compute.manager [None req-14812348-ec62-4799-9205-8e156073dbb5 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Received event <DeviceRemovedEvent: 1692021669.7519577, a3282525-9822-4be9-8ef1-c213392c6267 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73484) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a3282525-9822-4be9-8ef1-c213392c6267 {{(pid=73484) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 14:01:09 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Successfully detached device vdb from instance a3282525-9822-4be9-8ef1-c213392c6267 from the live domain config.
Aug 14 14:01:09 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFGWoBRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:01:09 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:01:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[147e6109-c979-4fea-8f27-f413f3e5f5c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8572f713-9552-412b-adf4-4cbc5c91ad7b]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)
Aug 14 14:01:09 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a (non-flash)
Aug 14 14:01:09 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4585b1870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a'): ({'sdc'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Removing single pathed devices sdc {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.035s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9572dc2-f03b-4dfc-aa1f-c0fafdcadb09]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.035s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5ae653-17f3-46eb-bd30-49e5b76f56e4]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Flushing IO for device /dev/sdc {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb7feab-cdd4-4fed-99ee-04520acdda32]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 14:01:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c58a5a3-3668-4e0d-9bb4-3e5996d09b98]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac19140d-ed3d-477b-b336-4f6cb34548a8]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[109c6a1b-9182-46fa-ae18-a4802c2dfdbe]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a, portal: 172.16.0.220,3260]
Aug 14 14:01:10 user nova-compute[73484]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a, portal: 172.16.0.220,3260] successful.
Aug 14 14:01:10 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95f3d908-0a47-45e1-8a2d-c9d8b5c6004a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7614388-84a6-4685-9c2a-f76ab128432a]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] <== disconnect_volume: return (342ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 14:01:10 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Instance destroyed successfully.
Aug 14 14:01:10 user nova-compute[73484]: DEBUG nova.objects.instance [None req-14812348-ec62-4799-9205-8e156073dbb5 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lazy-loading 'resources' on Instance uuid 165b7234-2b91-482a-8532-5fc41e481e1e {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-14812348-ec62-4799-9205-8e156073dbb5 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-597269201',display_name='tempest-AttachVolumeNegativeTest-server-597269201',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-597269201',id=39,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIg6PQPPMHr6jqpnyCtzBmMxyYfjkkSXQp8Big2Tz0hSb08D3ZVXlj7lnZedTel/MPVwZLRBoJS/Ox2NHM3OWtvZiLBG9EJ42YfIfn+kiVYqht2pFJVpRlukSQaQ0/z6rQ==',key_name='tempest-keypair-2033658647',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:58:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f404795fcace4922a10abdb33740e87d',ramdisk_id='',reservation_id='r-cqz4a0ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1043074889',owner_user_name='tempest-AttachVolumeNegativeTest-1043074889-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:58:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3ccc9cc867644d9bc040e9dfd4eb231',uuid=165b7234-2b91-482a-8532-5fc41e481e1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "253e674d-b55e-4d07-a5f1-833901a27e9b", "address": "fa:16:3e:d1:78:40", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap253e674d-b5", "ovs_interfaceid": "253e674d-b55e-4d07-a5f1-833901a27e9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-14812348-ec62-4799-9205-8e156073dbb5 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Converting VIF {"id": "253e674d-b55e-4d07-a5f1-833901a27e9b", "address": "fa:16:3e:d1:78:40", "network": {"id": "10d4738f-25c6-4995-a4b7-6fbee86f070f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1360720044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f404795fcace4922a10abdb33740e87d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap253e674d-b5", "ovs_interfaceid": "253e674d-b55e-4d07-a5f1-833901a27e9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-14812348-ec62-4799-9205-8e156073dbb5 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:78:40,bridge_name='br-int',has_traffic_filtering=True,id=253e674d-b55e-4d07-a5f1-833901a27e9b,network=Network(10d4738f-25c6-4995-a4b7-6fbee86f070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap253e674d-b5') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG os_vif [None req-14812348-ec62-4799-9205-8e156073dbb5 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:78:40,bridge_name='br-int',has_traffic_filtering=True,id=253e674d-b55e-4d07-a5f1-833901a27e9b,network=Network(10d4738f-25c6-4995-a4b7-6fbee86f070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap253e674d-b5') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap253e674d-b5, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:01:10 user nova-compute[73484]: INFO os_vif [None req-14812348-ec62-4799-9205-8e156073dbb5 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:78:40,bridge_name='br-int',has_traffic_filtering=True,id=253e674d-b55e-4d07-a5f1-833901a27e9b,network=Network(10d4738f-25c6-4995-a4b7-6fbee86f070f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap253e674d-b5')
Aug 14 14:01:10 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-14812348-ec62-4799-9205-8e156073dbb5 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Deleting instance files /opt/stack/data/nova/instances/165b7234-2b91-482a-8532-5fc41e481e1e_del
Aug 14 14:01:10 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-14812348-ec62-4799-9205-8e156073dbb5 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Deletion of /opt/stack/data/nova/instances/165b7234-2b91-482a-8532-5fc41e481e1e_del complete
Aug 14 14:01:10 user nova-compute[73484]: INFO nova.compute.manager [None req-14812348-ec62-4799-9205-8e156073dbb5 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 14 14:01:10 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-14812348-ec62-4799-9205-8e156073dbb5 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG nova.compute.manager [req-4652607f-6aec-4e88-af72-fabdf96bfe67 req-07fca69f-80f9-4a72-bac6-30f3e2817260 service nova] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Received event network-vif-unplugged-253e674d-b55e-4d07-a5f1-833901a27e9b {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4652607f-6aec-4e88-af72-fabdf96bfe67 req-07fca69f-80f9-4a72-bac6-30f3e2817260 service nova] Acquiring lock "165b7234-2b91-482a-8532-5fc41e481e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4652607f-6aec-4e88-af72-fabdf96bfe67 req-07fca69f-80f9-4a72-bac6-30f3e2817260 service nova] Lock "165b7234-2b91-482a-8532-5fc41e481e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4652607f-6aec-4e88-af72-fabdf96bfe67 req-07fca69f-80f9-4a72-bac6-30f3e2817260 service nova] Lock "165b7234-2b91-482a-8532-5fc41e481e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG nova.compute.manager [req-4652607f-6aec-4e88-af72-fabdf96bfe67 req-07fca69f-80f9-4a72-bac6-30f3e2817260 service nova] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] No waiting events found dispatching network-vif-unplugged-253e674d-b55e-4d07-a5f1-833901a27e9b {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG nova.compute.manager [req-4652607f-6aec-4e88-af72-fabdf96bfe67 req-07fca69f-80f9-4a72-bac6-30f3e2817260 service nova] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Received event network-vif-unplugged-253e674d-b55e-4d07-a5f1-833901a27e9b for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG nova.compute.manager [req-4652607f-6aec-4e88-af72-fabdf96bfe67 req-07fca69f-80f9-4a72-bac6-30f3e2817260 service nova] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Received event network-vif-plugged-253e674d-b55e-4d07-a5f1-833901a27e9b {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4652607f-6aec-4e88-af72-fabdf96bfe67 req-07fca69f-80f9-4a72-bac6-30f3e2817260 service nova] Acquiring lock "165b7234-2b91-482a-8532-5fc41e481e1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4652607f-6aec-4e88-af72-fabdf96bfe67 req-07fca69f-80f9-4a72-bac6-30f3e2817260 service nova] Lock "165b7234-2b91-482a-8532-5fc41e481e1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4652607f-6aec-4e88-af72-fabdf96bfe67 req-07fca69f-80f9-4a72-bac6-30f3e2817260 service nova] Lock "165b7234-2b91-482a-8532-5fc41e481e1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:01:10 user nova-compute[73484]: DEBUG nova.compute.manager [req-4652607f-6aec-4e88-af72-fabdf96bfe67 req-07fca69f-80f9-4a72-bac6-30f3e2817260 service nova] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] No waiting events found dispatching network-vif-plugged-253e674d-b55e-4d07-a5f1-833901a27e9b {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:01:10 user nova-compute[73484]: WARNING nova.compute.manager [req-4652607f-6aec-4e88-af72-fabdf96bfe67 req-07fca69f-80f9-4a72-bac6-30f3e2817260 service nova] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Received unexpected event network-vif-plugged-253e674d-b55e-4d07-a5f1-833901a27e9b for instance with vm_state active and task_state deleting.
Aug 14 14:01:11 user nova-compute[73484]: DEBUG nova.objects.instance [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lazy-loading 'flavor' on Instance uuid a3282525-9822-4be9-8ef1-c213392c6267 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:01:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-bfc59c56-a4eb-4ed4-a0d9-877ac02edb23 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "a3282525-9822-4be9-8ef1-c213392c6267" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.857s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:01:11 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:01:11 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Took 0.96 seconds to deallocate network for instance.
Aug 14 14:01:11 user nova-compute[73484]: DEBUG nova.compute.manager [req-16dda9ed-9cb5-4fcc-8f93-b2aad3b640d1 req-77a33188-ca06-48d1-81ea-7baa01a36158 service nova] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Received event network-vif-deleted-253e674d-b55e-4d07-a5f1-833901a27e9b {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:01:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-14812348-ec62-4799-9205-8e156073dbb5 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:01:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-14812348-ec62-4799-9205-8e156073dbb5 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:01:11 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-14812348-ec62-4799-9205-8e156073dbb5 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:01:11 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-14812348-ec62-4799-9205-8e156073dbb5 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:01:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-14812348-ec62-4799-9205-8e156073dbb5 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.221s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:01:11 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-14812348-ec62-4799-9205-8e156073dbb5 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Deleted allocations for instance 165b7234-2b91-482a-8532-5fc41e481e1e
Aug 14 14:01:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-14812348-ec62-4799-9205-8e156073dbb5 tempest-AttachVolumeNegativeTest-1043074889 tempest-AttachVolumeNegativeTest-1043074889-project-member] Lock "165b7234-2b91-482a-8532-5fc41e481e1e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.353s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:01:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:16 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692021661.9656546, 79d07235-a6fb-48ea-b2be-c140461e0cbb => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:01:16 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] VM Stopped (Lifecycle Event)
Aug 14 14:01:16 user nova-compute[73484]: DEBUG nova.compute.manager [None req-b6ff13fe-cddc-441c-b297-3c87b7090a12 None None] [instance: 79d07235-a6fb-48ea-b2be-c140461e0cbb] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:01:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:25 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692021670.5385027, 165b7234-2b91-482a-8532-5fc41e481e1e => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:01:25 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] VM Stopped (Lifecycle Event)
Aug 14 14:01:25 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0da5187f-8b7c-4f50-a30e-90e0278b825b None None] [instance: 165b7234-2b91-482a-8532-5fc41e481e1e] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:01:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-34dbc0f3-def4-4b59-8893-ebbb23ba31cd tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:01:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-34dbc0f3-def4-4b59-8893-ebbb23ba31cd tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:01:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-34dbc0f3-def4-4b59-8893-ebbb23ba31cd tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:01:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-34dbc0f3-def4-4b59-8893-ebbb23ba31cd tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:01:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-34dbc0f3-def4-4b59-8893-ebbb23ba31cd tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:01:40 user nova-compute[73484]: INFO nova.compute.manager [None req-34dbc0f3-def4-4b59-8893-ebbb23ba31cd tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Terminating instance
Aug 14 14:01:40 user nova-compute[73484]: DEBUG nova.compute.manager [None req-34dbc0f3-def4-4b59-8893-ebbb23ba31cd tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 14:01:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:41 user nova-compute[73484]: DEBUG nova.compute.manager [req-c7b0b0d7-5f38-4034-a77f-0568009bca11 req-f46503f9-39c3-4953-9c36-a829107e9c6a service nova] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Received event network-vif-unplugged-be08ca28-6a00-468c-9988-87185f498ca3 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:01:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c7b0b0d7-5f38-4034-a77f-0568009bca11 req-f46503f9-39c3-4953-9c36-a829107e9c6a service nova] Acquiring lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:01:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c7b0b0d7-5f38-4034-a77f-0568009bca11 req-f46503f9-39c3-4953-9c36-a829107e9c6a service nova] Lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:01:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c7b0b0d7-5f38-4034-a77f-0568009bca11 req-f46503f9-39c3-4953-9c36-a829107e9c6a service nova] Lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:01:41 user nova-compute[73484]: DEBUG nova.compute.manager [req-c7b0b0d7-5f38-4034-a77f-0568009bca11 req-f46503f9-39c3-4953-9c36-a829107e9c6a service nova] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] No waiting events found dispatching network-vif-unplugged-be08ca28-6a00-468c-9988-87185f498ca3 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:01:41 user nova-compute[73484]: DEBUG nova.compute.manager [req-c7b0b0d7-5f38-4034-a77f-0568009bca11 req-f46503f9-39c3-4953-9c36-a829107e9c6a service nova] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Received event network-vif-unplugged-be08ca28-6a00-468c-9988-87185f498ca3 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 14:01:41 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:41 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:41 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Instance destroyed successfully.
Aug 14 14:01:41 user nova-compute[73484]: DEBUG nova.objects.instance [None req-34dbc0f3-def4-4b59-8893-ebbb23ba31cd tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'resources' on Instance uuid 03255d24-b6fd-459c-8ac6-f9c4063b54b2 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:01:41 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-34dbc0f3-def4-4b59-8893-ebbb23ba31cd tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:45:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1759674947',display_name='tempest-ServerRescueNegativeTestJSON-server-1759674947',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1759674947',id=25,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:47:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f4df46bcfb843b7ac6c17d106703950',ramdisk_id='',reservation_id='r-yok2frut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-496474583',owner_user_name='tempest-ServerRescueNegativeTestJSON-496474583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:47:20Z,user_data=None,user_id='45d86b9371024e3d95ece74ccb2c37d9',uuid=03255d24-b6fd-459c-8ac6-f9c4063b54b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "be08ca28-6a00-468c-9988-87185f498ca3", "address": "fa:16:3e:66:27:2e", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe08ca28-6a", "ovs_interfaceid": "be08ca28-6a00-468c-9988-87185f498ca3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 14:01:41 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-34dbc0f3-def4-4b59-8893-ebbb23ba31cd tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Converting VIF {"id": "be08ca28-6a00-468c-9988-87185f498ca3", "address": "fa:16:3e:66:27:2e", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe08ca28-6a", "ovs_interfaceid": "be08ca28-6a00-468c-9988-87185f498ca3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:01:41 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-34dbc0f3-def4-4b59-8893-ebbb23ba31cd tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:27:2e,bridge_name='br-int',has_traffic_filtering=True,id=be08ca28-6a00-468c-9988-87185f498ca3,network=Network(cad53782-5ecf-4140-b113-62e807bf87df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe08ca28-6a') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:01:41 user nova-compute[73484]: DEBUG os_vif [None req-34dbc0f3-def4-4b59-8893-ebbb23ba31cd tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:27:2e,bridge_name='br-int',has_traffic_filtering=True,id=be08ca28-6a00-468c-9988-87185f498ca3,network=Network(cad53782-5ecf-4140-b113-62e807bf87df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe08ca28-6a') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 14:01:41 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:41 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe08ca28-6a, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:01:41 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:41 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:41 user nova-compute[73484]: INFO os_vif [None req-34dbc0f3-def4-4b59-8893-ebbb23ba31cd tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:27:2e,bridge_name='br-int',has_traffic_filtering=True,id=be08ca28-6a00-468c-9988-87185f498ca3,network=Network(cad53782-5ecf-4140-b113-62e807bf87df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe08ca28-6a')
Aug 14 14:01:41 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-34dbc0f3-def4-4b59-8893-ebbb23ba31cd tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Deleting instance files /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2_del
Aug 14 14:01:41 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-34dbc0f3-def4-4b59-8893-ebbb23ba31cd tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Deletion of /opt/stack/data/nova/instances/03255d24-b6fd-459c-8ac6-f9c4063b54b2_del complete
Aug 14 14:01:41 user nova-compute[73484]: INFO nova.compute.manager [None req-34dbc0f3-def4-4b59-8893-ebbb23ba31cd tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 14 14:01:41 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-34dbc0f3-def4-4b59-8893-ebbb23ba31cd tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 14:01:41 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 14:01:41 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 14:01:42 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:01:42 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Took 0.54 seconds to deallocate network for instance.
Aug 14 14:01:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-34dbc0f3-def4-4b59-8893-ebbb23ba31cd tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:01:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-34dbc0f3-def4-4b59-8893-ebbb23ba31cd tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:01:42 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-34dbc0f3-def4-4b59-8893-ebbb23ba31cd tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:01:42 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-34dbc0f3-def4-4b59-8893-ebbb23ba31cd tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:01:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-34dbc0f3-def4-4b59-8893-ebbb23ba31cd tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.221s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:01:42 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-34dbc0f3-def4-4b59-8893-ebbb23ba31cd tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Deleted allocations for instance 03255d24-b6fd-459c-8ac6-f9c4063b54b2
Aug 14 14:01:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-34dbc0f3-def4-4b59-8893-ebbb23ba31cd tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.897s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:01:43 user nova-compute[73484]: DEBUG nova.compute.manager [req-3d76cd9e-834c-4315-a886-90f69d37587a req-14fd1cfb-90c5-4105-9f75-44a03372b471 service nova] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Received event network-vif-plugged-be08ca28-6a00-468c-9988-87185f498ca3 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:01:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3d76cd9e-834c-4315-a886-90f69d37587a req-14fd1cfb-90c5-4105-9f75-44a03372b471 service nova] Acquiring lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:01:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3d76cd9e-834c-4315-a886-90f69d37587a req-14fd1cfb-90c5-4105-9f75-44a03372b471 service nova] Lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:01:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3d76cd9e-834c-4315-a886-90f69d37587a req-14fd1cfb-90c5-4105-9f75-44a03372b471 service nova] Lock "03255d24-b6fd-459c-8ac6-f9c4063b54b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:01:43 user nova-compute[73484]: DEBUG nova.compute.manager [req-3d76cd9e-834c-4315-a886-90f69d37587a req-14fd1cfb-90c5-4105-9f75-44a03372b471 service nova] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] No waiting events found dispatching network-vif-plugged-be08ca28-6a00-468c-9988-87185f498ca3 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:01:43 user nova-compute[73484]: WARNING nova.compute.manager [req-3d76cd9e-834c-4315-a886-90f69d37587a req-14fd1cfb-90c5-4105-9f75-44a03372b471 service nova] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Received unexpected event network-vif-plugged-be08ca28-6a00-468c-9988-87185f498ca3 for instance with vm_state deleted and task_state None.
Aug 14 14:01:43 user nova-compute[73484]: DEBUG nova.compute.manager [req-3d76cd9e-834c-4315-a886-90f69d37587a req-14fd1cfb-90c5-4105-9f75-44a03372b471 service nova] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Received event network-vif-deleted-be08ca28-6a00-468c-9988-87185f498ca3 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:01:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:47 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:01:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 14:01:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Rebuilding the list of instances to heal {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 14:01:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-782c6142-757a-49ae-9292-787a7f1e8a23" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:01:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-782c6142-757a-49ae-9292-787a7f1e8a23" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:01:47 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 14:01:47 user nova-compute[73484]: DEBUG nova.objects.instance [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lazy-loading 'info_cache' on Instance uuid 782c6142-757a-49ae-9292-787a7f1e8a23 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:01:48 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Updating instance_info_cache with network_info: [{"id": "2246e004-4f6b-449d-91b2-8e67b4f51006", "address": "fa:16:3e:31:2a:06", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2246e004-4f", "ovs_interfaceid": "2246e004-4f6b-449d-91b2-8e67b4f51006", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:01:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-782c6142-757a-49ae-9292-787a7f1e8a23" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:01:48 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 14:01:49 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:01:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:55 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:01:56 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692021701.6629946, 03255d24-b6fd-459c-8ac6-f9c4063b54b2 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:01:56 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] VM Stopped (Lifecycle Event)
Aug 14 14:01:56 user nova-compute[73484]: DEBUG nova.compute.manager [None req-ea4e426f-d74f-4b21-872b-2171521c6ce2 None None] [instance: 03255d24-b6fd-459c-8ac6-f9c4063b54b2] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:01:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:01:56 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:01:56 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:01:56 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 14:01:58 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:01:58 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:01:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:01:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:01:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:01:58 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 14:01:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:01:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:01:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:01:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:01:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f76f07a-33c6-466e-9008-a31589f5c870/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:01:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f76f07a-33c6-466e-9008-a31589f5c870/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:01:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f76f07a-33c6-466e-9008-a31589f5c870/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:01:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f76f07a-33c6-466e-9008-a31589f5c870/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:01:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:01:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:01:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:02:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:02:00 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:02:00 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:02:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=8346MB free_disk=25.269065856933594GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 14:02:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:02:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:02:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 782c6142-757a-49ae-9292-787a7f1e8a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:02:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance a3282525-9822-4be9-8ef1-c213392c6267 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:02:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 1f76f07a-33c6-466e-9008-a31589f5c870 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:02:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 14:02:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 14:02:00 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:02:00 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:02:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 14:02:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.294s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:02:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:02:03 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:02:03 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:02:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6813b76b-f641-41bf-9adf-d72b8e57ed31 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "a3282525-9822-4be9-8ef1-c213392c6267" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:02:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6813b76b-f641-41bf-9adf-d72b8e57ed31 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "a3282525-9822-4be9-8ef1-c213392c6267" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:02:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6813b76b-f641-41bf-9adf-d72b8e57ed31 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "a3282525-9822-4be9-8ef1-c213392c6267-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:02:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6813b76b-f641-41bf-9adf-d72b8e57ed31 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "a3282525-9822-4be9-8ef1-c213392c6267-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:02:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6813b76b-f641-41bf-9adf-d72b8e57ed31 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "a3282525-9822-4be9-8ef1-c213392c6267-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:02:06 user nova-compute[73484]: INFO nova.compute.manager [None req-6813b76b-f641-41bf-9adf-d72b8e57ed31 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Terminating instance
Aug 14 14:02:06 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6813b76b-f641-41bf-9adf-d72b8e57ed31 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 14:02:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:06 user nova-compute[73484]: DEBUG nova.compute.manager [req-0fa6e82c-06b6-4e6e-a6a9-8a990c24f8fe req-119a3b32-d94d-48d1-a8e1-c938b229478d service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Received event network-vif-unplugged-7ce35860-fbe8-4c2b-9697-bf867ebe5b39 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:02:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0fa6e82c-06b6-4e6e-a6a9-8a990c24f8fe req-119a3b32-d94d-48d1-a8e1-c938b229478d service nova] Acquiring lock "a3282525-9822-4be9-8ef1-c213392c6267-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:02:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0fa6e82c-06b6-4e6e-a6a9-8a990c24f8fe req-119a3b32-d94d-48d1-a8e1-c938b229478d service nova] Lock "a3282525-9822-4be9-8ef1-c213392c6267-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:02:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0fa6e82c-06b6-4e6e-a6a9-8a990c24f8fe req-119a3b32-d94d-48d1-a8e1-c938b229478d service nova] Lock "a3282525-9822-4be9-8ef1-c213392c6267-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:02:06 user nova-compute[73484]: DEBUG nova.compute.manager [req-0fa6e82c-06b6-4e6e-a6a9-8a990c24f8fe req-119a3b32-d94d-48d1-a8e1-c938b229478d service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] No waiting events found dispatching network-vif-unplugged-7ce35860-fbe8-4c2b-9697-bf867ebe5b39 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:02:06 user nova-compute[73484]: DEBUG nova.compute.manager [req-0fa6e82c-06b6-4e6e-a6a9-8a990c24f8fe req-119a3b32-d94d-48d1-a8e1-c938b229478d service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Received event network-vif-unplugged-7ce35860-fbe8-4c2b-9697-bf867ebe5b39 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 14:02:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:06 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Instance destroyed successfully.
Aug 14 14:02:06 user nova-compute[73484]: DEBUG nova.objects.instance [None req-6813b76b-f641-41bf-9adf-d72b8e57ed31 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lazy-loading 'resources' on Instance uuid a3282525-9822-4be9-8ef1-c213392c6267 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:02:07 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-6813b76b-f641-41bf-9adf-d72b8e57ed31 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:56:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1008126369',display_name='tempest-TestMinimumBasicScenario-server-1008126369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1008126369',id=38,image_ref='7e9f7742-c3f5-492c-b4c8-212072532633',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4a8pn3Vvu6dQiHnUjxe5S47vZZcNV7BZnNmiXptsYleB+jhejPspwALEfKvnpz0zOvOfgUo98QUeJ8MA0+PLeMfsNuk9i0SCfN25RGVr1raXPMKT0/tB3wEblrXP1NQA==',key_name='tempest-TestMinimumBasicScenario-229925239',keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:56:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1934a2112a584b82a20c4ae8c13a70db',ramdisk_id='',reservation_id='r-dafyuxae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7e9f7742-c3f5-492c-b4c8-212072532633',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-227652473',owner_user_name='tempest-TestMinimumBasicScenario-227652473-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:59:23Z,user_data=None,user_id='be2ee7c7641d4d0892cc3bc03f8340f1',uuid=a3282525-9822-4be9-8ef1-c213392c6267,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "address": "fa:16:3e:2e:7e:05", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce35860-fb", "ovs_interfaceid": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 14:02:07 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-6813b76b-f641-41bf-9adf-d72b8e57ed31 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Converting VIF {"id": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "address": "fa:16:3e:2e:7e:05", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ce35860-fb", "ovs_interfaceid": "7ce35860-fbe8-4c2b-9697-bf867ebe5b39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:02:07 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-6813b76b-f641-41bf-9adf-d72b8e57ed31 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:7e:05,bridge_name='br-int',has_traffic_filtering=True,id=7ce35860-fbe8-4c2b-9697-bf867ebe5b39,network=Network(b63f0a71-864e-4b2c-9602-fd57c50c5501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce35860-fb') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:02:07 user nova-compute[73484]: DEBUG os_vif [None req-6813b76b-f641-41bf-9adf-d72b8e57ed31 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:7e:05,bridge_name='br-int',has_traffic_filtering=True,id=7ce35860-fbe8-4c2b-9697-bf867ebe5b39,network=Network(b63f0a71-864e-4b2c-9602-fd57c50c5501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce35860-fb') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 14:02:07 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:07 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ce35860-fb, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:02:07 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:07 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:02:07 user nova-compute[73484]: INFO os_vif [None req-6813b76b-f641-41bf-9adf-d72b8e57ed31 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:7e:05,bridge_name='br-int',has_traffic_filtering=True,id=7ce35860-fbe8-4c2b-9697-bf867ebe5b39,network=Network(b63f0a71-864e-4b2c-9602-fd57c50c5501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ce35860-fb')
Aug 14 14:02:07 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-6813b76b-f641-41bf-9adf-d72b8e57ed31 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Deleting instance files /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267_del
Aug 14 14:02:07 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-6813b76b-f641-41bf-9adf-d72b8e57ed31 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Deletion of /opt/stack/data/nova/instances/a3282525-9822-4be9-8ef1-c213392c6267_del complete
Aug 14 14:02:07 user nova-compute[73484]: INFO nova.compute.manager [None req-6813b76b-f641-41bf-9adf-d72b8e57ed31 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 14 14:02:07 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-6813b76b-f641-41bf-9adf-d72b8e57ed31 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 14:02:07 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 14:02:07 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: a3282525-9822-4be9-8ef1-c213392c6267] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 14:02:07 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:02:07 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Took 0.45 seconds to deallocate network for instance.
Aug 14 14:02:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6813b76b-f641-41bf-9adf-d72b8e57ed31 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:02:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6813b76b-f641-41bf-9adf-d72b8e57ed31 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:02:07 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6813b76b-f641-41bf-9adf-d72b8e57ed31 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:02:07 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6813b76b-f641-41bf-9adf-d72b8e57ed31 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:02:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6813b76b-f641-41bf-9adf-d72b8e57ed31 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:02:07 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-6813b76b-f641-41bf-9adf-d72b8e57ed31 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Deleted allocations for instance a3282525-9822-4be9-8ef1-c213392c6267
Aug 14 14:02:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6813b76b-f641-41bf-9adf-d72b8e57ed31 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "a3282525-9822-4be9-8ef1-c213392c6267" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.710s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:02:08 user nova-compute[73484]: DEBUG nova.compute.manager [req-211dbef7-99a4-4ee3-b2e8-965722e64c9a req-dfb0b4df-72d4-46a8-942b-621013feed56 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Received event network-vif-plugged-7ce35860-fbe8-4c2b-9697-bf867ebe5b39 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:02:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-211dbef7-99a4-4ee3-b2e8-965722e64c9a req-dfb0b4df-72d4-46a8-942b-621013feed56 service nova] Acquiring lock "a3282525-9822-4be9-8ef1-c213392c6267-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:02:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-211dbef7-99a4-4ee3-b2e8-965722e64c9a req-dfb0b4df-72d4-46a8-942b-621013feed56 service nova] Lock "a3282525-9822-4be9-8ef1-c213392c6267-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:02:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-211dbef7-99a4-4ee3-b2e8-965722e64c9a req-dfb0b4df-72d4-46a8-942b-621013feed56 service nova] Lock "a3282525-9822-4be9-8ef1-c213392c6267-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:02:08 user nova-compute[73484]: DEBUG nova.compute.manager [req-211dbef7-99a4-4ee3-b2e8-965722e64c9a req-dfb0b4df-72d4-46a8-942b-621013feed56 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] No waiting events found dispatching network-vif-plugged-7ce35860-fbe8-4c2b-9697-bf867ebe5b39 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:02:08 user nova-compute[73484]: WARNING nova.compute.manager [req-211dbef7-99a4-4ee3-b2e8-965722e64c9a req-dfb0b4df-72d4-46a8-942b-621013feed56 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Received unexpected event network-vif-plugged-7ce35860-fbe8-4c2b-9697-bf867ebe5b39 for instance with vm_state deleted and task_state None.
Aug 14 14:02:08 user nova-compute[73484]: DEBUG nova.compute.manager [req-211dbef7-99a4-4ee3-b2e8-965722e64c9a req-dfb0b4df-72d4-46a8-942b-621013feed56 service nova] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Received event network-vif-deleted-7ce35860-fbe8-4c2b-9697-bf867ebe5b39 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:02:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:02:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:02:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:02:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:02:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:21 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692021726.9818182, a3282525-9822-4be9-8ef1-c213392c6267 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:02:21 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: a3282525-9822-4be9-8ef1-c213392c6267] VM Stopped (Lifecycle Event)
Aug 14 14:02:22 user nova-compute[73484]: DEBUG nova.compute.manager [None req-1dc3a8eb-4748-42b9-8734-47948c8960ab None None] [instance: a3282525-9822-4be9-8ef1-c213392c6267] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:02:22 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "328e872d-da9b-4ebc-9069-937c2d3fc74c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:02:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "328e872d-da9b-4ebc-9069-937c2d3fc74c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:02:24 user nova-compute[73484]: DEBUG nova.compute.manager [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 14:02:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:02:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:02:24 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 14:02:24 user nova-compute[73484]: INFO nova.compute.claims [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Claim successful on node user
Aug 14 14:02:24 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:02:24 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:02:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.217s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:02:24 user nova-compute[73484]: DEBUG nova.compute.manager [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 14:02:24 user nova-compute[73484]: DEBUG nova.compute.manager [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 14:02:24 user nova-compute[73484]: DEBUG nova.network.neutron [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 14:02:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:24 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 14:02:24 user nova-compute[73484]: DEBUG nova.compute.manager [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 14:02:24 user nova-compute[73484]: DEBUG nova.compute.manager [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 14:02:24 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 14:02:24 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Creating image(s)
Aug 14 14:02:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "/opt/stack/data/nova/instances/328e872d-da9b-4ebc-9069-937c2d3fc74c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:02:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "/opt/stack/data/nova/instances/328e872d-da9b-4ebc-9069-937c2d3fc74c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:02:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "/opt/stack/data/nova/instances/328e872d-da9b-4ebc-9069-937c2d3fc74c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:02:24 user nova-compute[73484]: DEBUG nova.policy [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce08ff2ccf9940259c0beb5ba8aba5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4707f4d9cd47c2b988af4fdaf685ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 14:02:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:02:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.182s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:02:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:02:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:02:24 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:02:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.185s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:02:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/328e872d-da9b-4ebc-9069-937c2d3fc74c/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:02:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/328e872d-da9b-4ebc-9069-937c2d3fc74c/disk 1073741824" returned: 0 in 0.066s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:02:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:02:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:02:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.197s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:02:25 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Checking if we can resize image /opt/stack/data/nova/instances/328e872d-da9b-4ebc-9069-937c2d3fc74c/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 14:02:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/328e872d-da9b-4ebc-9069-937c2d3fc74c/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:02:25 user nova-compute[73484]: DEBUG nova.network.neutron [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Successfully created port: c0373e7b-3687-462c-a775-ea6bdab07469 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 14:02:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/328e872d-da9b-4ebc-9069-937c2d3fc74c/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:02:25 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Cannot resize image /opt/stack/data/nova/instances/328e872d-da9b-4ebc-9069-937c2d3fc74c/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 14:02:25 user nova-compute[73484]: DEBUG nova.objects.instance [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lazy-loading 'migration_context' on Instance uuid 328e872d-da9b-4ebc-9069-937c2d3fc74c {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:02:25 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 14:02:25 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Ensure instance console log exists: /opt/stack/data/nova/instances/328e872d-da9b-4ebc-9069-937c2d3fc74c/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 14:02:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:02:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:02:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.network.neutron [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Successfully updated port: c0373e7b-3687-462c-a775-ea6bdab07469 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "refresh_cache-328e872d-da9b-4ebc-9069-937c2d3fc74c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquired lock "refresh_cache-328e872d-da9b-4ebc-9069-937c2d3fc74c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.network.neutron [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.compute.manager [req-786bec5c-f329-4be3-aedb-483fa444a69c req-cf35ad07-35f6-49a0-82fd-ead1d0e15567 service nova] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Received event network-changed-c0373e7b-3687-462c-a775-ea6bdab07469 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.compute.manager [req-786bec5c-f329-4be3-aedb-483fa444a69c req-cf35ad07-35f6-49a0-82fd-ead1d0e15567 service nova] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Refreshing instance network info cache due to event network-changed-c0373e7b-3687-462c-a775-ea6bdab07469. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-786bec5c-f329-4be3-aedb-483fa444a69c req-cf35ad07-35f6-49a0-82fd-ead1d0e15567 service nova] Acquiring lock "refresh_cache-328e872d-da9b-4ebc-9069-937c2d3fc74c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.network.neutron [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.network.neutron [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Updating instance_info_cache with network_info: [{"id": "c0373e7b-3687-462c-a775-ea6bdab07469", "address": "fa:16:3e:e5:bb:36", "network": {"id": "3458700f-a875-4968-8ae8-464e9ce8ab81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1812819141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4707f4d9cd47c2b988af4fdaf685ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0373e7b-36", "ovs_interfaceid": "c0373e7b-3687-462c-a775-ea6bdab07469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Releasing lock "refresh_cache-328e872d-da9b-4ebc-9069-937c2d3fc74c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.compute.manager [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Instance network_info: |[{"id": "c0373e7b-3687-462c-a775-ea6bdab07469", "address": "fa:16:3e:e5:bb:36", "network": {"id": "3458700f-a875-4968-8ae8-464e9ce8ab81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1812819141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4707f4d9cd47c2b988af4fdaf685ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0373e7b-36", "ovs_interfaceid": "c0373e7b-3687-462c-a775-ea6bdab07469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-786bec5c-f329-4be3-aedb-483fa444a69c req-cf35ad07-35f6-49a0-82fd-ead1d0e15567 service nova] Acquired lock "refresh_cache-328e872d-da9b-4ebc-9069-937c2d3fc74c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.network.neutron [req-786bec5c-f329-4be3-aedb-483fa444a69c req-cf35ad07-35f6-49a0-82fd-ead1d0e15567 service nova] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Refreshing network info cache for port c0373e7b-3687-462c-a775-ea6bdab07469 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Start _get_guest_xml network_info=[{"id": "c0373e7b-3687-462c-a775-ea6bdab07469", "address": "fa:16:3e:e5:bb:36", "network": {"id": "3458700f-a875-4968-8ae8-464e9ce8ab81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1812819141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4707f4d9cd47c2b988af4fdaf685ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0373e7b-36", "ovs_interfaceid": "c0373e7b-3687-462c-a775-ea6bdab07469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 14:02:26 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:02:26 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-427263749',display_name='tempest-VolumesSnapshotTestJSON-instance-427263749',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-427263749',id=43,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbPa9UUfKEDzopR8jgfuCfi1J5PXmBtWJtQWtUSi/ynaWeVV6rKlCoZ4KCFOpK1IFo0WLWaEuK/mVTz3p5IVnAXQ2JR8UusD2esKSN2ISZ2tPQLS+6owHp6MGmwo1V6Ew==',key_name='tempest-keypair-446779548',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f4707f4d9cd47c2b988af4fdaf685ef',ramdisk_id='',reservation_id='r-v4wjulup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1264452311',owner_user_name='tempest-VolumesSnapshotTestJSON-1264452311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:02:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce08ff2ccf9940259c0beb5ba8aba5d3',uuid=328e872d-da9b-4ebc-9069-937c2d3fc74c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0373e7b-3687-462c-a775-ea6bdab07469", "address": "fa:16:3e:e5:bb:36", "network": {"id": "3458700f-a875-4968-8ae8-464e9ce8ab81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1812819141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4707f4d9cd47c2b988af4fdaf685ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0373e7b-36", "ovs_interfaceid": "c0373e7b-3687-462c-a775-ea6bdab07469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Converting VIF {"id": "c0373e7b-3687-462c-a775-ea6bdab07469", "address": "fa:16:3e:e5:bb:36", "network": {"id": "3458700f-a875-4968-8ae8-464e9ce8ab81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1812819141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4707f4d9cd47c2b988af4fdaf685ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0373e7b-36", "ovs_interfaceid": "c0373e7b-3687-462c-a775-ea6bdab07469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:bb:36,bridge_name='br-int',has_traffic_filtering=True,id=c0373e7b-3687-462c-a775-ea6bdab07469,network=Network(3458700f-a875-4968-8ae8-464e9ce8ab81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0373e7b-36') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.objects.instance [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lazy-loading 'pci_devices' on Instance uuid 328e872d-da9b-4ebc-9069-937c2d3fc74c {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] End _get_guest_xml xml=<domain type="kvm">
Aug 14 14:02:26 user nova-compute[73484]:   <uuid>328e872d-da9b-4ebc-9069-937c2d3fc74c</uuid>
Aug 14 14:02:26 user nova-compute[73484]:   <name>instance-0000002b</name>
Aug 14 14:02:26 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 14:02:26 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 14:02:26 user nova-compute[73484]:   <metadata>
Aug 14 14:02:26 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 14:02:26 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 14:02:26 user nova-compute[73484]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-427263749</nova:name>
Aug 14 14:02:26 user nova-compute[73484]:       <nova:creationTime>2023-08-14 14:02:26</nova:creationTime>
Aug 14 14:02:26 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 14:02:26 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 14:02:26 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 14:02:26 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 14:02:26 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 14:02:26 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 14:02:26 user nova-compute[73484]:       </nova:flavor>
Aug 14 14:02:26 user nova-compute[73484]:       <nova:owner>
Aug 14 14:02:26 user nova-compute[73484]:         <nova:user uuid="ce08ff2ccf9940259c0beb5ba8aba5d3">tempest-VolumesSnapshotTestJSON-1264452311-project-member</nova:user>
Aug 14 14:02:26 user nova-compute[73484]:         <nova:project uuid="7f4707f4d9cd47c2b988af4fdaf685ef">tempest-VolumesSnapshotTestJSON-1264452311</nova:project>
Aug 14 14:02:26 user nova-compute[73484]:       </nova:owner>
Aug 14 14:02:26 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 14:02:26 user nova-compute[73484]:       <nova:ports>
Aug 14 14:02:26 user nova-compute[73484]:         <nova:port uuid="c0373e7b-3687-462c-a775-ea6bdab07469">
Aug 14 14:02:26 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 14:02:26 user nova-compute[73484]:         </nova:port>
Aug 14 14:02:26 user nova-compute[73484]:       </nova:ports>
Aug 14 14:02:26 user nova-compute[73484]:     </nova:instance>
Aug 14 14:02:26 user nova-compute[73484]:   </metadata>
Aug 14 14:02:26 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 14:02:26 user nova-compute[73484]:     <system>
Aug 14 14:02:26 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 14:02:26 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 14:02:26 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 14:02:26 user nova-compute[73484]:       <entry name="serial">328e872d-da9b-4ebc-9069-937c2d3fc74c</entry>
Aug 14 14:02:26 user nova-compute[73484]:       <entry name="uuid">328e872d-da9b-4ebc-9069-937c2d3fc74c</entry>
Aug 14 14:02:26 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 14:02:26 user nova-compute[73484]:     </system>
Aug 14 14:02:26 user nova-compute[73484]:   </sysinfo>
Aug 14 14:02:26 user nova-compute[73484]:   <os>
Aug 14 14:02:26 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 14:02:26 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 14:02:26 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 14:02:26 user nova-compute[73484]:   </os>
Aug 14 14:02:26 user nova-compute[73484]:   <features>
Aug 14 14:02:26 user nova-compute[73484]:     <acpi/>
Aug 14 14:02:26 user nova-compute[73484]:     <apic/>
Aug 14 14:02:26 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 14:02:26 user nova-compute[73484]:   </features>
Aug 14 14:02:26 user nova-compute[73484]:   <clock offset="utc">
Aug 14 14:02:26 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 14:02:26 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 14:02:26 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 14:02:26 user nova-compute[73484]:   </clock>
Aug 14 14:02:26 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 14:02:26 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 14:02:26 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 14:02:26 user nova-compute[73484]:   </cpu>
Aug 14 14:02:26 user nova-compute[73484]:   <devices>
Aug 14 14:02:26 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 14:02:26 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 14:02:26 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/328e872d-da9b-4ebc-9069-937c2d3fc74c/disk"/>
Aug 14 14:02:26 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 14:02:26 user nova-compute[73484]:     </disk>
Aug 14 14:02:26 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 14:02:26 user nova-compute[73484]:       <mac address="fa:16:3e:e5:bb:36"/>
Aug 14 14:02:26 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 14:02:26 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 14:02:26 user nova-compute[73484]:       <target dev="tapc0373e7b-36"/>
Aug 14 14:02:26 user nova-compute[73484]:     </interface>
Aug 14 14:02:26 user nova-compute[73484]:     <serial type="pty">
Aug 14 14:02:26 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/328e872d-da9b-4ebc-9069-937c2d3fc74c/console.log" append="off"/>
Aug 14 14:02:26 user nova-compute[73484]:     </serial>
Aug 14 14:02:26 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 14:02:26 user nova-compute[73484]:     <video>
Aug 14 14:02:26 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 14:02:26 user nova-compute[73484]:     </video>
Aug 14 14:02:26 user nova-compute[73484]:     <rng model="virtio">
Aug 14 14:02:26 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 14:02:26 user nova-compute[73484]:     </rng>
Aug 14 14:02:26 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 14:02:26 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 14:02:26 user nova-compute[73484]:       <stats period="10"/>
Aug 14 14:02:26 user nova-compute[73484]:     </memballoon>
Aug 14 14:02:26 user nova-compute[73484]:   </devices>
Aug 14 14:02:26 user nova-compute[73484]: </domain>
Aug 14 14:02:26 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-427263749',display_name='tempest-VolumesSnapshotTestJSON-instance-427263749',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-427263749',id=43,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbPa9UUfKEDzopR8jgfuCfi1J5PXmBtWJtQWtUSi/ynaWeVV6rKlCoZ4KCFOpK1IFo0WLWaEuK/mVTz3p5IVnAXQ2JR8UusD2esKSN2ISZ2tPQLS+6owHp6MGmwo1V6Ew==',key_name='tempest-keypair-446779548',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f4707f4d9cd47c2b988af4fdaf685ef',ramdisk_id='',reservation_id='r-v4wjulup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1264452311',owner_user_name='tempest-VolumesSnapshotTestJSON-1264452311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:02:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce08ff2ccf9940259c0beb5ba8aba5d3',uuid=328e872d-da9b-4ebc-9069-937c2d3fc74c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0373e7b-3687-462c-a775-ea6bdab07469", "address": "fa:16:3e:e5:bb:36", "network": {"id": "3458700f-a875-4968-8ae8-464e9ce8ab81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1812819141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4707f4d9cd47c2b988af4fdaf685ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0373e7b-36", "ovs_interfaceid": "c0373e7b-3687-462c-a775-ea6bdab07469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Converting VIF {"id": "c0373e7b-3687-462c-a775-ea6bdab07469", "address": "fa:16:3e:e5:bb:36", "network": {"id": "3458700f-a875-4968-8ae8-464e9ce8ab81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1812819141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4707f4d9cd47c2b988af4fdaf685ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0373e7b-36", "ovs_interfaceid": "c0373e7b-3687-462c-a775-ea6bdab07469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:bb:36,bridge_name='br-int',has_traffic_filtering=True,id=c0373e7b-3687-462c-a775-ea6bdab07469,network=Network(3458700f-a875-4968-8ae8-464e9ce8ab81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0373e7b-36') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG os_vif [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:bb:36,bridge_name='br-int',has_traffic_filtering=True,id=c0373e7b-3687-462c-a775-ea6bdab07469,network=Network(3458700f-a875-4968-8ae8-464e9ce8ab81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0373e7b-36') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0373e7b-36, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc0373e7b-36, col_values=(('external_ids', {'iface-id': 'c0373e7b-3687-462c-a775-ea6bdab07469', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:bb:36', 'vm-uuid': '328e872d-da9b-4ebc-9069-937c2d3fc74c'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:02:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:26 user nova-compute[73484]: INFO os_vif [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:bb:36,bridge_name='br-int',has_traffic_filtering=True,id=c0373e7b-3687-462c-a775-ea6bdab07469,network=Network(3458700f-a875-4968-8ae8-464e9ce8ab81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0373e7b-36')
Aug 14 14:02:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:02:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] No VIF found with MAC fa:16:3e:e5:bb:36, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:02:27 user nova-compute[73484]: DEBUG nova.network.neutron [req-786bec5c-f329-4be3-aedb-483fa444a69c req-cf35ad07-35f6-49a0-82fd-ead1d0e15567 service nova] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Updated VIF entry in instance network info cache for port c0373e7b-3687-462c-a775-ea6bdab07469. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:02:27 user nova-compute[73484]: DEBUG nova.network.neutron [req-786bec5c-f329-4be3-aedb-483fa444a69c req-cf35ad07-35f6-49a0-82fd-ead1d0e15567 service nova] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Updating instance_info_cache with network_info: [{"id": "c0373e7b-3687-462c-a775-ea6bdab07469", "address": "fa:16:3e:e5:bb:36", "network": {"id": "3458700f-a875-4968-8ae8-464e9ce8ab81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1812819141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4707f4d9cd47c2b988af4fdaf685ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0373e7b-36", "ovs_interfaceid": "c0373e7b-3687-462c-a775-ea6bdab07469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:02:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-786bec5c-f329-4be3-aedb-483fa444a69c req-cf35ad07-35f6-49a0-82fd-ead1d0e15567 service nova] Releasing lock "refresh_cache-328e872d-da9b-4ebc-9069-937c2d3fc74c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:02:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:28 user nova-compute[73484]: DEBUG nova.compute.manager [req-8f68b48d-c731-45d8-86de-d9c373d629e2 req-9c44de81-393f-49d7-9e87-2787a8d7d545 service nova] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Received event network-vif-plugged-c0373e7b-3687-462c-a775-ea6bdab07469 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:02:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8f68b48d-c731-45d8-86de-d9c373d629e2 req-9c44de81-393f-49d7-9e87-2787a8d7d545 service nova] Acquiring lock "328e872d-da9b-4ebc-9069-937c2d3fc74c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:02:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8f68b48d-c731-45d8-86de-d9c373d629e2 req-9c44de81-393f-49d7-9e87-2787a8d7d545 service nova] Lock "328e872d-da9b-4ebc-9069-937c2d3fc74c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:02:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8f68b48d-c731-45d8-86de-d9c373d629e2 req-9c44de81-393f-49d7-9e87-2787a8d7d545 service nova] Lock "328e872d-da9b-4ebc-9069-937c2d3fc74c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:02:28 user nova-compute[73484]: DEBUG nova.compute.manager [req-8f68b48d-c731-45d8-86de-d9c373d629e2 req-9c44de81-393f-49d7-9e87-2787a8d7d545 service nova] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] No waiting events found dispatching network-vif-plugged-c0373e7b-3687-462c-a775-ea6bdab07469 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:02:28 user nova-compute[73484]: WARNING nova.compute.manager [req-8f68b48d-c731-45d8-86de-d9c373d629e2 req-9c44de81-393f-49d7-9e87-2787a8d7d545 service nova] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Received unexpected event network-vif-plugged-c0373e7b-3687-462c-a775-ea6bdab07469 for instance with vm_state building and task_state spawning.
Aug 14 14:02:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:30 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021750.5573063, 328e872d-da9b-4ebc-9069-937c2d3fc74c => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:02:30 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] VM Resumed (Lifecycle Event)
Aug 14 14:02:30 user nova-compute[73484]: DEBUG nova.compute.manager [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 14:02:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 14:02:30 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Instance spawned successfully.
Aug 14 14:02:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 14:02:30 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:02:30 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:02:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:02:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:02:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:02:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:02:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:02:30 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:02:30 user nova-compute[73484]: DEBUG nova.compute.manager [req-af3100cb-a304-43d5-9128-0828c18f63e3 req-409a484d-bebb-4313-a556-605921f311e5 service nova] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Received event network-vif-plugged-c0373e7b-3687-462c-a775-ea6bdab07469 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:02:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-af3100cb-a304-43d5-9128-0828c18f63e3 req-409a484d-bebb-4313-a556-605921f311e5 service nova] Acquiring lock "328e872d-da9b-4ebc-9069-937c2d3fc74c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:02:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-af3100cb-a304-43d5-9128-0828c18f63e3 req-409a484d-bebb-4313-a556-605921f311e5 service nova] Lock "328e872d-da9b-4ebc-9069-937c2d3fc74c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:02:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-af3100cb-a304-43d5-9128-0828c18f63e3 req-409a484d-bebb-4313-a556-605921f311e5 service nova] Lock "328e872d-da9b-4ebc-9069-937c2d3fc74c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:02:30 user nova-compute[73484]: DEBUG nova.compute.manager [req-af3100cb-a304-43d5-9128-0828c18f63e3 req-409a484d-bebb-4313-a556-605921f311e5 service nova] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] No waiting events found dispatching network-vif-plugged-c0373e7b-3687-462c-a775-ea6bdab07469 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:02:30 user nova-compute[73484]: WARNING nova.compute.manager [req-af3100cb-a304-43d5-9128-0828c18f63e3 req-409a484d-bebb-4313-a556-605921f311e5 service nova] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Received unexpected event network-vif-plugged-c0373e7b-3687-462c-a775-ea6bdab07469 for instance with vm_state building and task_state spawning.
Aug 14 14:02:30 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:02:30 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021750.5652287, 328e872d-da9b-4ebc-9069-937c2d3fc74c => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:02:30 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] VM Started (Lifecycle Event)
Aug 14 14:02:30 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:02:30 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:02:30 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:02:30 user nova-compute[73484]: INFO nova.compute.manager [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Took 6.00 seconds to spawn the instance on the hypervisor.
Aug 14 14:02:30 user nova-compute[73484]: DEBUG nova.compute.manager [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:02:30 user nova-compute[73484]: INFO nova.compute.manager [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Took 6.55 seconds to build instance.
Aug 14 14:02:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-486d32e5-c688-41fb-9375-94772600876b tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "328e872d-da9b-4ebc-9069-937c2d3fc74c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.658s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:02:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d03c3e72-6e24-4647-b052-f680256b847f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "782c6142-757a-49ae-9292-787a7f1e8a23" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:02:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d03c3e72-6e24-4647-b052-f680256b847f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "782c6142-757a-49ae-9292-787a7f1e8a23" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:02:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d03c3e72-6e24-4647-b052-f680256b847f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:02:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d03c3e72-6e24-4647-b052-f680256b847f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:02:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d03c3e72-6e24-4647-b052-f680256b847f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:02:31 user nova-compute[73484]: INFO nova.compute.manager [None req-d03c3e72-6e24-4647-b052-f680256b847f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Terminating instance
Aug 14 14:02:31 user nova-compute[73484]: DEBUG nova.compute.manager [None req-d03c3e72-6e24-4647-b052-f680256b847f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 14:02:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:31 user nova-compute[73484]: DEBUG nova.compute.manager [req-b9dfb896-7ac9-4559-b8ac-da32bd1267d6 req-1aacc043-f542-40c3-bd5e-664141244606 service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Received event network-vif-unplugged-2246e004-4f6b-449d-91b2-8e67b4f51006 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:02:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b9dfb896-7ac9-4559-b8ac-da32bd1267d6 req-1aacc043-f542-40c3-bd5e-664141244606 service nova] Acquiring lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:02:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b9dfb896-7ac9-4559-b8ac-da32bd1267d6 req-1aacc043-f542-40c3-bd5e-664141244606 service nova] Lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:02:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b9dfb896-7ac9-4559-b8ac-da32bd1267d6 req-1aacc043-f542-40c3-bd5e-664141244606 service nova] Lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:02:31 user nova-compute[73484]: DEBUG nova.compute.manager [req-b9dfb896-7ac9-4559-b8ac-da32bd1267d6 req-1aacc043-f542-40c3-bd5e-664141244606 service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] No waiting events found dispatching network-vif-unplugged-2246e004-4f6b-449d-91b2-8e67b4f51006 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:02:31 user nova-compute[73484]: DEBUG nova.compute.manager [req-b9dfb896-7ac9-4559-b8ac-da32bd1267d6 req-1aacc043-f542-40c3-bd5e-664141244606 service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Received event network-vif-unplugged-2246e004-4f6b-449d-91b2-8e67b4f51006 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 14:02:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:31 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Instance destroyed successfully.
Aug 14 14:02:31 user nova-compute[73484]: DEBUG nova.objects.instance [None req-d03c3e72-6e24-4647-b052-f680256b847f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lazy-loading 'resources' on Instance uuid 782c6142-757a-49ae-9292-787a7f1e8a23 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:02:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-d03c3e72-6e24-4647-b052-f680256b847f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T13:45:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-260357687',display_name='tempest-ServerRescueNegativeTestJSON-server-260357687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-260357687',id=24,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T13:50:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f4df46bcfb843b7ac6c17d106703950',ramdisk_id='',reservation_id='r-07yebak7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-496474583',owner_user_name='tempest-ServerRescueNegativeTestJSON-496474583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T13:52:07Z,user_data=None,user_id='45d86b9371024e3d95ece74ccb2c37d9',uuid=782c6142-757a-49ae-9292-787a7f1e8a23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2246e004-4f6b-449d-91b2-8e67b4f51006", "address": "fa:16:3e:31:2a:06", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2246e004-4f", "ovs_interfaceid": "2246e004-4f6b-449d-91b2-8e67b4f51006", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 14:02:31 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-d03c3e72-6e24-4647-b052-f680256b847f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Converting VIF {"id": "2246e004-4f6b-449d-91b2-8e67b4f51006", "address": "fa:16:3e:31:2a:06", "network": {"id": "cad53782-5ecf-4140-b113-62e807bf87df", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2021668862-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4df46bcfb843b7ac6c17d106703950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2246e004-4f", "ovs_interfaceid": "2246e004-4f6b-449d-91b2-8e67b4f51006", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:02:31 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-d03c3e72-6e24-4647-b052-f680256b847f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:2a:06,bridge_name='br-int',has_traffic_filtering=True,id=2246e004-4f6b-449d-91b2-8e67b4f51006,network=Network(cad53782-5ecf-4140-b113-62e807bf87df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2246e004-4f') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:02:31 user nova-compute[73484]: DEBUG os_vif [None req-d03c3e72-6e24-4647-b052-f680256b847f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:2a:06,bridge_name='br-int',has_traffic_filtering=True,id=2246e004-4f6b-449d-91b2-8e67b4f51006,network=Network(cad53782-5ecf-4140-b113-62e807bf87df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2246e004-4f') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 14:02:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2246e004-4f, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:02:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:02:32 user nova-compute[73484]: INFO os_vif [None req-d03c3e72-6e24-4647-b052-f680256b847f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:2a:06,bridge_name='br-int',has_traffic_filtering=True,id=2246e004-4f6b-449d-91b2-8e67b4f51006,network=Network(cad53782-5ecf-4140-b113-62e807bf87df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2246e004-4f')
Aug 14 14:02:32 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-d03c3e72-6e24-4647-b052-f680256b847f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Deleting instance files /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23_del
Aug 14 14:02:32 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-d03c3e72-6e24-4647-b052-f680256b847f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Deletion of /opt/stack/data/nova/instances/782c6142-757a-49ae-9292-787a7f1e8a23_del complete
Aug 14 14:02:32 user nova-compute[73484]: INFO nova.compute.manager [None req-d03c3e72-6e24-4647-b052-f680256b847f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Took 0.77 seconds to destroy the instance on the hypervisor.
Aug 14 14:02:32 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-d03c3e72-6e24-4647-b052-f680256b847f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 14:02:32 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 14:02:32 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 14:02:32 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:02:32 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Took 0.52 seconds to deallocate network for instance.
Aug 14 14:02:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d03c3e72-6e24-4647-b052-f680256b847f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:02:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d03c3e72-6e24-4647-b052-f680256b847f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:02:32 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-d03c3e72-6e24-4647-b052-f680256b847f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:02:32 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-d03c3e72-6e24-4647-b052-f680256b847f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:02:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d03c3e72-6e24-4647-b052-f680256b847f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:02:32 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-d03c3e72-6e24-4647-b052-f680256b847f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Deleted allocations for instance 782c6142-757a-49ae-9292-787a7f1e8a23
Aug 14 14:02:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d03c3e72-6e24-4647-b052-f680256b847f tempest-ServerRescueNegativeTestJSON-496474583 tempest-ServerRescueNegativeTestJSON-496474583-project-member] Lock "782c6142-757a-49ae-9292-787a7f1e8a23" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.732s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:02:33 user nova-compute[73484]: DEBUG nova.compute.manager [req-e941d053-7d52-4229-bde6-1512dd57e930 req-c1b93755-5624-4c4f-bab7-195e8521f2d5 service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Received event network-vif-plugged-2246e004-4f6b-449d-91b2-8e67b4f51006 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:02:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e941d053-7d52-4229-bde6-1512dd57e930 req-c1b93755-5624-4c4f-bab7-195e8521f2d5 service nova] Acquiring lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:02:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e941d053-7d52-4229-bde6-1512dd57e930 req-c1b93755-5624-4c4f-bab7-195e8521f2d5 service nova] Lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:02:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e941d053-7d52-4229-bde6-1512dd57e930 req-c1b93755-5624-4c4f-bab7-195e8521f2d5 service nova] Lock "782c6142-757a-49ae-9292-787a7f1e8a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:02:33 user nova-compute[73484]: DEBUG nova.compute.manager [req-e941d053-7d52-4229-bde6-1512dd57e930 req-c1b93755-5624-4c4f-bab7-195e8521f2d5 service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] No waiting events found dispatching network-vif-plugged-2246e004-4f6b-449d-91b2-8e67b4f51006 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:02:33 user nova-compute[73484]: WARNING nova.compute.manager [req-e941d053-7d52-4229-bde6-1512dd57e930 req-c1b93755-5624-4c4f-bab7-195e8521f2d5 service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Received unexpected event network-vif-plugged-2246e004-4f6b-449d-91b2-8e67b4f51006 for instance with vm_state deleted and task_state None.
Aug 14 14:02:33 user nova-compute[73484]: DEBUG nova.compute.manager [req-e941d053-7d52-4229-bde6-1512dd57e930 req-c1b93755-5624-4c4f-bab7-195e8521f2d5 service nova] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Received event network-vif-deleted-2246e004-4f6b-449d-91b2-8e67b4f51006 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:02:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:42 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:02:42 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:42 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:02:42 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:02:42 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:02:42 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2382c7d8-8093-493b-9b4e-7b48a7e74c2c tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Acquiring lock "1f76f07a-33c6-466e-9008-a31589f5c870" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:02:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2382c7d8-8093-493b-9b4e-7b48a7e74c2c tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "1f76f07a-33c6-466e-9008-a31589f5c870" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:02:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2382c7d8-8093-493b-9b4e-7b48a7e74c2c tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Acquiring lock "1f76f07a-33c6-466e-9008-a31589f5c870-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:02:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2382c7d8-8093-493b-9b4e-7b48a7e74c2c tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "1f76f07a-33c6-466e-9008-a31589f5c870-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:02:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2382c7d8-8093-493b-9b4e-7b48a7e74c2c tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "1f76f07a-33c6-466e-9008-a31589f5c870-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:02:46 user nova-compute[73484]: INFO nova.compute.manager [None req-2382c7d8-8093-493b-9b4e-7b48a7e74c2c tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Terminating instance
Aug 14 14:02:46 user nova-compute[73484]: DEBUG nova.compute.manager [None req-2382c7d8-8093-493b-9b4e-7b48a7e74c2c tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 14:02:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:46 user nova-compute[73484]: DEBUG nova.compute.manager [req-b79deca2-8e2a-404a-8aa0-6a0297b7158c req-9f7f0f5c-8537-4bff-9248-f38220dc380a service nova] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Received event network-vif-unplugged-41a9a017-ad62-448b-b319-0cf66bc85dba {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:02:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b79deca2-8e2a-404a-8aa0-6a0297b7158c req-9f7f0f5c-8537-4bff-9248-f38220dc380a service nova] Acquiring lock "1f76f07a-33c6-466e-9008-a31589f5c870-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:02:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b79deca2-8e2a-404a-8aa0-6a0297b7158c req-9f7f0f5c-8537-4bff-9248-f38220dc380a service nova] Lock "1f76f07a-33c6-466e-9008-a31589f5c870-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:02:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b79deca2-8e2a-404a-8aa0-6a0297b7158c req-9f7f0f5c-8537-4bff-9248-f38220dc380a service nova] Lock "1f76f07a-33c6-466e-9008-a31589f5c870-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:02:46 user nova-compute[73484]: DEBUG nova.compute.manager [req-b79deca2-8e2a-404a-8aa0-6a0297b7158c req-9f7f0f5c-8537-4bff-9248-f38220dc380a service nova] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] No waiting events found dispatching network-vif-unplugged-41a9a017-ad62-448b-b319-0cf66bc85dba {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:02:46 user nova-compute[73484]: DEBUG nova.compute.manager [req-b79deca2-8e2a-404a-8aa0-6a0297b7158c req-9f7f0f5c-8537-4bff-9248-f38220dc380a service nova] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Received event network-vif-unplugged-41a9a017-ad62-448b-b319-0cf66bc85dba for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 14:02:47 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692021751.9604337, 782c6142-757a-49ae-9292-787a7f1e8a23 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:02:47 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] VM Stopped (Lifecycle Event)
Aug 14 14:02:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-88240ccc-9eea-4ee8-bcc1-296f2e1f0446 None None] [instance: 782c6142-757a-49ae-9292-787a7f1e8a23] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:02:47 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Instance destroyed successfully.
Aug 14 14:02:47 user nova-compute[73484]: DEBUG nova.objects.instance [None req-2382c7d8-8093-493b-9b4e-7b48a7e74c2c tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lazy-loading 'resources' on Instance uuid 1f76f07a-33c6-466e-9008-a31589f5c870 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:02:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-2382c7d8-8093-493b-9b4e-7b48a7e74c2c tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-302972027',display_name='tempest-VolumesActionsTest-instance-302972027',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-302972027',id=42,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T14:01:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a3a83ee8b254c66a0b9904abf8c65c5',ramdisk_id='',reservation_id='r-62e2gwnp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1293487514',owner_user_name='tempest-VolumesActionsTest-1293487514-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T14:01:02Z,user_data=None,user_id='948dcb0982b745659f53c0d4d9a68a07',uuid=1f76f07a-33c6-466e-9008-a31589f5c870,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41a9a017-ad62-448b-b319-0cf66bc85dba", "address": "fa:16:3e:e3:10:da", "network": {"id": "0579994b-5b06-4838-87f7-e83438382cdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419510355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3a83ee8b254c66a0b9904abf8c65c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a9a017-ad", "ovs_interfaceid": "41a9a017-ad62-448b-b319-0cf66bc85dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 14:02:47 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-2382c7d8-8093-493b-9b4e-7b48a7e74c2c tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Converting VIF {"id": "41a9a017-ad62-448b-b319-0cf66bc85dba", "address": "fa:16:3e:e3:10:da", "network": {"id": "0579994b-5b06-4838-87f7-e83438382cdf", "bridge": "br-int", "label": "tempest-VolumesActionsTest-419510355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3a83ee8b254c66a0b9904abf8c65c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41a9a017-ad", "ovs_interfaceid": "41a9a017-ad62-448b-b319-0cf66bc85dba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:02:47 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-2382c7d8-8093-493b-9b4e-7b48a7e74c2c tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:10:da,bridge_name='br-int',has_traffic_filtering=True,id=41a9a017-ad62-448b-b319-0cf66bc85dba,network=Network(0579994b-5b06-4838-87f7-e83438382cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a9a017-ad') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:02:47 user nova-compute[73484]: DEBUG os_vif [None req-2382c7d8-8093-493b-9b4e-7b48a7e74c2c tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:10:da,bridge_name='br-int',has_traffic_filtering=True,id=41a9a017-ad62-448b-b319-0cf66bc85dba,network=Network(0579994b-5b06-4838-87f7-e83438382cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a9a017-ad') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 14:02:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41a9a017-ad, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:02:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:02:47 user nova-compute[73484]: INFO os_vif [None req-2382c7d8-8093-493b-9b4e-7b48a7e74c2c tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:10:da,bridge_name='br-int',has_traffic_filtering=True,id=41a9a017-ad62-448b-b319-0cf66bc85dba,network=Network(0579994b-5b06-4838-87f7-e83438382cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41a9a017-ad')
Aug 14 14:02:47 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-2382c7d8-8093-493b-9b4e-7b48a7e74c2c tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Deleting instance files /opt/stack/data/nova/instances/1f76f07a-33c6-466e-9008-a31589f5c870_del
Aug 14 14:02:47 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-2382c7d8-8093-493b-9b4e-7b48a7e74c2c tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Deletion of /opt/stack/data/nova/instances/1f76f07a-33c6-466e-9008-a31589f5c870_del complete
Aug 14 14:02:47 user nova-compute[73484]: INFO nova.compute.manager [None req-2382c7d8-8093-493b-9b4e-7b48a7e74c2c tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 14 14:02:47 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-2382c7d8-8093-493b-9b4e-7b48a7e74c2c tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 14:02:47 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 14:02:47 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 14:02:47 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:02:47 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Took 0.56 seconds to deallocate network for instance.
Aug 14 14:02:47 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:02:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 14:02:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2382c7d8-8093-493b-9b4e-7b48a7e74c2c tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:02:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2382c7d8-8093-493b-9b4e-7b48a7e74c2c tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:02:47 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-2382c7d8-8093-493b-9b4e-7b48a7e74c2c tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:02:47 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-2382c7d8-8093-493b-9b4e-7b48a7e74c2c tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:02:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2382c7d8-8093-493b-9b4e-7b48a7e74c2c tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:02:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-1f76f07a-33c6-466e-9008-a31589f5c870" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:02:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-1f76f07a-33c6-466e-9008-a31589f5c870" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:02:48 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 14:02:48 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-2382c7d8-8093-493b-9b4e-7b48a7e74c2c tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Deleted allocations for instance 1f76f07a-33c6-466e-9008-a31589f5c870
Aug 14 14:02:48 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 14:02:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2382c7d8-8093-493b-9b4e-7b48a7e74c2c tempest-VolumesActionsTest-1293487514 tempest-VolumesActionsTest-1293487514-project-member] Lock "1f76f07a-33c6-466e-9008-a31589f5c870" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.118s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:02:48 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:02:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-1f76f07a-33c6-466e-9008-a31589f5c870" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:02:48 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 14:02:48 user nova-compute[73484]: DEBUG nova.compute.manager [req-c3ae4f4b-4600-4d75-a08b-2d78107311a4 req-14fbe244-fd89-4651-8c03-ae85506afb64 service nova] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Received event network-vif-plugged-41a9a017-ad62-448b-b319-0cf66bc85dba {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:02:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c3ae4f4b-4600-4d75-a08b-2d78107311a4 req-14fbe244-fd89-4651-8c03-ae85506afb64 service nova] Acquiring lock "1f76f07a-33c6-466e-9008-a31589f5c870-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:02:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c3ae4f4b-4600-4d75-a08b-2d78107311a4 req-14fbe244-fd89-4651-8c03-ae85506afb64 service nova] Lock "1f76f07a-33c6-466e-9008-a31589f5c870-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:02:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c3ae4f4b-4600-4d75-a08b-2d78107311a4 req-14fbe244-fd89-4651-8c03-ae85506afb64 service nova] Lock "1f76f07a-33c6-466e-9008-a31589f5c870-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:02:48 user nova-compute[73484]: DEBUG nova.compute.manager [req-c3ae4f4b-4600-4d75-a08b-2d78107311a4 req-14fbe244-fd89-4651-8c03-ae85506afb64 service nova] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] No waiting events found dispatching network-vif-plugged-41a9a017-ad62-448b-b319-0cf66bc85dba {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:02:48 user nova-compute[73484]: WARNING nova.compute.manager [req-c3ae4f4b-4600-4d75-a08b-2d78107311a4 req-14fbe244-fd89-4651-8c03-ae85506afb64 service nova] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Received unexpected event network-vif-plugged-41a9a017-ad62-448b-b319-0cf66bc85dba for instance with vm_state deleted and task_state None.
Aug 14 14:02:48 user nova-compute[73484]: DEBUG nova.compute.manager [req-c3ae4f4b-4600-4d75-a08b-2d78107311a4 req-14fbe244-fd89-4651-8c03-ae85506afb64 service nova] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Received event network-vif-deleted-41a9a017-ad62-448b-b319-0cf66bc85dba {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:02:49 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:02:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:52 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:52 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:02:52 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73484) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 14:02:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:57 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:02:57 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:02:57 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:02:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 14:02:57 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:02:58 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:02:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:02:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:02:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:02:58 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 14:02:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:58 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/328e872d-da9b-4ebc-9069-937c2d3fc74c/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:02:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/328e872d-da9b-4ebc-9069-937c2d3fc74c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:02:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/328e872d-da9b-4ebc-9069-937c2d3fc74c/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:02:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/328e872d-da9b-4ebc-9069-937c2d3fc74c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:02:59 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:02:59 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:02:59 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=8458MB free_disk=25.342269897460938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 14:02:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:02:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:02:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:02:59 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 328e872d-da9b-4ebc-9069-937c2d3fc74c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:02:59 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 14:02:59 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 14:02:59 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:02:59 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:03:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 14:03:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.230s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:03:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "ee776e8c-6c86-450c-a020-1778e32e4d9c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:03:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:03:00 user nova-compute[73484]: DEBUG nova.compute.manager [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 14:03:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:03:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:03:01 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 14:03:01 user nova-compute[73484]: INFO nova.compute.claims [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Claim successful on node user
Aug 14 14:03:01 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Refreshing inventories for resource provider 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 14:03:01 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Updating ProviderTree inventory for provider 165d4635-93b4-49a6-879a-21c1324822ab from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 14:03:01 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Updating inventory in ProviderTree for provider 165d4635-93b4-49a6-879a-21c1324822ab with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 14:03:01 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Refreshing aggregate associations for resource provider 165d4635-93b4-49a6-879a-21c1324822ab, aggregates: None {{(pid=73484) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 14:03:01 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Refreshing trait associations for resource provider 165d4635-93b4-49a6-879a-21c1324822ab, traits: COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS {{(pid=73484) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 14:03:01 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:03:01 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:03:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.346s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:03:01 user nova-compute[73484]: DEBUG nova.compute.manager [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 14:03:01 user nova-compute[73484]: DEBUG nova.compute.manager [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 14:03:01 user nova-compute[73484]: DEBUG nova.network.neutron [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 14:03:01 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 14:03:01 user nova-compute[73484]: DEBUG nova.compute.manager [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 14:03:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:01 user nova-compute[73484]: DEBUG nova.policy [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be2ee7c7641d4d0892cc3bc03f8340f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1934a2112a584b82a20c4ae8c13a70db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 14:03:01 user nova-compute[73484]: DEBUG nova.compute.manager [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 14:03:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 14:03:01 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Creating image(s)
Aug 14 14:03:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:03:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "/opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:03:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "/opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:03:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "de717a39b1b8d642604f3face08054f09da0c13d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:03:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "de717a39b1b8d642604f3face08054f09da0c13d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:03:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de717a39b1b8d642604f3face08054f09da0c13d.part --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:03:02 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:03:02 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692021767.1157355, 1f76f07a-33c6-466e-9008-a31589f5c870 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:03:02 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] VM Stopped (Lifecycle Event)
Aug 14 14:03:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:02 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:03:02 user nova-compute[73484]: DEBUG nova.compute.manager [None req-4e333d7a-970d-46ee-8688-adb80ea6a1fa None None] [instance: 1f76f07a-33c6-466e-9008-a31589f5c870] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:03:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de717a39b1b8d642604f3face08054f09da0c13d.part --force-share --output=json" returned: 0 in 0.183s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:03:02 user nova-compute[73484]: DEBUG nova.virt.images [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] ce87f5cd-6b5d-4429-b657-1801c6e5a64a was qcow2, converting to raw {{(pid=73484) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 14:03:02 user nova-compute[73484]: DEBUG nova.privsep.utils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73484) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 14:03:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/de717a39b1b8d642604f3face08054f09da0c13d.part /opt/stack/data/nova/instances/_base/de717a39b1b8d642604f3face08054f09da0c13d.converted {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:03:02 user nova-compute[73484]: DEBUG nova.network.neutron [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Successfully created port: 2ab1c5ec-bc00-45c2-9cc0-9a24367e044e {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 14:03:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/de717a39b1b8d642604f3face08054f09da0c13d.part /opt/stack/data/nova/instances/_base/de717a39b1b8d642604f3face08054f09da0c13d.converted" returned: 0 in 0.447s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:03:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de717a39b1b8d642604f3face08054f09da0c13d.converted --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:03:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de717a39b1b8d642604f3face08054f09da0c13d.converted --force-share --output=json" returned: 0 in 0.216s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:03:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "de717a39b1b8d642604f3face08054f09da0c13d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.526s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:03:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de717a39b1b8d642604f3face08054f09da0c13d --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:03:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de717a39b1b8d642604f3face08054f09da0c13d --force-share --output=json" returned: 0 in 0.229s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:03:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "de717a39b1b8d642604f3face08054f09da0c13d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:03:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "de717a39b1b8d642604f3face08054f09da0c13d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:03:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de717a39b1b8d642604f3face08054f09da0c13d --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:03:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de717a39b1b8d642604f3face08054f09da0c13d --force-share --output=json" returned: 0 in 0.188s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:03:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de717a39b1b8d642604f3face08054f09da0c13d,backing_fmt=raw /opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:03:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de717a39b1b8d642604f3face08054f09da0c13d,backing_fmt=raw /opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/disk 1073741824" returned: 0 in 0.072s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:03:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "de717a39b1b8d642604f3face08054f09da0c13d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:03:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de717a39b1b8d642604f3face08054f09da0c13d --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:03:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de717a39b1b8d642604f3face08054f09da0c13d --force-share --output=json" returned: 0 in 0.203s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:03:03 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 14:03:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:03:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:03:04 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Cannot resize image /opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 14:03:04 user nova-compute[73484]: DEBUG nova.objects.instance [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lazy-loading 'migration_context' on Instance uuid ee776e8c-6c86-450c-a020-1778e32e4d9c {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:03:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 14:03:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Ensure instance console log exists: /opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 14:03:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:03:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:03:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:03:04 user nova-compute[73484]: DEBUG nova.network.neutron [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Successfully updated port: 2ab1c5ec-bc00-45c2-9cc0-9a24367e044e {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 14:03:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "refresh_cache-ee776e8c-6c86-450c-a020-1778e32e4d9c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:03:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquired lock "refresh_cache-ee776e8c-6c86-450c-a020-1778e32e4d9c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:03:04 user nova-compute[73484]: DEBUG nova.network.neutron [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 14:03:04 user nova-compute[73484]: DEBUG nova.compute.manager [req-73c35f86-8d90-475e-ba8c-4ec9c945f35b req-06e559d3-7bfb-4449-88e5-ad106917f46c service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Received event network-changed-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:03:04 user nova-compute[73484]: DEBUG nova.compute.manager [req-73c35f86-8d90-475e-ba8c-4ec9c945f35b req-06e559d3-7bfb-4449-88e5-ad106917f46c service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Refreshing instance network info cache due to event network-changed-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:03:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-73c35f86-8d90-475e-ba8c-4ec9c945f35b req-06e559d3-7bfb-4449-88e5-ad106917f46c service nova] Acquiring lock "refresh_cache-ee776e8c-6c86-450c-a020-1778e32e4d9c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:03:04 user nova-compute[73484]: DEBUG nova.network.neutron [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 14:03:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:04 user nova-compute[73484]: DEBUG nova.network.neutron [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Updating instance_info_cache with network_info: [{"id": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "address": "fa:16:3e:e0:52:91", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab1c5ec-bc", "ovs_interfaceid": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Releasing lock "refresh_cache-ee776e8c-6c86-450c-a020-1778e32e4d9c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG nova.compute.manager [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Instance network_info: |[{"id": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "address": "fa:16:3e:e0:52:91", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab1c5ec-bc", "ovs_interfaceid": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-73c35f86-8d90-475e-ba8c-4ec9c945f35b req-06e559d3-7bfb-4449-88e5-ad106917f46c service nova] Acquired lock "refresh_cache-ee776e8c-6c86-450c-a020-1778e32e4d9c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG nova.network.neutron [req-73c35f86-8d90-475e-ba8c-4ec9c945f35b req-06e559d3-7bfb-4449-88e5-ad106917f46c service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Refreshing network info cache for port 2ab1c5ec-bc00-45c2-9cc0-9a24367e044e {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Start _get_guest_xml network_info=[{"id": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "address": "fa:16:3e:e0:52:91", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab1c5ec-bc", "ovs_interfaceid": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:02:58Z,direct_url=<?>,disk_format='qcow2',id=ce87f5cd-6b5d-4429-b657-1801c6e5a64a,min_disk=0,min_ram=0,name='tempest-scenario-img--999043979',owner='1934a2112a584b82a20c4ae8c13a70db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:02:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': 'ce87f5cd-6b5d-4429-b657-1801c6e5a64a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 14:03:05 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:03:05 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:03:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:02:58Z,direct_url=<?>,disk_format='qcow2',id=ce87f5cd-6b5d-4429-b657-1801c6e5a64a,min_disk=0,min_ram=0,name='tempest-scenario-img--999043979',owner='1934a2112a584b82a20c4ae8c13a70db',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:02:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:03:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-530409438',display_name='tempest-TestMinimumBasicScenario-server-530409438',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-530409438',id=44,image_ref='ce87f5cd-6b5d-4429-b657-1801c6e5a64a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSxYsMa2lpFaIzg2BTLUUmAtOBOvy5MRlLHoqnFS9a/fnz22lw4CLm+3C/lSGK4vZ+yXzuyyG9Xw3xej5fA/MKaQWNJBVlRMulQBB5tnrf+EOlakHUGw+CdjPIvZP3uRA==',key_name='tempest-TestMinimumBasicScenario-460265953',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1934a2112a584b82a20c4ae8c13a70db',ramdisk_id='',reservation_id='r-h48umtmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ce87f5cd-6b5d-4429-b657-1801c6e5a64a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-227652473',owner_user_name='tempest-TestMinimumBasicScenario-227652473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:03:02Z,user_data=None,user_id='be2ee7c7641d4d0892cc3bc03f8340f1',uuid=ee776e8c-6c86-450c-a020-1778e32e4d9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "address": "fa:16:3e:e0:52:91", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab1c5ec-bc", "ovs_interfaceid": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Converting VIF {"id": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "address": "fa:16:3e:e0:52:91", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab1c5ec-bc", "ovs_interfaceid": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:52:91,bridge_name='br-int',has_traffic_filtering=True,id=2ab1c5ec-bc00-45c2-9cc0-9a24367e044e,network=Network(b63f0a71-864e-4b2c-9602-fd57c50c5501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab1c5ec-bc') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG nova.objects.instance [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lazy-loading 'pci_devices' on Instance uuid ee776e8c-6c86-450c-a020-1778e32e4d9c {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] End _get_guest_xml xml=<domain type="kvm">
Aug 14 14:03:05 user nova-compute[73484]:   <uuid>ee776e8c-6c86-450c-a020-1778e32e4d9c</uuid>
Aug 14 14:03:05 user nova-compute[73484]:   <name>instance-0000002c</name>
Aug 14 14:03:05 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 14:03:05 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 14:03:05 user nova-compute[73484]:   <metadata>
Aug 14 14:03:05 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 14:03:05 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 14:03:05 user nova-compute[73484]:       <nova:name>tempest-TestMinimumBasicScenario-server-530409438</nova:name>
Aug 14 14:03:05 user nova-compute[73484]:       <nova:creationTime>2023-08-14 14:03:05</nova:creationTime>
Aug 14 14:03:05 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 14:03:05 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 14:03:05 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 14:03:05 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 14:03:05 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 14:03:05 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 14:03:05 user nova-compute[73484]:       </nova:flavor>
Aug 14 14:03:05 user nova-compute[73484]:       <nova:owner>
Aug 14 14:03:05 user nova-compute[73484]:         <nova:user uuid="be2ee7c7641d4d0892cc3bc03f8340f1">tempest-TestMinimumBasicScenario-227652473-project-member</nova:user>
Aug 14 14:03:05 user nova-compute[73484]:         <nova:project uuid="1934a2112a584b82a20c4ae8c13a70db">tempest-TestMinimumBasicScenario-227652473</nova:project>
Aug 14 14:03:05 user nova-compute[73484]:       </nova:owner>
Aug 14 14:03:05 user nova-compute[73484]:       <nova:root type="image" uuid="ce87f5cd-6b5d-4429-b657-1801c6e5a64a"/>
Aug 14 14:03:05 user nova-compute[73484]:       <nova:ports>
Aug 14 14:03:05 user nova-compute[73484]:         <nova:port uuid="2ab1c5ec-bc00-45c2-9cc0-9a24367e044e">
Aug 14 14:03:05 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 14:03:05 user nova-compute[73484]:         </nova:port>
Aug 14 14:03:05 user nova-compute[73484]:       </nova:ports>
Aug 14 14:03:05 user nova-compute[73484]:     </nova:instance>
Aug 14 14:03:05 user nova-compute[73484]:   </metadata>
Aug 14 14:03:05 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 14:03:05 user nova-compute[73484]:     <system>
Aug 14 14:03:05 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 14:03:05 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 14:03:05 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 14:03:05 user nova-compute[73484]:       <entry name="serial">ee776e8c-6c86-450c-a020-1778e32e4d9c</entry>
Aug 14 14:03:05 user nova-compute[73484]:       <entry name="uuid">ee776e8c-6c86-450c-a020-1778e32e4d9c</entry>
Aug 14 14:03:05 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 14:03:05 user nova-compute[73484]:     </system>
Aug 14 14:03:05 user nova-compute[73484]:   </sysinfo>
Aug 14 14:03:05 user nova-compute[73484]:   <os>
Aug 14 14:03:05 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 14:03:05 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 14:03:05 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 14:03:05 user nova-compute[73484]:   </os>
Aug 14 14:03:05 user nova-compute[73484]:   <features>
Aug 14 14:03:05 user nova-compute[73484]:     <acpi/>
Aug 14 14:03:05 user nova-compute[73484]:     <apic/>
Aug 14 14:03:05 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 14:03:05 user nova-compute[73484]:   </features>
Aug 14 14:03:05 user nova-compute[73484]:   <clock offset="utc">
Aug 14 14:03:05 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 14:03:05 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 14:03:05 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 14:03:05 user nova-compute[73484]:   </clock>
Aug 14 14:03:05 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 14:03:05 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 14:03:05 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 14:03:05 user nova-compute[73484]:   </cpu>
Aug 14 14:03:05 user nova-compute[73484]:   <devices>
Aug 14 14:03:05 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 14:03:05 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 14:03:05 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/disk"/>
Aug 14 14:03:05 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 14:03:05 user nova-compute[73484]:     </disk>
Aug 14 14:03:05 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 14:03:05 user nova-compute[73484]:       <mac address="fa:16:3e:e0:52:91"/>
Aug 14 14:03:05 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 14:03:05 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 14:03:05 user nova-compute[73484]:       <target dev="tap2ab1c5ec-bc"/>
Aug 14 14:03:05 user nova-compute[73484]:     </interface>
Aug 14 14:03:05 user nova-compute[73484]:     <serial type="pty">
Aug 14 14:03:05 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/console.log" append="off"/>
Aug 14 14:03:05 user nova-compute[73484]:     </serial>
Aug 14 14:03:05 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 14:03:05 user nova-compute[73484]:     <video>
Aug 14 14:03:05 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 14:03:05 user nova-compute[73484]:     </video>
Aug 14 14:03:05 user nova-compute[73484]:     <rng model="virtio">
Aug 14 14:03:05 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 14:03:05 user nova-compute[73484]:     </rng>
Aug 14 14:03:05 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 14:03:05 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 14:03:05 user nova-compute[73484]:       <stats period="10"/>
Aug 14 14:03:05 user nova-compute[73484]:     </memballoon>
Aug 14 14:03:05 user nova-compute[73484]:   </devices>
Aug 14 14:03:05 user nova-compute[73484]: </domain>
Aug 14 14:03:05 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:03:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-530409438',display_name='tempest-TestMinimumBasicScenario-server-530409438',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-530409438',id=44,image_ref='ce87f5cd-6b5d-4429-b657-1801c6e5a64a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSxYsMa2lpFaIzg2BTLUUmAtOBOvy5MRlLHoqnFS9a/fnz22lw4CLm+3C/lSGK4vZ+yXzuyyG9Xw3xej5fA/MKaQWNJBVlRMulQBB5tnrf+EOlakHUGw+CdjPIvZP3uRA==',key_name='tempest-TestMinimumBasicScenario-460265953',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1934a2112a584b82a20c4ae8c13a70db',ramdisk_id='',reservation_id='r-h48umtmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ce87f5cd-6b5d-4429-b657-1801c6e5a64a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-227652473',owner_user_name='tempest-TestMinimumBasicScenario-227652473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:03:02Z,user_data=None,user_id='be2ee7c7641d4d0892cc3bc03f8340f1',uuid=ee776e8c-6c86-450c-a020-1778e32e4d9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "address": "fa:16:3e:e0:52:91", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab1c5ec-bc", "ovs_interfaceid": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Converting VIF {"id": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "address": "fa:16:3e:e0:52:91", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab1c5ec-bc", "ovs_interfaceid": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:52:91,bridge_name='br-int',has_traffic_filtering=True,id=2ab1c5ec-bc00-45c2-9cc0-9a24367e044e,network=Network(b63f0a71-864e-4b2c-9602-fd57c50c5501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab1c5ec-bc') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG os_vif [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:52:91,bridge_name='br-int',has_traffic_filtering=True,id=2ab1c5ec-bc00-45c2-9cc0-9a24367e044e,network=Network(b63f0a71-864e-4b2c-9602-fd57c50c5501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab1c5ec-bc') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ab1c5ec-bc, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2ab1c5ec-bc, col_values=(('external_ids', {'iface-id': '2ab1c5ec-bc00-45c2-9cc0-9a24367e044e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:52:91', 'vm-uuid': 'ee776e8c-6c86-450c-a020-1778e32e4d9c'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:05 user nova-compute[73484]: INFO os_vif [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:52:91,bridge_name='br-int',has_traffic_filtering=True,id=2ab1c5ec-bc00-45c2-9cc0-9a24367e044e,network=Network(b63f0a71-864e-4b2c-9602-fd57c50c5501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab1c5ec-bc')
Aug 14 14:03:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] No VIF found with MAC fa:16:3e:e0:52:91, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG nova.network.neutron [req-73c35f86-8d90-475e-ba8c-4ec9c945f35b req-06e559d3-7bfb-4449-88e5-ad106917f46c service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Updated VIF entry in instance network info cache for port 2ab1c5ec-bc00-45c2-9cc0-9a24367e044e. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG nova.network.neutron [req-73c35f86-8d90-475e-ba8c-4ec9c945f35b req-06e559d3-7bfb-4449-88e5-ad106917f46c service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Updating instance_info_cache with network_info: [{"id": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "address": "fa:16:3e:e0:52:91", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab1c5ec-bc", "ovs_interfaceid": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-73c35f86-8d90-475e-ba8c-4ec9c945f35b req-06e559d3-7bfb-4449-88e5-ad106917f46c service nova] Releasing lock "refresh_cache-ee776e8c-6c86-450c-a020-1778e32e4d9c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:03:05 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:03:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:06 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:03:06 user nova-compute[73484]: DEBUG nova.compute.manager [req-27b28d0c-50a9-48b7-8ec2-2c01a0b415fb req-11bb62a4-fe6c-4c38-a4d1-a4a1a5812705 service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Received event network-vif-plugged-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:03:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-27b28d0c-50a9-48b7-8ec2-2c01a0b415fb req-11bb62a4-fe6c-4c38-a4d1-a4a1a5812705 service nova] Acquiring lock "ee776e8c-6c86-450c-a020-1778e32e4d9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:03:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-27b28d0c-50a9-48b7-8ec2-2c01a0b415fb req-11bb62a4-fe6c-4c38-a4d1-a4a1a5812705 service nova] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:03:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-27b28d0c-50a9-48b7-8ec2-2c01a0b415fb req-11bb62a4-fe6c-4c38-a4d1-a4a1a5812705 service nova] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:03:07 user nova-compute[73484]: DEBUG nova.compute.manager [req-27b28d0c-50a9-48b7-8ec2-2c01a0b415fb req-11bb62a4-fe6c-4c38-a4d1-a4a1a5812705 service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] No waiting events found dispatching network-vif-plugged-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:03:07 user nova-compute[73484]: WARNING nova.compute.manager [req-27b28d0c-50a9-48b7-8ec2-2c01a0b415fb req-11bb62a4-fe6c-4c38-a4d1-a4a1a5812705 service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Received unexpected event network-vif-plugged-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e for instance with vm_state building and task_state spawning.
Aug 14 14:03:07 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:07 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:07 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:07 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:08 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:08 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021788.7618303, ee776e8c-6c86-450c-a020-1778e32e4d9c => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:03:08 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] VM Resumed (Lifecycle Event)
Aug 14 14:03:08 user nova-compute[73484]: DEBUG nova.compute.manager [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 14:03:08 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 14:03:08 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Instance spawned successfully.
Aug 14 14:03:08 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 14:03:08 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:03:08 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:03:08 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:03:08 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:03:08 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:03:08 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:03:08 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:03:08 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:03:08 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:03:08 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021788.7653215, ee776e8c-6c86-450c-a020-1778e32e4d9c => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:03:08 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] VM Started (Lifecycle Event)
Aug 14 14:03:08 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:03:08 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:03:08 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:03:08 user nova-compute[73484]: INFO nova.compute.manager [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Took 7.21 seconds to spawn the instance on the hypervisor.
Aug 14 14:03:08 user nova-compute[73484]: DEBUG nova.compute.manager [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:03:08 user nova-compute[73484]: INFO nova.compute.manager [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Took 8.05 seconds to build instance.
Aug 14 14:03:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-912b81b4-b92c-425a-a160-070728320a12 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.148s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:03:09 user nova-compute[73484]: DEBUG nova.compute.manager [req-ecaa94d4-2b8b-4c7a-8356-c1cc925dde74 req-bbc5f1d3-3c2e-4bf2-80ca-e3bf8285f115 service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Received event network-vif-plugged-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:03:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ecaa94d4-2b8b-4c7a-8356-c1cc925dde74 req-bbc5f1d3-3c2e-4bf2-80ca-e3bf8285f115 service nova] Acquiring lock "ee776e8c-6c86-450c-a020-1778e32e4d9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:03:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ecaa94d4-2b8b-4c7a-8356-c1cc925dde74 req-bbc5f1d3-3c2e-4bf2-80ca-e3bf8285f115 service nova] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:03:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ecaa94d4-2b8b-4c7a-8356-c1cc925dde74 req-bbc5f1d3-3c2e-4bf2-80ca-e3bf8285f115 service nova] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:03:09 user nova-compute[73484]: DEBUG nova.compute.manager [req-ecaa94d4-2b8b-4c7a-8356-c1cc925dde74 req-bbc5f1d3-3c2e-4bf2-80ca-e3bf8285f115 service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] No waiting events found dispatching network-vif-plugged-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:03:09 user nova-compute[73484]: WARNING nova.compute.manager [req-ecaa94d4-2b8b-4c7a-8356-c1cc925dde74 req-bbc5f1d3-3c2e-4bf2-80ca-e3bf8285f115 service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Received unexpected event network-vif-plugged-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e for instance with vm_state active and task_state None.
Aug 14 14:03:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "8bce4703-8877-40ea-8615-323c70a5b47d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:03:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "8bce4703-8877-40ea-8615-323c70a5b47d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:03:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 14:03:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:03:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:03:15 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 14:03:15 user nova-compute[73484]: INFO nova.compute.claims [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Claim successful on node user
Aug 14 14:03:15 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:03:15 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:03:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.241s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:03:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 14:03:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 14:03:15 user nova-compute[73484]: DEBUG nova.network.neutron [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 14:03:15 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 14:03:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 14:03:15 user nova-compute[73484]: DEBUG nova.policy [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a8689f4ffa4140f1a94a61206ae011a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0208e39a3304b7383d1c01e070a4c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 14:03:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 14:03:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 14:03:15 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Creating image(s)
Aug 14 14:03:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "/opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:03:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "/opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:03:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "/opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:03:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:03:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.193s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:03:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:03:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:03:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:03:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.174s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:03:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:03:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk 1073741824" returned: 0 in 0.049s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:03:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:03:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:03:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.207s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:03:16 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 14:03:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:03:16 user nova-compute[73484]: DEBUG nova.network.neutron [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Successfully created port: 8829dabb-317a-48a1-b26f-145fd4a441bc {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 14:03:16 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:03:16 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Cannot resize image /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 14:03:16 user nova-compute[73484]: DEBUG nova.objects.instance [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lazy-loading 'migration_context' on Instance uuid 8bce4703-8877-40ea-8615-323c70a5b47d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:03:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 14:03:16 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Ensure instance console log exists: /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 14:03:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:03:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:03:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:03:16 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:03:16 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Cleaning up deleted instances {{(pid=73484) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 14:03:16 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] There are 0 instances to clean {{(pid=73484) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.network.neutron [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Successfully updated port: 8829dabb-317a-48a1-b26f-145fd4a441bc {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "refresh_cache-8bce4703-8877-40ea-8615-323c70a5b47d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquired lock "refresh_cache-8bce4703-8877-40ea-8615-323c70a5b47d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.network.neutron [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.network.neutron [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.compute.manager [req-8f85ebe6-f22c-44dc-9577-8581b8acb801 req-4eec96b8-02d4-4119-bd73-aebfcc7f7d80 service nova] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Received event network-changed-8829dabb-317a-48a1-b26f-145fd4a441bc {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.compute.manager [req-8f85ebe6-f22c-44dc-9577-8581b8acb801 req-4eec96b8-02d4-4119-bd73-aebfcc7f7d80 service nova] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Refreshing instance network info cache due to event network-changed-8829dabb-317a-48a1-b26f-145fd4a441bc. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8f85ebe6-f22c-44dc-9577-8581b8acb801 req-4eec96b8-02d4-4119-bd73-aebfcc7f7d80 service nova] Acquiring lock "refresh_cache-8bce4703-8877-40ea-8615-323c70a5b47d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.network.neutron [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Updating instance_info_cache with network_info: [{"id": "8829dabb-317a-48a1-b26f-145fd4a441bc", "address": "fa:16:3e:6b:5d:48", "network": {"id": "e5777564-99ba-44b7-b752-efaf236d840c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-601395130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0208e39a3304b7383d1c01e070a4c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8829dabb-31", "ovs_interfaceid": "8829dabb-317a-48a1-b26f-145fd4a441bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Releasing lock "refresh_cache-8bce4703-8877-40ea-8615-323c70a5b47d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.compute.manager [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Instance network_info: |[{"id": "8829dabb-317a-48a1-b26f-145fd4a441bc", "address": "fa:16:3e:6b:5d:48", "network": {"id": "e5777564-99ba-44b7-b752-efaf236d840c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-601395130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0208e39a3304b7383d1c01e070a4c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8829dabb-31", "ovs_interfaceid": "8829dabb-317a-48a1-b26f-145fd4a441bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8f85ebe6-f22c-44dc-9577-8581b8acb801 req-4eec96b8-02d4-4119-bd73-aebfcc7f7d80 service nova] Acquired lock "refresh_cache-8bce4703-8877-40ea-8615-323c70a5b47d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.network.neutron [req-8f85ebe6-f22c-44dc-9577-8581b8acb801 req-4eec96b8-02d4-4119-bd73-aebfcc7f7d80 service nova] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Refreshing network info cache for port 8829dabb-317a-48a1-b26f-145fd4a441bc {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Start _get_guest_xml network_info=[{"id": "8829dabb-317a-48a1-b26f-145fd4a441bc", "address": "fa:16:3e:6b:5d:48", "network": {"id": "e5777564-99ba-44b7-b752-efaf236d840c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-601395130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0208e39a3304b7383d1c01e070a4c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8829dabb-31", "ovs_interfaceid": "8829dabb-317a-48a1-b26f-145fd4a441bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 14:03:17 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:03:17 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:03:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2119523497',display_name='tempest-SnapshotDataIntegrityTests-server-2119523497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2119523497',id=45,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZ4QdAOOweDDTW/BK5hy3/iPFTeQSYkg1GsGm6eMu4D/y/FSJySa798ATMfDog5OnNNFHlfPBWYpsnFbl4MScVRUmtKz3eh3O5TVJWy6BncrjRxjgBe7YTwy68SUeMUtQ==',key_name='tempest-keypair-1658362240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0208e39a3304b7383d1c01e070a4c01',ramdisk_id='',reservation_id='r-e7whamu7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-917109927',owner_user_name='tempest-SnapshotDataIntegrityTests-917109927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:03:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a8689f4ffa4140f1a94a61206ae011a3',uuid=8bce4703-8877-40ea-8615-323c70a5b47d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8829dabb-317a-48a1-b26f-145fd4a441bc", "address": "fa:16:3e:6b:5d:48", "network": {"id": "e5777564-99ba-44b7-b752-efaf236d840c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-601395130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0208e39a3304b7383d1c01e070a4c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8829dabb-31", "ovs_interfaceid": "8829dabb-317a-48a1-b26f-145fd4a441bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Converting VIF {"id": "8829dabb-317a-48a1-b26f-145fd4a441bc", "address": "fa:16:3e:6b:5d:48", "network": {"id": "e5777564-99ba-44b7-b752-efaf236d840c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-601395130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0208e39a3304b7383d1c01e070a4c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8829dabb-31", "ovs_interfaceid": "8829dabb-317a-48a1-b26f-145fd4a441bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:5d:48,bridge_name='br-int',has_traffic_filtering=True,id=8829dabb-317a-48a1-b26f-145fd4a441bc,network=Network(e5777564-99ba-44b7-b752-efaf236d840c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8829dabb-31') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.objects.instance [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lazy-loading 'pci_devices' on Instance uuid 8bce4703-8877-40ea-8615-323c70a5b47d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] End _get_guest_xml xml=<domain type="kvm">
Aug 14 14:03:17 user nova-compute[73484]:   <uuid>8bce4703-8877-40ea-8615-323c70a5b47d</uuid>
Aug 14 14:03:17 user nova-compute[73484]:   <name>instance-0000002d</name>
Aug 14 14:03:17 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 14:03:17 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 14:03:17 user nova-compute[73484]:   <metadata>
Aug 14 14:03:17 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 14:03:17 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 14:03:17 user nova-compute[73484]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-2119523497</nova:name>
Aug 14 14:03:17 user nova-compute[73484]:       <nova:creationTime>2023-08-14 14:03:17</nova:creationTime>
Aug 14 14:03:17 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 14:03:17 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 14:03:17 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 14:03:17 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 14:03:17 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 14:03:17 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 14:03:17 user nova-compute[73484]:       </nova:flavor>
Aug 14 14:03:17 user nova-compute[73484]:       <nova:owner>
Aug 14 14:03:17 user nova-compute[73484]:         <nova:user uuid="a8689f4ffa4140f1a94a61206ae011a3">tempest-SnapshotDataIntegrityTests-917109927-project-member</nova:user>
Aug 14 14:03:17 user nova-compute[73484]:         <nova:project uuid="b0208e39a3304b7383d1c01e070a4c01">tempest-SnapshotDataIntegrityTests-917109927</nova:project>
Aug 14 14:03:17 user nova-compute[73484]:       </nova:owner>
Aug 14 14:03:17 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 14:03:17 user nova-compute[73484]:       <nova:ports>
Aug 14 14:03:17 user nova-compute[73484]:         <nova:port uuid="8829dabb-317a-48a1-b26f-145fd4a441bc">
Aug 14 14:03:17 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 14:03:17 user nova-compute[73484]:         </nova:port>
Aug 14 14:03:17 user nova-compute[73484]:       </nova:ports>
Aug 14 14:03:17 user nova-compute[73484]:     </nova:instance>
Aug 14 14:03:17 user nova-compute[73484]:   </metadata>
Aug 14 14:03:17 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 14:03:17 user nova-compute[73484]:     <system>
Aug 14 14:03:17 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 14:03:17 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 14:03:17 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 14:03:17 user nova-compute[73484]:       <entry name="serial">8bce4703-8877-40ea-8615-323c70a5b47d</entry>
Aug 14 14:03:17 user nova-compute[73484]:       <entry name="uuid">8bce4703-8877-40ea-8615-323c70a5b47d</entry>
Aug 14 14:03:17 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 14:03:17 user nova-compute[73484]:     </system>
Aug 14 14:03:17 user nova-compute[73484]:   </sysinfo>
Aug 14 14:03:17 user nova-compute[73484]:   <os>
Aug 14 14:03:17 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 14:03:17 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 14:03:17 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 14:03:17 user nova-compute[73484]:   </os>
Aug 14 14:03:17 user nova-compute[73484]:   <features>
Aug 14 14:03:17 user nova-compute[73484]:     <acpi/>
Aug 14 14:03:17 user nova-compute[73484]:     <apic/>
Aug 14 14:03:17 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 14:03:17 user nova-compute[73484]:   </features>
Aug 14 14:03:17 user nova-compute[73484]:   <clock offset="utc">
Aug 14 14:03:17 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 14:03:17 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 14:03:17 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 14:03:17 user nova-compute[73484]:   </clock>
Aug 14 14:03:17 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 14:03:17 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 14:03:17 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 14:03:17 user nova-compute[73484]:   </cpu>
Aug 14 14:03:17 user nova-compute[73484]:   <devices>
Aug 14 14:03:17 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 14:03:17 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 14:03:17 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk"/>
Aug 14 14:03:17 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 14:03:17 user nova-compute[73484]:     </disk>
Aug 14 14:03:17 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 14:03:17 user nova-compute[73484]:       <mac address="fa:16:3e:6b:5d:48"/>
Aug 14 14:03:17 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 14:03:17 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 14:03:17 user nova-compute[73484]:       <target dev="tap8829dabb-31"/>
Aug 14 14:03:17 user nova-compute[73484]:     </interface>
Aug 14 14:03:17 user nova-compute[73484]:     <serial type="pty">
Aug 14 14:03:17 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/console.log" append="off"/>
Aug 14 14:03:17 user nova-compute[73484]:     </serial>
Aug 14 14:03:17 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 14:03:17 user nova-compute[73484]:     <video>
Aug 14 14:03:17 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 14:03:17 user nova-compute[73484]:     </video>
Aug 14 14:03:17 user nova-compute[73484]:     <rng model="virtio">
Aug 14 14:03:17 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 14:03:17 user nova-compute[73484]:     </rng>
Aug 14 14:03:17 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 14:03:17 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 14:03:17 user nova-compute[73484]:       <stats period="10"/>
Aug 14 14:03:17 user nova-compute[73484]:     </memballoon>
Aug 14 14:03:17 user nova-compute[73484]:   </devices>
Aug 14 14:03:17 user nova-compute[73484]: </domain>
Aug 14 14:03:17 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:03:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2119523497',display_name='tempest-SnapshotDataIntegrityTests-server-2119523497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2119523497',id=45,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZ4QdAOOweDDTW/BK5hy3/iPFTeQSYkg1GsGm6eMu4D/y/FSJySa798ATMfDog5OnNNFHlfPBWYpsnFbl4MScVRUmtKz3eh3O5TVJWy6BncrjRxjgBe7YTwy68SUeMUtQ==',key_name='tempest-keypair-1658362240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0208e39a3304b7383d1c01e070a4c01',ramdisk_id='',reservation_id='r-e7whamu7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-917109927',owner_user_name='tempest-SnapshotDataIntegrityTests-917109927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:03:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a8689f4ffa4140f1a94a61206ae011a3',uuid=8bce4703-8877-40ea-8615-323c70a5b47d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8829dabb-317a-48a1-b26f-145fd4a441bc", "address": "fa:16:3e:6b:5d:48", "network": {"id": "e5777564-99ba-44b7-b752-efaf236d840c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-601395130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0208e39a3304b7383d1c01e070a4c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8829dabb-31", "ovs_interfaceid": "8829dabb-317a-48a1-b26f-145fd4a441bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Converting VIF {"id": "8829dabb-317a-48a1-b26f-145fd4a441bc", "address": "fa:16:3e:6b:5d:48", "network": {"id": "e5777564-99ba-44b7-b752-efaf236d840c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-601395130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0208e39a3304b7383d1c01e070a4c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8829dabb-31", "ovs_interfaceid": "8829dabb-317a-48a1-b26f-145fd4a441bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:5d:48,bridge_name='br-int',has_traffic_filtering=True,id=8829dabb-317a-48a1-b26f-145fd4a441bc,network=Network(e5777564-99ba-44b7-b752-efaf236d840c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8829dabb-31') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG os_vif [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:5d:48,bridge_name='br-int',has_traffic_filtering=True,id=8829dabb-317a-48a1-b26f-145fd4a441bc,network=Network(e5777564-99ba-44b7-b752-efaf236d840c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8829dabb-31') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8829dabb-31, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8829dabb-31, col_values=(('external_ids', {'iface-id': '8829dabb-317a-48a1-b26f-145fd4a441bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:5d:48', 'vm-uuid': '8bce4703-8877-40ea-8615-323c70a5b47d'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:17 user nova-compute[73484]: INFO os_vif [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:5d:48,bridge_name='br-int',has_traffic_filtering=True,id=8829dabb-317a-48a1-b26f-145fd4a441bc,network=Network(e5777564-99ba-44b7-b752-efaf236d840c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8829dabb-31')
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] No VIF found with MAC fa:16:3e:6b:5d:48, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.network.neutron [req-8f85ebe6-f22c-44dc-9577-8581b8acb801 req-4eec96b8-02d4-4119-bd73-aebfcc7f7d80 service nova] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Updated VIF entry in instance network info cache for port 8829dabb-317a-48a1-b26f-145fd4a441bc. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG nova.network.neutron [req-8f85ebe6-f22c-44dc-9577-8581b8acb801 req-4eec96b8-02d4-4119-bd73-aebfcc7f7d80 service nova] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Updating instance_info_cache with network_info: [{"id": "8829dabb-317a-48a1-b26f-145fd4a441bc", "address": "fa:16:3e:6b:5d:48", "network": {"id": "e5777564-99ba-44b7-b752-efaf236d840c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-601395130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0208e39a3304b7383d1c01e070a4c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8829dabb-31", "ovs_interfaceid": "8829dabb-317a-48a1-b26f-145fd4a441bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:03:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8f85ebe6-f22c-44dc-9577-8581b8acb801 req-4eec96b8-02d4-4119-bd73-aebfcc7f7d80 service nova] Releasing lock "refresh_cache-8bce4703-8877-40ea-8615-323c70a5b47d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:03:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:19 user nova-compute[73484]: DEBUG nova.compute.manager [req-355ceee4-a254-4155-84a5-e0eaa8b02622 req-df5a2cce-404b-4721-a958-6a7a026bf5b2 service nova] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Received event network-vif-plugged-8829dabb-317a-48a1-b26f-145fd4a441bc {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:03:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-355ceee4-a254-4155-84a5-e0eaa8b02622 req-df5a2cce-404b-4721-a958-6a7a026bf5b2 service nova] Acquiring lock "8bce4703-8877-40ea-8615-323c70a5b47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:03:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-355ceee4-a254-4155-84a5-e0eaa8b02622 req-df5a2cce-404b-4721-a958-6a7a026bf5b2 service nova] Lock "8bce4703-8877-40ea-8615-323c70a5b47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:03:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-355ceee4-a254-4155-84a5-e0eaa8b02622 req-df5a2cce-404b-4721-a958-6a7a026bf5b2 service nova] Lock "8bce4703-8877-40ea-8615-323c70a5b47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:03:19 user nova-compute[73484]: DEBUG nova.compute.manager [req-355ceee4-a254-4155-84a5-e0eaa8b02622 req-df5a2cce-404b-4721-a958-6a7a026bf5b2 service nova] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] No waiting events found dispatching network-vif-plugged-8829dabb-317a-48a1-b26f-145fd4a441bc {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:03:19 user nova-compute[73484]: WARNING nova.compute.manager [req-355ceee4-a254-4155-84a5-e0eaa8b02622 req-df5a2cce-404b-4721-a958-6a7a026bf5b2 service nova] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Received unexpected event network-vif-plugged-8829dabb-317a-48a1-b26f-145fd4a441bc for instance with vm_state building and task_state spawning.
Aug 14 14:03:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:21 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021801.0024986, 8bce4703-8877-40ea-8615-323c70a5b47d => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:03:21 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] VM Resumed (Lifecycle Event)
Aug 14 14:03:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 14:03:21 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 14:03:21 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Instance spawned successfully.
Aug 14 14:03:21 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 14:03:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:03:21 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:03:21 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:03:21 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:03:21 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:03:21 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:03:21 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:03:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:03:21 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:03:21 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021801.003938, 8bce4703-8877-40ea-8615-323c70a5b47d => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:03:21 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] VM Started (Lifecycle Event)
Aug 14 14:03:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:03:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:03:21 user nova-compute[73484]: INFO nova.compute.manager [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Took 5.56 seconds to spawn the instance on the hypervisor.
Aug 14 14:03:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:03:21 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:03:21 user nova-compute[73484]: DEBUG nova.compute.manager [req-57108f98-c286-4dac-9d94-1b773426ea67 req-228c51d8-b7b3-4e77-9091-51b7fee4dfce service nova] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Received event network-vif-plugged-8829dabb-317a-48a1-b26f-145fd4a441bc {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:03:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-57108f98-c286-4dac-9d94-1b773426ea67 req-228c51d8-b7b3-4e77-9091-51b7fee4dfce service nova] Acquiring lock "8bce4703-8877-40ea-8615-323c70a5b47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:03:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-57108f98-c286-4dac-9d94-1b773426ea67 req-228c51d8-b7b3-4e77-9091-51b7fee4dfce service nova] Lock "8bce4703-8877-40ea-8615-323c70a5b47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:03:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-57108f98-c286-4dac-9d94-1b773426ea67 req-228c51d8-b7b3-4e77-9091-51b7fee4dfce service nova] Lock "8bce4703-8877-40ea-8615-323c70a5b47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:03:21 user nova-compute[73484]: DEBUG nova.compute.manager [req-57108f98-c286-4dac-9d94-1b773426ea67 req-228c51d8-b7b3-4e77-9091-51b7fee4dfce service nova] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] No waiting events found dispatching network-vif-plugged-8829dabb-317a-48a1-b26f-145fd4a441bc {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:03:21 user nova-compute[73484]: WARNING nova.compute.manager [req-57108f98-c286-4dac-9d94-1b773426ea67 req-228c51d8-b7b3-4e77-9091-51b7fee4dfce service nova] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Received unexpected event network-vif-plugged-8829dabb-317a-48a1-b26f-145fd4a441bc for instance with vm_state building and task_state spawning.
Aug 14 14:03:21 user nova-compute[73484]: INFO nova.compute.manager [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Took 6.12 seconds to build instance.
Aug 14 14:03:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7a9b7aaa-fc5d-489b-b860-58b00d512047 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "8bce4703-8877-40ea-8615-323c70a5b47d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.223s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:03:22 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:22 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:28 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:03:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:39 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:03:39 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Triggering sync for uuid 328e872d-da9b-4ebc-9069-937c2d3fc74c {{(pid=73484) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 14:03:39 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Triggering sync for uuid ee776e8c-6c86-450c-a020-1778e32e4d9c {{(pid=73484) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 14:03:39 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Triggering sync for uuid 8bce4703-8877-40ea-8615-323c70a5b47d {{(pid=73484) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 14:03:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "328e872d-da9b-4ebc-9069-937c2d3fc74c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:03:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "328e872d-da9b-4ebc-9069-937c2d3fc74c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:03:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "ee776e8c-6c86-450c-a020-1778e32e4d9c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:03:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:03:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "8bce4703-8877-40ea-8615-323c70a5b47d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:03:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "8bce4703-8877-40ea-8615-323c70a5b47d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:03:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "328e872d-da9b-4ebc-9069-937c2d3fc74c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:03:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:03:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "8bce4703-8877-40ea-8615-323c70a5b47d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:03:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:42 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:49 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:03:49 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 14:03:49 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Rebuilding the list of instances to heal {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 14:03:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-328e872d-da9b-4ebc-9069-937c2d3fc74c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:03:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-328e872d-da9b-4ebc-9069-937c2d3fc74c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:03:49 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 14:03:49 user nova-compute[73484]: DEBUG nova.objects.instance [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lazy-loading 'info_cache' on Instance uuid 328e872d-da9b-4ebc-9069-937c2d3fc74c {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:03:50 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Updating instance_info_cache with network_info: [{"id": "c0373e7b-3687-462c-a775-ea6bdab07469", "address": "fa:16:3e:e5:bb:36", "network": {"id": "3458700f-a875-4968-8ae8-464e9ce8ab81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1812819141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4707f4d9cd47c2b988af4fdaf685ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0373e7b-36", "ovs_interfaceid": "c0373e7b-3687-462c-a775-ea6bdab07469", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:03:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-328e872d-da9b-4ebc-9069-937c2d3fc74c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:03:50 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 14:03:50 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:03:52 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:03:57 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:03:57 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:03:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 14:03:58 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:04:00 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:04:00 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:04:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:04:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:04:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:04:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 14:04:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:04:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:04:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:04:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:04:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:04:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:04:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:04:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:04:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/328e872d-da9b-4ebc-9069-937c2d3fc74c/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:04:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/328e872d-da9b-4ebc-9069-937c2d3fc74c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:04:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/328e872d-da9b-4ebc-9069-937c2d3fc74c/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:04:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/328e872d-da9b-4ebc-9069-937c2d3fc74c/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:04:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:04:04 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:04:04 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:04:04 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=8329MB free_disk=24.406639099121094GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 14:04:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:04:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:04:04 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 328e872d-da9b-4ebc-9069-937c2d3fc74c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:04:04 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance ee776e8c-6c86-450c-a020-1778e32e4d9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:04:04 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 8bce4703-8877-40ea-8615-323c70a5b47d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:04:04 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 14:04:04 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 14:04:04 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:04:04 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:04:04 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 14:04:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.304s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:04:07 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:04:07 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:04:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:04:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:04:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:04:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:04:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:04:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:04:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:04:16 user nova-compute[73484]: DEBUG nova.compute.manager [req-1879a8fa-9a96-450f-9568-c300ac7f2efc req-418e685e-f59a-443a-8bb4-93e7b4a8c173 service nova] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Received event network-changed-c0373e7b-3687-462c-a775-ea6bdab07469 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:04:16 user nova-compute[73484]: DEBUG nova.compute.manager [req-1879a8fa-9a96-450f-9568-c300ac7f2efc req-418e685e-f59a-443a-8bb4-93e7b4a8c173 service nova] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Refreshing instance network info cache due to event network-changed-c0373e7b-3687-462c-a775-ea6bdab07469. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:04:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1879a8fa-9a96-450f-9568-c300ac7f2efc req-418e685e-f59a-443a-8bb4-93e7b4a8c173 service nova] Acquiring lock "refresh_cache-328e872d-da9b-4ebc-9069-937c2d3fc74c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:04:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1879a8fa-9a96-450f-9568-c300ac7f2efc req-418e685e-f59a-443a-8bb4-93e7b4a8c173 service nova] Acquired lock "refresh_cache-328e872d-da9b-4ebc-9069-937c2d3fc74c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:04:16 user nova-compute[73484]: DEBUG nova.network.neutron [req-1879a8fa-9a96-450f-9568-c300ac7f2efc req-418e685e-f59a-443a-8bb4-93e7b4a8c173 service nova] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Refreshing network info cache for port c0373e7b-3687-462c-a775-ea6bdab07469 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:04:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "328e872d-da9b-4ebc-9069-937c2d3fc74c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:04:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "328e872d-da9b-4ebc-9069-937c2d3fc74c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:04:16 user nova-compute[73484]: DEBUG nova.objects.instance [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lazy-loading 'flavor' on Instance uuid 328e872d-da9b-4ebc-9069-937c2d3fc74c {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:04:16 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Ignoring supplied device name: /dev/vdb
Aug 14 14:04:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "328e872d-da9b-4ebc-9069-937c2d3fc74c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:04:17 user nova-compute[73484]: DEBUG nova.network.neutron [req-1879a8fa-9a96-450f-9568-c300ac7f2efc req-418e685e-f59a-443a-8bb4-93e7b4a8c173 service nova] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Updated VIF entry in instance network info cache for port c0373e7b-3687-462c-a775-ea6bdab07469. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:04:17 user nova-compute[73484]: DEBUG nova.network.neutron [req-1879a8fa-9a96-450f-9568-c300ac7f2efc req-418e685e-f59a-443a-8bb4-93e7b4a8c173 service nova] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Updating instance_info_cache with network_info: [{"id": "c0373e7b-3687-462c-a775-ea6bdab07469", "address": "fa:16:3e:e5:bb:36", "network": {"id": "3458700f-a875-4968-8ae8-464e9ce8ab81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1812819141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4707f4d9cd47c2b988af4fdaf685ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0373e7b-36", "ovs_interfaceid": "c0373e7b-3687-462c-a775-ea6bdab07469", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:04:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-1879a8fa-9a96-450f-9568-c300ac7f2efc req-418e685e-f59a-443a-8bb4-93e7b4a8c173 service nova] Releasing lock "refresh_cache-328e872d-da9b-4ebc-9069-937c2d3fc74c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:04:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "328e872d-da9b-4ebc-9069-937c2d3fc74c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:04:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "328e872d-da9b-4ebc-9069-937c2d3fc74c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:04:17 user nova-compute[73484]: INFO nova.compute.manager [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Attaching volume 69f2e5c5-0cff-4658-93aa-d38fc7b28b4c to /dev/vdb
Aug 14 14:04:17 user nova-compute[73484]: DEBUG os_brick.utils [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:04:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:04:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:04:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b8c88d-91d3-458b-862f-4b72a7cb6db2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:04:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:04:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:04:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20aa352-a30e-4bd2-b97b-33dc11ce3405]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:04:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:04:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.053s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:04:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[def66821-e284-45a4-ad37-ecaf2d6467a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:04:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ba9321-50f5-479e-ab25-288076ef8950]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:04:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:04:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:04:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 14:04:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:04:17 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:04:17 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 14:04:17 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fc793e-6609-43e1-90b3-fc8c5978db46]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:04:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 14:04:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 14:04:17 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 14:04:17 user nova-compute[73484]: DEBUG os_brick.utils [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:04:17 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Updating existing volume attachment record: 746b171e-4d10-472c-8d54-2f22faddbcd7 {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 14:04:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:04:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:04:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:04:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:04:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:04:25 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 14:04:25 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqJuXtTQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:04:25 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:04:25 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:04:25 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:04:25 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:04:25 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:04:25 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:04:25 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 14:04:25 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec5ccf4-6224-44a9-a88c-c89e64748c97]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 14:04:26 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea4b2c4-90cf-4382-8a3b-27c027db37d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c] added
Aug 14 14:04:26 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[712bff23-7229-4e23-9f42-bd97c18cd742]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43934c6-5c8b-4e55-b17c-b6a41a90b385]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bqJuXtTQ {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bqJuXtTQ" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e71e88-34a2-4c1f-a5c7-0bda8962e552]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bqJuXtTQ'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3ac57f-cae6-4376-a239-2572ec24dc71]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[26562c6d-b690-4249-9f37-f88e5ef93b70]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 14:04:26 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 14:04:26 user nova-compute[73484]:  {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:04:26 user nova-compute[73484]: WARNING os_brick.initiator.connectors.iscsi [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 14:04:26 user nova-compute[73484]: 
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eaf168e-27cc-4b42-9cad-e7d187b1b030]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c, portal: 172.16.0.220,3260]
Aug 14 14:04:26 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c, portal: 172.16.0.220,3260] successful.
Aug 14 14:04:26 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.107s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d2e6ac-e605-430f-a02e-f3db956922a4]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e03bd0-07b8-4424-a7ae-c65b23403eea]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c (non-flash)
Aug 14 14:04:26 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c (non-flash)
Aug 14 14:04:26 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e88a862-d17f-407a-84a8-a5caff66cdb1]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 14:04:26 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqJuXtTQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 14:04:27 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:04:27 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23537653666346134', 'path': '/dev/sdb'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:04:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537653666346134', 'path': '/dev/sdb'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 14:04:27 user nova-compute[73484]: DEBUG nova.objects.instance [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lazy-loading 'flavor' on Instance uuid 328e872d-da9b-4ebc-9069-937c2d3fc74c {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:04:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 14:04:27 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:04:27 user nova-compute[73484]:   <source dev="/dev/sdb"/>
Aug 14 14:04:27 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 14:04:27 user nova-compute[73484]:   <serial>69f2e5c5-0cff-4658-93aa-d38fc7b28b4c</serial>
Aug 14 14:04:27 user nova-compute[73484]: </disk>
Aug 14 14:04:27 user nova-compute[73484]:  {{(pid=73484) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 14:04:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:04:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:04:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] No VIF found with MAC fa:16:3e:e5:bb:36, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:04:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-02b94b57-655c-4569-ad04-dd3234c307ae tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "328e872d-da9b-4ebc-9069-937c2d3fc74c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.317s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:04:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:04:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:04:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:04:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:04:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:04:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:04:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:04:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:04:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:04:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:04:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:04:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:04:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:04:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:04:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:04:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:04:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:04:50 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:04:50 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 14:04:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-ee776e8c-6c86-450c-a020-1778e32e4d9c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:04:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-ee776e8c-6c86-450c-a020-1778e32e4d9c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:04:50 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 14:04:51 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Updating instance_info_cache with network_info: [{"id": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "address": "fa:16:3e:e0:52:91", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab1c5ec-bc", "ovs_interfaceid": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:04:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-ee776e8c-6c86-450c-a020-1778e32e4d9c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:04:51 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 14:04:51 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:04:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:04:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "ee776e8c-6c86-450c-a020-1778e32e4d9c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:04:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:04:55 user nova-compute[73484]: DEBUG nova.objects.instance [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lazy-loading 'flavor' on Instance uuid ee776e8c-6c86-450c-a020-1778e32e4d9c {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:04:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:04:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "ee776e8c-6c86-450c-a020-1778e32e4d9c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:04:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:04:55 user nova-compute[73484]: INFO nova.compute.manager [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Attaching volume 90f6e412-ffa9-4b7d-8a08-276e00dad159 to /dev/vdb
Aug 14 14:04:55 user nova-compute[73484]: DEBUG os_brick.utils [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:04:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:04:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:04:55 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0473693c-68e1-4938-aa82-a7dd15a61575]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:04:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:04:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:04:55 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd689eb-7b1b-4a24-b7b8-3bdd3ddf6495]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:04:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:04:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:04:55 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[833f33fe-a6aa-4975-8172-1458d84c5650]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:04:55 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[051e7a75-8007-4e79-bd6c-034a11a266ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:04:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:04:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:04:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 14:04:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:04:55 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:04:55 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 14:04:55 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa761a24-3be5-47db-8c7d-cd6a6fd2dc07]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:04:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 14:04:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 14:04:55 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 14:04:55 user nova-compute[73484]: DEBUG os_brick.utils [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:04:55 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Updating existing volume attachment record: 7285424a-52eb-443b-aaf1-e2b85293d996 {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 14:04:57 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:04:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 14:04:58 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:04:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:04:59 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:05:00 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:05:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:05:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:05:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:05:00 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 14:05:00 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/328e872d-da9b-4ebc-9069-937c2d3fc74c/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/328e872d-da9b-4ebc-9069-937c2d3fc74c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:01 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/328e872d-da9b-4ebc-9069-937c2d3fc74c/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/328e872d-da9b-4ebc-9069-937c2d3fc74c/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:02 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 14:05:02 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:05:02 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:05:02 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=8453MB free_disk=25.204025268554688GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 14:05:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:05:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:05:02 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 328e872d-da9b-4ebc-9069-937c2d3fc74c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:05:02 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance ee776e8c-6c86-450c-a020-1778e32e4d9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:05:02 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 8bce4703-8877-40ea-8615-323c70a5b47d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:05:02 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 14:05:02 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 14:05:02 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:05:02 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:05:02 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 14:05:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:05:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:05:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:05:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:05:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:05:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:04 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:05:05 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:05:06 user nova-compute[73484]: DEBUG nova.compute.manager [req-a9c1b733-e7ab-4cf0-90d8-d1e29ad254cd req-f5e41697-caa5-426a-86c9-4117cd925b45 service nova] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Received event network-changed-8829dabb-317a-48a1-b26f-145fd4a441bc {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:05:06 user nova-compute[73484]: DEBUG nova.compute.manager [req-a9c1b733-e7ab-4cf0-90d8-d1e29ad254cd req-f5e41697-caa5-426a-86c9-4117cd925b45 service nova] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Refreshing instance network info cache due to event network-changed-8829dabb-317a-48a1-b26f-145fd4a441bc. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:05:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a9c1b733-e7ab-4cf0-90d8-d1e29ad254cd req-f5e41697-caa5-426a-86c9-4117cd925b45 service nova] Acquiring lock "refresh_cache-8bce4703-8877-40ea-8615-323c70a5b47d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:05:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a9c1b733-e7ab-4cf0-90d8-d1e29ad254cd req-f5e41697-caa5-426a-86c9-4117cd925b45 service nova] Acquired lock "refresh_cache-8bce4703-8877-40ea-8615-323c70a5b47d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:05:06 user nova-compute[73484]: DEBUG nova.network.neutron [req-a9c1b733-e7ab-4cf0-90d8-d1e29ad254cd req-f5e41697-caa5-426a-86c9-4117cd925b45 service nova] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Refreshing network info cache for port 8829dabb-317a-48a1-b26f-145fd4a441bc {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:05:06 user nova-compute[73484]: DEBUG nova.network.neutron [req-a9c1b733-e7ab-4cf0-90d8-d1e29ad254cd req-f5e41697-caa5-426a-86c9-4117cd925b45 service nova] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Updated VIF entry in instance network info cache for port 8829dabb-317a-48a1-b26f-145fd4a441bc. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:05:06 user nova-compute[73484]: DEBUG nova.network.neutron [req-a9c1b733-e7ab-4cf0-90d8-d1e29ad254cd req-f5e41697-caa5-426a-86c9-4117cd925b45 service nova] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Updating instance_info_cache with network_info: [{"id": "8829dabb-317a-48a1-b26f-145fd4a441bc", "address": "fa:16:3e:6b:5d:48", "network": {"id": "e5777564-99ba-44b7-b752-efaf236d840c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-601395130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0208e39a3304b7383d1c01e070a4c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8829dabb-31", "ovs_interfaceid": "8829dabb-317a-48a1-b26f-145fd4a441bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:05:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a9c1b733-e7ab-4cf0-90d8-d1e29ad254cd req-f5e41697-caa5-426a-86c9-4117cd925b45 service nova] Releasing lock "refresh_cache-8bce4703-8877-40ea-8615-323c70a5b47d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:05:08 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:05:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:05:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:05:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:05:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:05:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:05:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yDoHGncV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:05:11 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:05:11 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:05:11 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:05:11 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:05:11 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1693995-f12f-4346-a3eb-5fe3b771a7f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 14:05:11 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[202eb039-5b19-4ae2-83f6-411fd4da57b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159] added
Aug 14 14:05:11 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[68de1d7b-6631-4525-87dd-a689f686f5c4]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad4eb20-0e5b-46f4-8f8b-de7fa7001628]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yDoHGncV {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yDoHGncV" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[533e81f1-d4fd-4d1a-a401-10dffa7e60b6]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yDoHGncV'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cf0450-33af-4734-a7f7-c044d8cb12ba]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e895a5e1-66eb-4aa8-9b5a-1fe4f9adde86]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c (non-flash)
Aug 14 14:05:11 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c (non-flash)
Aug 14 14:05:11 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8be04f-b9a1-44da-9947-8e997377cb32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159, portal: 172.16.0.220,3260]
Aug 14 14:05:11 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159, portal: 172.16.0.220,3260] successful.
Aug 14 14:05:11 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d93515-e9b2-4d2f-84b3-107495d55ba7]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[09dd2137-e73f-41b5-a998-82fc9af25bef]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c (non-flash)
Aug 14 14:05:11 user nova-compute[73484]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)
Aug 14 14:05:11 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c (non-flash)
Aug 14 14:05:11 user nova-compute[73484]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)
Aug 14 14:05:11 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d68538-626f-48e9-a151-feafc18abd93]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yDoHGncV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "8bce4703-8877-40ea-8615-323c70a5b47d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "8bce4703-8877-40ea-8615-323c70a5b47d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG nova.objects.instance [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lazy-loading 'flavor' on Instance uuid 8bce4703-8877-40ea-8615-323c70a5b47d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:05:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "8bce4703-8877-40ea-8615-323c70a5b47d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:05:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "8bce4703-8877-40ea-8615-323c70a5b47d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:05:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "8bce4703-8877-40ea-8615-323c70a5b47d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:05:12 user nova-compute[73484]: INFO nova.compute.manager [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Attaching volume 6d5bad2c-3f44-45ae-9dc8-061d864c8991 to /dev/vdb
Aug 14 14:05:12 user nova-compute[73484]: DEBUG os_brick.utils [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:05:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:12 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6cdd6c-6d64-49cc-83ab-3cefc637d619]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:12 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[933a0af8-7a97-4db5-a3e7-b363e2d85413]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:12 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b226039d-bf5a-4474-8607-7fd79cec205d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:12 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae26c0db-1307-4000-af62-3df8a7c784a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:05:12 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 14:05:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:12 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:05:12 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 14:05:12 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[775f81d9-ccb6-4c0c-8c14-70f801bbf642]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:12 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 14:05:12 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 14:05:12 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 14:05:12 user nova-compute[73484]: DEBUG os_brick.utils [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:05:12 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Updating existing volume attachment record: 97b2f30a-1989-401a-a884-14263071124a {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 14:05:12 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:05:12 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26633336462653839', 'path': '/dev/sdc'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:05:12 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633336462653839', 'path': '/dev/sdc'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 14:05:12 user nova-compute[73484]: DEBUG nova.objects.instance [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lazy-loading 'flavor' on Instance uuid ee776e8c-6c86-450c-a020-1778e32e4d9c {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:05:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "328e872d-da9b-4ebc-9069-937c2d3fc74c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:05:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "328e872d-da9b-4ebc-9069-937c2d3fc74c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:05:12 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 14:05:12 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:05:12 user nova-compute[73484]:   <source dev="/dev/sdc"/>
Aug 14 14:05:12 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 14:05:12 user nova-compute[73484]:   <serial>90f6e412-ffa9-4b7d-8a08-276e00dad159</serial>
Aug 14 14:05:12 user nova-compute[73484]: </disk>
Aug 14 14:05:12 user nova-compute[73484]:  {{(pid=73484) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 14:05:12 user nova-compute[73484]: INFO nova.compute.manager [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Detaching volume 69f2e5c5-0cff-4658-93aa-d38fc7b28b4c
Aug 14 14:05:13 user nova-compute[73484]: INFO nova.virt.block_device [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Attempting to driver detach volume 69f2e5c5-0cff-4658-93aa-d38fc7b28b4c from mountpoint /dev/vdb
Aug 14 14:05:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Attempting to detach device vdb from instance 328e872d-da9b-4ebc-9069-937c2d3fc74c from the persistent domain config. {{(pid=73484) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 14:05:13 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:05:13 user nova-compute[73484]:   <source dev="/dev/sdb"/>
Aug 14 14:05:13 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 14:05:13 user nova-compute[73484]:   <serial>69f2e5c5-0cff-4658-93aa-d38fc7b28b4c</serial>
Aug 14 14:05:13 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 14:05:13 user nova-compute[73484]: </disk>
Aug 14 14:05:13 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 14:05:13 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Successfully detached device vdb from instance 328e872d-da9b-4ebc-9069-937c2d3fc74c from the persistent domain config.
Aug 14 14:05:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 328e872d-da9b-4ebc-9069-937c2d3fc74c from the live domain config. {{(pid=73484) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 14:05:13 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:05:13 user nova-compute[73484]:   <source dev="/dev/sdb"/>
Aug 14 14:05:13 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 14:05:13 user nova-compute[73484]:   <serial>69f2e5c5-0cff-4658-93aa-d38fc7b28b4c</serial>
Aug 14 14:05:13 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 14:05:13 user nova-compute[73484]: </disk>
Aug 14 14:05:13 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "328e872d-da9b-4ebc-9069-937c2d3fc74c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] No VIF found with MAC fa:16:3e:e0:52:91, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-1a80f2a8-9885-4002-8845-bcf76cd4f724 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.014s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Received event <DeviceRemovedEvent: 1692021913.6833074, 328e872d-da9b-4ebc-9069-937c2d3fc74c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73484) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 328e872d-da9b-4ebc-9069-937c2d3fc74c {{(pid=73484) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 14:05:13 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Successfully detached device vdb from instance 328e872d-da9b-4ebc-9069-937c2d3fc74c from the live domain config.
Aug 14 14:05:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqJuXtTQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:05:13 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:05:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c7fa9c-216d-4512-b8ed-ccee6739ce4b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e5364d-bea2-410d-9df4-926d57dee706]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c (non-flash)
Aug 14 14:05:13 user nova-compute[73484]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)
Aug 14 14:05:13 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c (non-flash)
Aug 14 14:05:13 user nova-compute[73484]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)
Aug 14 14:05:13 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc491fba3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c'): ({'sdb'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Removing single pathed devices sdb {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92a98c5-087b-4932-a2c3-75a436a66ecc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b88f160-502e-4c48-ba07-a06ce90e8606]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Flushing IO for device /dev/sdb {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3237bc4d-8478-4a89-b38b-2ba001f663d8]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccca3cb-625f-4baf-868c-2e999d58d475]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] SCSI volumes sdb have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8b8939-c673-40f3-9308-4dfd1a745e49]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bea852-8b90-4b42-987c-19f3980e3fcf]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c, portal: 172.16.0.220,3260]
Aug 14 14:05:13 user nova-compute[73484]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c, portal: 172.16.0.220,3260] successful.
Aug 14 14:05:13 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:05:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:14 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0b09d2-d0eb-4fb5-a155-da39a9f02c53]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:05:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:05:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] <== disconnect_volume: return (315ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:05:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 14:05:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:14 user nova-compute[73484]: DEBUG nova.objects.instance [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lazy-loading 'flavor' on Instance uuid 328e872d-da9b-4ebc-9069-937c2d3fc74c {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:05:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7b205af9-ba84-4c57-9569-c6fa0e3e18f9 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "328e872d-da9b-4ebc-9069-937c2d3fc74c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.842s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:05:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "328e872d-da9b-4ebc-9069-937c2d3fc74c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.641s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:05:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "328e872d-da9b-4ebc-9069-937c2d3fc74c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:05:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "328e872d-da9b-4ebc-9069-937c2d3fc74c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:05:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "328e872d-da9b-4ebc-9069-937c2d3fc74c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:05:14 user nova-compute[73484]: INFO nova.compute.manager [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Terminating instance
Aug 14 14:05:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 14:05:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG nova.compute.manager [req-9b73508d-e482-4de2-bc11-80837c7713ea req-d26d6c18-f31a-4e6d-831d-bba4d52bfda4 service nova] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Received event network-vif-unplugged-c0373e7b-3687-462c-a775-ea6bdab07469 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-9b73508d-e482-4de2-bc11-80837c7713ea req-d26d6c18-f31a-4e6d-831d-bba4d52bfda4 service nova] Acquiring lock "328e872d-da9b-4ebc-9069-937c2d3fc74c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-9b73508d-e482-4de2-bc11-80837c7713ea req-d26d6c18-f31a-4e6d-831d-bba4d52bfda4 service nova] Lock "328e872d-da9b-4ebc-9069-937c2d3fc74c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-9b73508d-e482-4de2-bc11-80837c7713ea req-d26d6c18-f31a-4e6d-831d-bba4d52bfda4 service nova] Lock "328e872d-da9b-4ebc-9069-937c2d3fc74c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG nova.compute.manager [req-9b73508d-e482-4de2-bc11-80837c7713ea req-d26d6c18-f31a-4e6d-831d-bba4d52bfda4 service nova] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] No waiting events found dispatching network-vif-unplugged-c0373e7b-3687-462c-a775-ea6bdab07469 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG nova.compute.manager [req-9b73508d-e482-4de2-bc11-80837c7713ea req-d26d6c18-f31a-4e6d-831d-bba4d52bfda4 service nova] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Received event network-vif-unplugged-c0373e7b-3687-462c-a775-ea6bdab07469 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:15 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Instance destroyed successfully.
Aug 14 14:05:15 user nova-compute[73484]: DEBUG nova.objects.instance [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lazy-loading 'resources' on Instance uuid 328e872d-da9b-4ebc-9069-937c2d3fc74c {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-427263749',display_name='tempest-VolumesSnapshotTestJSON-instance-427263749',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-427263749',id=43,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbPa9UUfKEDzopR8jgfuCfi1J5PXmBtWJtQWtUSi/ynaWeVV6rKlCoZ4KCFOpK1IFo0WLWaEuK/mVTz3p5IVnAXQ2JR8UusD2esKSN2ISZ2tPQLS+6owHp6MGmwo1V6Ew==',key_name='tempest-keypair-446779548',keypairs=<?>,launch_index=0,launched_at=2023-08-14T14:02:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f4707f4d9cd47c2b988af4fdaf685ef',ramdisk_id='',reservation_id='r-v4wjulup',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1264452311',owner_user_name='tempest-VolumesSnapshotTestJSON-1264452311-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T14:02:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce08ff2ccf9940259c0beb5ba8aba5d3',uuid=328e872d-da9b-4ebc-9069-937c2d3fc74c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0373e7b-3687-462c-a775-ea6bdab07469", "address": "fa:16:3e:e5:bb:36", "network": {"id": "3458700f-a875-4968-8ae8-464e9ce8ab81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1812819141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4707f4d9cd47c2b988af4fdaf685ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0373e7b-36", "ovs_interfaceid": "c0373e7b-3687-462c-a775-ea6bdab07469", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Converting VIF {"id": "c0373e7b-3687-462c-a775-ea6bdab07469", "address": "fa:16:3e:e5:bb:36", "network": {"id": "3458700f-a875-4968-8ae8-464e9ce8ab81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1812819141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4707f4d9cd47c2b988af4fdaf685ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0373e7b-36", "ovs_interfaceid": "c0373e7b-3687-462c-a775-ea6bdab07469", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:bb:36,bridge_name='br-int',has_traffic_filtering=True,id=c0373e7b-3687-462c-a775-ea6bdab07469,network=Network(3458700f-a875-4968-8ae8-464e9ce8ab81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0373e7b-36') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG os_vif [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:bb:36,bridge_name='br-int',has_traffic_filtering=True,id=c0373e7b-3687-462c-a775-ea6bdab07469,network=Network(3458700f-a875-4968-8ae8-464e9ce8ab81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0373e7b-36') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0373e7b-36, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:05:15 user nova-compute[73484]: INFO os_vif [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:bb:36,bridge_name='br-int',has_traffic_filtering=True,id=c0373e7b-3687-462c-a775-ea6bdab07469,network=Network(3458700f-a875-4968-8ae8-464e9ce8ab81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0373e7b-36')
Aug 14 14:05:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqJuXtTQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:05:15 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:05:15 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69f2e5c5-0cff-4658-93aa-d38fc7b28b4c', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7ce0c2-56d0-42c4-af17-00a38a1f23cc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd5a4b4-9b44-4a7c-bb2b-1f4cede35f80]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)
Aug 14 14:05:15 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)
Aug 14 14:05:15 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4785eacb0>, {}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Disconnecting from: [] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.055s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] <== disconnect_volume: return (57ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 14:05:15 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Deleting instance files /opt/stack/data/nova/instances/328e872d-da9b-4ebc-9069-937c2d3fc74c_del
Aug 14 14:05:15 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Deletion of /opt/stack/data/nova/instances/328e872d-da9b-4ebc-9069-937c2d3fc74c_del complete
Aug 14 14:05:15 user nova-compute[73484]: INFO nova.compute.manager [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 14 14:05:15 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 14:05:15 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 14:05:16 user nova-compute[73484]: DEBUG nova.compute.manager [req-b08dc918-7573-477c-bf09-65ba6ee8dfcc req-2495c479-8c0e-4e6e-83bb-32e2fe9b7a12 service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Received event network-changed-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:05:16 user nova-compute[73484]: DEBUG nova.compute.manager [req-b08dc918-7573-477c-bf09-65ba6ee8dfcc req-2495c479-8c0e-4e6e-83bb-32e2fe9b7a12 service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Refreshing instance network info cache due to event network-changed-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:05:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b08dc918-7573-477c-bf09-65ba6ee8dfcc req-2495c479-8c0e-4e6e-83bb-32e2fe9b7a12 service nova] Acquiring lock "refresh_cache-ee776e8c-6c86-450c-a020-1778e32e4d9c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:05:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b08dc918-7573-477c-bf09-65ba6ee8dfcc req-2495c479-8c0e-4e6e-83bb-32e2fe9b7a12 service nova] Acquired lock "refresh_cache-ee776e8c-6c86-450c-a020-1778e32e4d9c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:05:16 user nova-compute[73484]: DEBUG nova.network.neutron [req-b08dc918-7573-477c-bf09-65ba6ee8dfcc req-2495c479-8c0e-4e6e-83bb-32e2fe9b7a12 service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Refreshing network info cache for port 2ab1c5ec-bc00-45c2-9cc0-9a24367e044e {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:05:17 user nova-compute[73484]: DEBUG nova.compute.manager [req-4fb6f3db-112a-4156-9755-d46cc3fa19ea req-6fd6b34c-fa57-4d90-b42f-0673e1d2174e service nova] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Received event network-vif-plugged-c0373e7b-3687-462c-a775-ea6bdab07469 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:05:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4fb6f3db-112a-4156-9755-d46cc3fa19ea req-6fd6b34c-fa57-4d90-b42f-0673e1d2174e service nova] Acquiring lock "328e872d-da9b-4ebc-9069-937c2d3fc74c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:05:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4fb6f3db-112a-4156-9755-d46cc3fa19ea req-6fd6b34c-fa57-4d90-b42f-0673e1d2174e service nova] Lock "328e872d-da9b-4ebc-9069-937c2d3fc74c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:05:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-4fb6f3db-112a-4156-9755-d46cc3fa19ea req-6fd6b34c-fa57-4d90-b42f-0673e1d2174e service nova] Lock "328e872d-da9b-4ebc-9069-937c2d3fc74c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:05:17 user nova-compute[73484]: DEBUG nova.compute.manager [req-4fb6f3db-112a-4156-9755-d46cc3fa19ea req-6fd6b34c-fa57-4d90-b42f-0673e1d2174e service nova] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] No waiting events found dispatching network-vif-plugged-c0373e7b-3687-462c-a775-ea6bdab07469 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:05:17 user nova-compute[73484]: WARNING nova.compute.manager [req-4fb6f3db-112a-4156-9755-d46cc3fa19ea req-6fd6b34c-fa57-4d90-b42f-0673e1d2174e service nova] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Received unexpected event network-vif-plugged-c0373e7b-3687-462c-a775-ea6bdab07469 for instance with vm_state active and task_state deleting.
Aug 14 14:05:17 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:05:17 user nova-compute[73484]: DEBUG nova.network.neutron [req-b08dc918-7573-477c-bf09-65ba6ee8dfcc req-2495c479-8c0e-4e6e-83bb-32e2fe9b7a12 service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Updated VIF entry in instance network info cache for port 2ab1c5ec-bc00-45c2-9cc0-9a24367e044e. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:05:17 user nova-compute[73484]: DEBUG nova.network.neutron [req-b08dc918-7573-477c-bf09-65ba6ee8dfcc req-2495c479-8c0e-4e6e-83bb-32e2fe9b7a12 service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Updating instance_info_cache with network_info: [{"id": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "address": "fa:16:3e:e0:52:91", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab1c5ec-bc", "ovs_interfaceid": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:05:17 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Took 1.84 seconds to deallocate network for instance.
Aug 14 14:05:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b08dc918-7573-477c-bf09-65ba6ee8dfcc req-2495c479-8c0e-4e6e-83bb-32e2fe9b7a12 service nova] Releasing lock "refresh_cache-ee776e8c-6c86-450c-a020-1778e32e4d9c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:05:17 user nova-compute[73484]: WARNING nova.volume.cinder [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Attachment 746b171e-4d10-472c-8d54-2f22faddbcd7 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 746b171e-4d10-472c-8d54-2f22faddbcd7. (HTTP 404) (Request-ID: req-0a4d4d3e-2ea5-42ad-8158-381295304783)
Aug 14 14:05:17 user nova-compute[73484]: INFO nova.compute.manager [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Took 0.03 seconds to detach 1 volumes for instance.
Aug 14 14:05:17 user nova-compute[73484]: DEBUG nova.compute.manager [req-04702fd7-6239-4bf0-880c-f60f653042eb req-74a6509f-458e-4098-b3a0-6d1b9b5d6ee7 service nova] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Received event network-vif-deleted-c0373e7b-3687-462c-a775-ea6bdab07469 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:05:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:05:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:05:17 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:05:17 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:05:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.225s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:05:17 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Deleted allocations for instance 328e872d-da9b-4ebc-9069-937c2d3fc74c
Aug 14 14:05:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-a956f1f1-667a-4d38-a2be-3f3148064698 tempest-VolumesSnapshotTestJSON-1264452311 tempest-VolumesSnapshotTestJSON-1264452311-project-member] Lock "328e872d-da9b-4ebc-9069-937c2d3fc74c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.250s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:05:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e911d5b-24c5-4a34-aeec-182a5bd7ce0f tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "ee776e8c-6c86-450c-a020-1778e32e4d9c" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:05:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e911d5b-24c5-4a34-aeec-182a5bd7ce0f tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:05:19 user nova-compute[73484]: INFO nova.compute.manager [None req-6e911d5b-24c5-4a34-aeec-182a5bd7ce0f tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Rebooting instance
Aug 14 14:05:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e911d5b-24c5-4a34-aeec-182a5bd7ce0f tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "refresh_cache-ee776e8c-6c86-450c-a020-1778e32e4d9c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:05:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e911d5b-24c5-4a34-aeec-182a5bd7ce0f tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquired lock "refresh_cache-ee776e8c-6c86-450c-a020-1778e32e4d9c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:05:19 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e911d5b-24c5-4a34-aeec-182a5bd7ce0f tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 14:05:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:20 user nova-compute[73484]: DEBUG nova.compute.manager [req-055ed43c-1e78-4454-94c3-85f1dec2b62d req-3cded1c1-64cf-4a54-a1aa-f9324f2391b6 service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Received event network-changed-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:05:20 user nova-compute[73484]: DEBUG nova.compute.manager [req-055ed43c-1e78-4454-94c3-85f1dec2b62d req-3cded1c1-64cf-4a54-a1aa-f9324f2391b6 service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Refreshing instance network info cache due to event network-changed-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:05:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-055ed43c-1e78-4454-94c3-85f1dec2b62d req-3cded1c1-64cf-4a54-a1aa-f9324f2391b6 service nova] Acquiring lock "refresh_cache-ee776e8c-6c86-450c-a020-1778e32e4d9c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:05:20 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e911d5b-24c5-4a34-aeec-182a5bd7ce0f tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Updating instance_info_cache with network_info: [{"id": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "address": "fa:16:3e:e0:52:91", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab1c5ec-bc", "ovs_interfaceid": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:05:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e911d5b-24c5-4a34-aeec-182a5bd7ce0f tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Releasing lock "refresh_cache-ee776e8c-6c86-450c-a020-1778e32e4d9c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:05:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-055ed43c-1e78-4454-94c3-85f1dec2b62d req-3cded1c1-64cf-4a54-a1aa-f9324f2391b6 service nova] Acquired lock "refresh_cache-ee776e8c-6c86-450c-a020-1778e32e4d9c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:05:20 user nova-compute[73484]: DEBUG nova.network.neutron [req-055ed43c-1e78-4454-94c3-85f1dec2b62d req-3cded1c1-64cf-4a54-a1aa-f9324f2391b6 service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Refreshing network info cache for port 2ab1c5ec-bc00-45c2-9cc0-9a24367e044e {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:05:20 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e911d5b-24c5-4a34-aeec-182a5bd7ce0f tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:05:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:20 user nova-compute[73484]: DEBUG nova.network.neutron [req-055ed43c-1e78-4454-94c3-85f1dec2b62d req-3cded1c1-64cf-4a54-a1aa-f9324f2391b6 service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Updated VIF entry in instance network info cache for port 2ab1c5ec-bc00-45c2-9cc0-9a24367e044e. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:05:20 user nova-compute[73484]: DEBUG nova.network.neutron [req-055ed43c-1e78-4454-94c3-85f1dec2b62d req-3cded1c1-64cf-4a54-a1aa-f9324f2391b6 service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Updating instance_info_cache with network_info: [{"id": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "address": "fa:16:3e:e0:52:91", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab1c5ec-bc", "ovs_interfaceid": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:05:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-055ed43c-1e78-4454-94c3-85f1dec2b62d req-3cded1c1-64cf-4a54-a1aa-f9324f2391b6 service nova] Releasing lock "refresh_cache-ee776e8c-6c86-450c-a020-1778e32e4d9c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aFiPyfXg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:05:21 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:05:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:05:21 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:05:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:05:21 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d346fc4-3ceb-4b00-b24b-3e14adb30350]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 14:05:21 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991 -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd1f2d2-fbb0-4631-9554-478f94348cbd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991] added
Aug 14 14:05:21 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[de14208f-aad0-42b4-956d-6b98b52bd036]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14ce232-b3f5-4103-8afd-7a0ac63b328e]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aFiPyfXg {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aFiPyfXg" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad986b89-e2fc-43e4-b5ba-166c06f07c04]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aFiPyfXg'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a134b9-6ec3-4d93-8245-8a1edf2a7016]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54e91eb-bd89-49e5-a646-3f2f633ee4b9]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)
Aug 14 14:05:21 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)
Aug 14 14:05:21 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991 -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0d4527-f401-48e1-8faa-a78c8f548710]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991, portal: 172.16.0.220,3260]
Aug 14 14:05:21 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991, portal: 172.16.0.220,3260] successful.
Aug 14 14:05:21 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11e1de6-ffa3-4244-967e-32429debc1ff]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f07451-e4c0-4f6d-847d-a6e6a91587e0]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)
Aug 14 14:05:21 user nova-compute[73484]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991 (non-flash)
Aug 14 14:05:21 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)
Aug 14 14:05:21 user nova-compute[73484]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991 (non-flash)
Aug 14 14:05:21 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61216d5-a6c2-4328-80e6-085c87875d36]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:21 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 14:05:22 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 14:05:22 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aFiPyfXg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 14:05:22 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:05:22 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23764313830343466', 'path': '/dev/sdb'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:05:22 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764313830343466', 'path': '/dev/sdb'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 14:05:22 user nova-compute[73484]: DEBUG nova.objects.instance [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lazy-loading 'flavor' on Instance uuid 8bce4703-8877-40ea-8615-323c70a5b47d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:05:22 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 14:05:22 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:05:22 user nova-compute[73484]:   <source dev="/dev/sdb"/>
Aug 14 14:05:22 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 14:05:22 user nova-compute[73484]:   <serial>6d5bad2c-3f44-45ae-9dc8-061d864c8991</serial>
Aug 14 14:05:22 user nova-compute[73484]: </disk>
Aug 14 14:05:22 user nova-compute[73484]:  {{(pid=73484) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 14:05:22 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:22 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:22 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:22 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:22 user nova-compute[73484]: DEBUG nova.compute.manager [req-a8f58d16-b915-4c69-b39b-3b9ab469cc96 req-05b496b4-ef5c-43af-94ab-d6b5b7731991 service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Received event network-vif-unplugged-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:05:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a8f58d16-b915-4c69-b39b-3b9ab469cc96 req-05b496b4-ef5c-43af-94ab-d6b5b7731991 service nova] Acquiring lock "ee776e8c-6c86-450c-a020-1778e32e4d9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:05:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a8f58d16-b915-4c69-b39b-3b9ab469cc96 req-05b496b4-ef5c-43af-94ab-d6b5b7731991 service nova] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:05:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-a8f58d16-b915-4c69-b39b-3b9ab469cc96 req-05b496b4-ef5c-43af-94ab-d6b5b7731991 service nova] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:05:22 user nova-compute[73484]: DEBUG nova.compute.manager [req-a8f58d16-b915-4c69-b39b-3b9ab469cc96 req-05b496b4-ef5c-43af-94ab-d6b5b7731991 service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] No waiting events found dispatching network-vif-unplugged-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:05:22 user nova-compute[73484]: WARNING nova.compute.manager [req-a8f58d16-b915-4c69-b39b-3b9ab469cc96 req-05b496b4-ef5c-43af-94ab-d6b5b7731991 service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Received unexpected event network-vif-unplugged-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e for instance with vm_state active and task_state reboot_started.
Aug 14 14:05:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:05:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:05:23 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] No VIF found with MAC fa:16:3e:6b:5d:48, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:05:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-cfded837-861e-4d2c-b4fa-1db26ab98b56 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "8bce4703-8877-40ea-8615-323c70a5b47d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:05:23 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-6e911d5b-24c5-4a34-aeec-182a5bd7ce0f tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Instance shutdown successfully.
Aug 14 14:05:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:25 user nova-compute[73484]: DEBUG nova.compute.manager [req-18c24d64-f366-4644-9d86-a60171411e42 req-d88aa27e-12ae-4c32-9423-01c1ba1d0c93 service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Received event network-vif-plugged-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:05:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-18c24d64-f366-4644-9d86-a60171411e42 req-d88aa27e-12ae-4c32-9423-01c1ba1d0c93 service nova] Acquiring lock "ee776e8c-6c86-450c-a020-1778e32e4d9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:05:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-18c24d64-f366-4644-9d86-a60171411e42 req-d88aa27e-12ae-4c32-9423-01c1ba1d0c93 service nova] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:05:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-18c24d64-f366-4644-9d86-a60171411e42 req-d88aa27e-12ae-4c32-9423-01c1ba1d0c93 service nova] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:05:25 user nova-compute[73484]: DEBUG nova.compute.manager [req-18c24d64-f366-4644-9d86-a60171411e42 req-d88aa27e-12ae-4c32-9423-01c1ba1d0c93 service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] No waiting events found dispatching network-vif-plugged-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:05:25 user nova-compute[73484]: WARNING nova.compute.manager [req-18c24d64-f366-4644-9d86-a60171411e42 req-d88aa27e-12ae-4c32-9423-01c1ba1d0c93 service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Received unexpected event network-vif-plugged-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e for instance with vm_state active and task_state reboot_started.
Aug 14 14:05:25 user nova-compute[73484]: DEBUG nova.compute.manager [req-18c24d64-f366-4644-9d86-a60171411e42 req-d88aa27e-12ae-4c32-9423-01c1ba1d0c93 service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Received event network-vif-plugged-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:05:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-18c24d64-f366-4644-9d86-a60171411e42 req-d88aa27e-12ae-4c32-9423-01c1ba1d0c93 service nova] Acquiring lock "ee776e8c-6c86-450c-a020-1778e32e4d9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:05:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-18c24d64-f366-4644-9d86-a60171411e42 req-d88aa27e-12ae-4c32-9423-01c1ba1d0c93 service nova] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:05:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-18c24d64-f366-4644-9d86-a60171411e42 req-d88aa27e-12ae-4c32-9423-01c1ba1d0c93 service nova] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:05:25 user nova-compute[73484]: DEBUG nova.compute.manager [req-18c24d64-f366-4644-9d86-a60171411e42 req-d88aa27e-12ae-4c32-9423-01c1ba1d0c93 service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] No waiting events found dispatching network-vif-plugged-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:05:25 user nova-compute[73484]: WARNING nova.compute.manager [req-18c24d64-f366-4644-9d86-a60171411e42 req-d88aa27e-12ae-4c32-9423-01c1ba1d0c93 service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Received unexpected event network-vif-plugged-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e for instance with vm_state active and task_state reboot_started.
Aug 14 14:05:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:27 user nova-compute[73484]: DEBUG nova.compute.manager [req-24b8449a-55a0-4760-9238-885ee8efabf5 req-719b48ce-93c9-4a81-9f25-b90bc9f5d52b service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Received event network-vif-plugged-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:05:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-24b8449a-55a0-4760-9238-885ee8efabf5 req-719b48ce-93c9-4a81-9f25-b90bc9f5d52b service nova] Acquiring lock "ee776e8c-6c86-450c-a020-1778e32e4d9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:05:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-24b8449a-55a0-4760-9238-885ee8efabf5 req-719b48ce-93c9-4a81-9f25-b90bc9f5d52b service nova] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:05:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-24b8449a-55a0-4760-9238-885ee8efabf5 req-719b48ce-93c9-4a81-9f25-b90bc9f5d52b service nova] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:05:27 user nova-compute[73484]: DEBUG nova.compute.manager [req-24b8449a-55a0-4760-9238-885ee8efabf5 req-719b48ce-93c9-4a81-9f25-b90bc9f5d52b service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] No waiting events found dispatching network-vif-plugged-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:05:27 user nova-compute[73484]: WARNING nova.compute.manager [req-24b8449a-55a0-4760-9238-885ee8efabf5 req-719b48ce-93c9-4a81-9f25-b90bc9f5d52b service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Received unexpected event network-vif-plugged-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e for instance with vm_state active and task_state reboot_started.
Aug 14 14:05:27 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Removed pending event for ee776e8c-6c86-450c-a020-1778e32e4d9c due to event {{(pid=73484) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 14:05:27 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021927.1954432, ee776e8c-6c86-450c-a020-1778e32e4d9c => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:05:27 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] VM Resumed (Lifecycle Event)
Aug 14 14:05:27 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Instance running successfully.
Aug 14 14:05:27 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-6e911d5b-24c5-4a34-aeec-182a5bd7ce0f tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Instance soft rebooted successfully.
Aug 14 14:05:27 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e911d5b-24c5-4a34-aeec-182a5bd7ce0f tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:05:27 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:05:27 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:05:27 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 14 14:05:27 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692021927.1971555, ee776e8c-6c86-450c-a020-1778e32e4d9c => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:05:27 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] VM Started (Lifecycle Event)
Aug 14 14:05:27 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:05:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e911d5b-24c5-4a34-aeec-182a5bd7ce0f tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.191s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:05:27 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:05:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:30 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692021915.5406847, 328e872d-da9b-4ebc-9069-937c2d3fc74c => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:05:30 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] VM Stopped (Lifecycle Event)
Aug 14 14:05:30 user nova-compute[73484]: DEBUG nova.compute.manager [None req-5d0fd6ea-c378-457e-a3a2-5c3a6c6be581 None None] [instance: 328e872d-da9b-4ebc-9069-937c2d3fc74c] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:05:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "8bce4703-8877-40ea-8615-323c70a5b47d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:05:49 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "8bce4703-8877-40ea-8615-323c70a5b47d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:05:49 user nova-compute[73484]: INFO nova.compute.manager [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Detaching volume 6d5bad2c-3f44-45ae-9dc8-061d864c8991
Aug 14 14:05:49 user nova-compute[73484]: INFO nova.virt.block_device [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Attempting to driver detach volume 6d5bad2c-3f44-45ae-9dc8-061d864c8991 from mountpoint /dev/vdb
Aug 14 14:05:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Attempting to detach device vdb from instance 8bce4703-8877-40ea-8615-323c70a5b47d from the persistent domain config. {{(pid=73484) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 14:05:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 14:05:49 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:05:49 user nova-compute[73484]:   <source dev="/dev/sdb"/>
Aug 14 14:05:49 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 14:05:49 user nova-compute[73484]:   <serial>6d5bad2c-3f44-45ae-9dc8-061d864c8991</serial>
Aug 14 14:05:49 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 14:05:49 user nova-compute[73484]: </disk>
Aug 14 14:05:49 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 14:05:49 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Successfully detached device vdb from instance 8bce4703-8877-40ea-8615-323c70a5b47d from the persistent domain config.
Aug 14 14:05:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8bce4703-8877-40ea-8615-323c70a5b47d from the live domain config. {{(pid=73484) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 14:05:49 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 14:05:49 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:05:49 user nova-compute[73484]:   <source dev="/dev/sdb"/>
Aug 14 14:05:49 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 14:05:49 user nova-compute[73484]:   <serial>6d5bad2c-3f44-45ae-9dc8-061d864c8991</serial>
Aug 14 14:05:49 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 14:05:49 user nova-compute[73484]: </disk>
Aug 14 14:05:49 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 14:05:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Received event <DeviceRemovedEvent: 1692021950.0994039, 8bce4703-8877-40ea-8615-323c70a5b47d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73484) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8bce4703-8877-40ea-8615-323c70a5b47d {{(pid=73484) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 14:05:50 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Successfully detached device vdb from instance 8bce4703-8877-40ea-8615-323c70a5b47d from the live domain config.
Aug 14 14:05:50 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aFiPyfXg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:05:50 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:05:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f54709-765a-4ead-bd5c-8aeb4564ec67]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a4debe-9bf0-469a-adc9-c829a7da98ac]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)
Aug 14 14:05:50 user nova-compute[73484]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991 (non-flash)
Aug 14 14:05:50 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)
Aug 14 14:05:50 user nova-compute[73484]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991 (non-flash)
Aug 14 14:05:50 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc48806f0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991'): ({'sdb'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Removing single pathed devices sdb {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[18aa4d68-80eb-4e64-a4c4-a3c4bfbecd13]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ca5f28-bef6-44d5-817b-6b43a05bea52]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Flushing IO for device /dev/sdb {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4bf036-d309-42aa-9452-645af26388df]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff11c2e-5b18-4bf1-a13a-6c103026cab0]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] SCSI volumes sdb have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[989b433d-86c1-4ecd-90ff-af99af0b419b]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991 -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2419cc-7ae4-45c3-9bf3-1fc79ad375d2]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991, portal: 172.16.0.220,3260]
Aug 14 14:05:50 user nova-compute[73484]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991, portal: 172.16.0.220,3260] successful.
Aug 14 14:05:50 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991 -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d5bad2c-3f44-45ae-9dc8-061d864c8991 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a99aa49-dad0-44c2-856a-31a7660ff8db]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] <== disconnect_volume: return (292ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 14:05:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:51 user nova-compute[73484]: DEBUG nova.objects.instance [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lazy-loading 'flavor' on Instance uuid 8bce4703-8877-40ea-8615-323c70a5b47d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:05:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e5121663-e39f-4a38-8abd-85517840b5d8 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "8bce4703-8877-40ea-8615-323c70a5b47d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.669s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:05:51 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:05:51 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 14:05:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-8bce4703-8877-40ea-8615-323c70a5b47d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:05:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-8bce4703-8877-40ea-8615-323c70a5b47d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:05:51 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 14:05:52 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Updating instance_info_cache with network_info: [{"id": "8829dabb-317a-48a1-b26f-145fd4a441bc", "address": "fa:16:3e:6b:5d:48", "network": {"id": "e5777564-99ba-44b7-b752-efaf236d840c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-601395130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0208e39a3304b7383d1c01e070a4c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8829dabb-31", "ovs_interfaceid": "8829dabb-317a-48a1-b26f-145fd4a441bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:05:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-8bce4703-8877-40ea-8615-323c70a5b47d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:05:52 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 14:05:52 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:05:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:05:57 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:05:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 14:05:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:00 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:06:01 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:06:02 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:06:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:06:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:06:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:06:02 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 14:06:02 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:03 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 14:06:04 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:06:04 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:06:04 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=8503MB free_disk=25.226917266845703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 14:06:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:06:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:06:04 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance ee776e8c-6c86-450c-a020-1778e32e4d9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:06:04 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 8bce4703-8877-40ea-8615-323c70a5b47d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:06:04 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 14:06:04 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 14:06:04 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:06:04 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:06:04 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 14:06:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.295s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:06:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:05 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:06:06 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:06:09 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:06:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "f3fdfa01-354e-4b59-9c1c-e82787ddcd02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:06:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "f3fdfa01-354e-4b59-9c1c-e82787ddcd02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:06:40 user nova-compute[73484]: DEBUG nova.compute.manager [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 14:06:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:06:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:06:41 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 14:06:41 user nova-compute[73484]: INFO nova.compute.claims [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Claim successful on node user
Aug 14 14:06:41 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:06:41 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:06:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.231s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:06:41 user nova-compute[73484]: DEBUG nova.compute.manager [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 14:06:41 user nova-compute[73484]: DEBUG nova.compute.manager [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 14:06:41 user nova-compute[73484]: DEBUG nova.network.neutron [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 14:06:41 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 14:06:41 user nova-compute[73484]: DEBUG nova.compute.manager [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 14:06:41 user nova-compute[73484]: INFO nova.virt.block_device [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Booting with volume snapshot 0cb8f3e6-927a-4537-a447-73afbfb2026e at /dev/vda
Aug 14 14:06:41 user nova-compute[73484]: DEBUG nova.policy [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06a79841cf6743a7bd565a6084383f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f985c3a8447e4870782d5e8709609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 14:06:42 user nova-compute[73484]: DEBUG nova.network.neutron [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Successfully created port: 631f3e90-984d-443a-baff-c1f4677b6da9 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 14:06:43 user nova-compute[73484]: DEBUG nova.network.neutron [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Successfully updated port: 631f3e90-984d-443a-baff-c1f4677b6da9 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 14:06:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "refresh_cache-f3fdfa01-354e-4b59-9c1c-e82787ddcd02" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:06:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquired lock "refresh_cache-f3fdfa01-354e-4b59-9c1c-e82787ddcd02" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:06:43 user nova-compute[73484]: DEBUG nova.network.neutron [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 14:06:43 user nova-compute[73484]: DEBUG nova.compute.manager [req-fe849b46-b46e-4dae-835b-6dc74fa9e612 req-0db787f6-6834-475c-a420-511b72e87c06 service nova] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Received event network-changed-631f3e90-984d-443a-baff-c1f4677b6da9 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:06:43 user nova-compute[73484]: DEBUG nova.compute.manager [req-fe849b46-b46e-4dae-835b-6dc74fa9e612 req-0db787f6-6834-475c-a420-511b72e87c06 service nova] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Refreshing instance network info cache due to event network-changed-631f3e90-984d-443a-baff-c1f4677b6da9. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:06:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-fe849b46-b46e-4dae-835b-6dc74fa9e612 req-0db787f6-6834-475c-a420-511b72e87c06 service nova] Acquiring lock "refresh_cache-f3fdfa01-354e-4b59-9c1c-e82787ddcd02" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:06:43 user nova-compute[73484]: DEBUG nova.network.neutron [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 14:06:43 user nova-compute[73484]: DEBUG nova.network.neutron [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Updating instance_info_cache with network_info: [{"id": "631f3e90-984d-443a-baff-c1f4677b6da9", "address": "fa:16:3e:89:d0:2d", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap631f3e90-98", "ovs_interfaceid": "631f3e90-984d-443a-baff-c1f4677b6da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:06:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Releasing lock "refresh_cache-f3fdfa01-354e-4b59-9c1c-e82787ddcd02" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:06:43 user nova-compute[73484]: DEBUG nova.compute.manager [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Instance network_info: |[{"id": "631f3e90-984d-443a-baff-c1f4677b6da9", "address": "fa:16:3e:89:d0:2d", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap631f3e90-98", "ovs_interfaceid": "631f3e90-984d-443a-baff-c1f4677b6da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 14:06:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-fe849b46-b46e-4dae-835b-6dc74fa9e612 req-0db787f6-6834-475c-a420-511b72e87c06 service nova] Acquired lock "refresh_cache-f3fdfa01-354e-4b59-9c1c-e82787ddcd02" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:06:43 user nova-compute[73484]: DEBUG nova.network.neutron [req-fe849b46-b46e-4dae-835b-6dc74fa9e612 req-0db787f6-6834-475c-a420-511b72e87c06 service nova] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Refreshing network info cache for port 631f3e90-984d-443a-baff-c1f4677b6da9 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:06:43 user nova-compute[73484]: DEBUG nova.network.neutron [req-fe849b46-b46e-4dae-835b-6dc74fa9e612 req-0db787f6-6834-475c-a420-511b72e87c06 service nova] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Updated VIF entry in instance network info cache for port 631f3e90-984d-443a-baff-c1f4677b6da9. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:06:43 user nova-compute[73484]: DEBUG nova.network.neutron [req-fe849b46-b46e-4dae-835b-6dc74fa9e612 req-0db787f6-6834-475c-a420-511b72e87c06 service nova] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Updating instance_info_cache with network_info: [{"id": "631f3e90-984d-443a-baff-c1f4677b6da9", "address": "fa:16:3e:89:d0:2d", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap631f3e90-98", "ovs_interfaceid": "631f3e90-984d-443a-baff-c1f4677b6da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:06:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-fe849b46-b46e-4dae-835b-6dc74fa9e612 req-0db787f6-6834-475c-a420-511b72e87c06 service nova] Releasing lock "refresh_cache-f3fdfa01-354e-4b59-9c1c-e82787ddcd02" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:06:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "8bce4703-8877-40ea-8615-323c70a5b47d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:06:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "8bce4703-8877-40ea-8615-323c70a5b47d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:06:44 user nova-compute[73484]: DEBUG nova.objects.instance [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lazy-loading 'flavor' on Instance uuid 8bce4703-8877-40ea-8615-323c70a5b47d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:06:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "8bce4703-8877-40ea-8615-323c70a5b47d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:06:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "8bce4703-8877-40ea-8615-323c70a5b47d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:06:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "8bce4703-8877-40ea-8615-323c70a5b47d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:06:44 user nova-compute[73484]: INFO nova.compute.manager [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Attaching volume 2a807e53-0bdf-4454-9e41-39188cf0ca3a to /dev/vdb
Aug 14 14:06:44 user nova-compute[73484]: DEBUG os_brick.utils [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:06:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:44 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[08dae8f2-1e18-4021-8d59-359c1cd2bc86]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:44 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[de17b424-f6d4-4216-a93c-2ee9ff58b6b5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:44 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a200b5-21db-4de6-bde8-84bdbfd2004c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:44 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cf9076-290e-48f8-8db4-6065409e4edd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:06:44 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 14:06:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:06:44 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 14:06:44 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99720a5-3d24-4ce6-8529-ce3dc1496fab]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:44 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 14:06:44 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 14:06:44 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 14:06:44 user nova-compute[73484]: DEBUG os_brick.utils [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:06:44 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Updating existing volume attachment record: 04e9a9dd-a161-4350-9b8b-fcc92b6e2dd0 {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 14:06:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:47 user nova-compute[73484]: DEBUG os_brick.utils [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:06:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:47 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a0c6f4-c45d-492b-b708-89c7e7d33b7e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:47 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e617379-fbb6-43ad-a739-59dbd2ba39a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:47 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b414061c-5504-487b-8ce2-1f08bc551a84]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:47 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b83aa86-af7a-43f3-b968-263f43e2190e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:06:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 14:06:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:06:47 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 14:06:47 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b253d42-01ca-4910-9200-77ca8d8b4eec]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 14:06:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 14:06:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 14:06:47 user nova-compute[73484]: DEBUG os_brick.utils [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:06:47 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Updating existing volume attachment record: 8a79f613-075b-4a27-9ce8-e0602fb098dc {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 14:06:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dxqVNHRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:06:53 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:06:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:06:53 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:06:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:06:53 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7c6f0b-9fcd-4aea-80f0-519a76cfbae3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 14:06:53 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7b9570-5a11-4035-98af-3600c76653a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a] added
Aug 14 14:06:53 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[317ebc5c-645f-409f-8221-746a9132ffc2]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e7e809-c33a-45df-ade4-ae73b66b501d]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dxqVNHRC {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dxqVNHRC" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8545fb4b-6c9e-47b1-a18a-cf959b7989a5]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dxqVNHRC'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0830c70c-d739-4130-89b2-ff016e9b4534]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7eaa48-8675-488f-8baa-b1328532bb8c]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)
Aug 14 14:06:53 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)
Aug 14 14:06:53 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[40960a9c-10f2-417c-b5f2-1e093e7d1c7d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a, portal: 172.16.0.220,3260]
Aug 14 14:06:53 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a, portal: 172.16.0.220,3260] successful.
Aug 14 14:06:53 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[925aff69-a3c6-4394-b554-bdf5554f41e2]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9efbc9-8817-463b-96e5-7031958eaf4b]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)
Aug 14 14:06:53 user nova-compute[73484]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a (non-flash)
Aug 14 14:06:53 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)
Aug 14 14:06:53 user nova-compute[73484]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a (non-flash)
Aug 14 14:06:53 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fd5451-5540-49c6-ba05-dde505a0c172]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dxqVNHRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Rebuilding the list of instances to heal {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Skipping network cache update for instance because it is Building. {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-ee776e8c-6c86-450c-a020-1778e32e4d9c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-ee776e8c-6c86-450c-a020-1778e32e4d9c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 14:06:53 user nova-compute[73484]: DEBUG nova.objects.instance [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lazy-loading 'info_cache' on Instance uuid ee776e8c-6c86-450c-a020-1778e32e4d9c {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:06:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:06:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26333363366653864', 'path': '/dev/sdb'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:06:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333363366653864', 'path': '/dev/sdb'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 14:06:54 user nova-compute[73484]: DEBUG nova.objects.instance [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lazy-loading 'flavor' on Instance uuid 8bce4703-8877-40ea-8615-323c70a5b47d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:06:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 14:06:54 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:06:54 user nova-compute[73484]:   <source dev="/dev/sdb"/>
Aug 14 14:06:54 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 14:06:54 user nova-compute[73484]:   <serial>2a807e53-0bdf-4454-9e41-39188cf0ca3a</serial>
Aug 14 14:06:54 user nova-compute[73484]: </disk>
Aug 14 14:06:54 user nova-compute[73484]:  {{(pid=73484) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 14:06:54 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Updating instance_info_cache with network_info: [{"id": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "address": "fa:16:3e:e0:52:91", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab1c5ec-bc", "ovs_interfaceid": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:06:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-ee776e8c-6c86-450c-a020-1778e32e4d9c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:06:54 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 14:06:54 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:06:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:06:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:06:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] No VIF found with MAC fa:16:3e:6b:5d:48, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:06:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-e4a9cf5b-6060-42a6-ae43-1cda56b57cd7 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "8bce4703-8877-40ea-8615-323c70a5b47d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.607s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:06:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG nova.compute.manager [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 14:06:56 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Creating image(s)
Aug 14 14:06:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Did not create local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Ensure instance console log exists: /opt/stack/data/nova/instances/f3fdfa01-354e-4b59-9c1c-e82787ddcd02/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Start _get_guest_xml network_info=[{"id": "631f3e90-984d-443a-baff-c1f4677b6da9", "address": "fa:16:3e:89:d0:2d", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap631f3e90-98", "ovs_interfaceid": "631f3e90-984d-443a-baff-c1f4677b6da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8a79f613-075b-4a27-9ce8-e0602fb098dc', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXxfuUpi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f3fdfa01-354e-4b59-9c1c-e82787ddcd02', 'attached_at': '', 'detached_at': '', 'volume_id': '5ca286e8-a70d-4260-b3ce-3eb4a46c16a1', 'serial': '5ca286e8-a70d-4260-b3ce-3eb4a46c16a1'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 14:06:56 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:06:56 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:06:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXxfuUpi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:06:56 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:06:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:06:56 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:06:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:06:56 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe70868-d4ee-45fd-aa76-26d74f86b632]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 14:06:56 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[98dd8c9e-0d7b-494c-92b3-2670122e3c8b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1] added
Aug 14 14:06:56 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8ef9f2-f043-4e76-b4e0-1620a1d28806]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bceaee-26d6-4122-aa74-183bb6caa221]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DXxfuUpi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DXxfuUpi" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c533a5-791a-40d7-8681-1a19cc90f681]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DXxfuUpi'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a39cfa-cc37-4b6a-bec0-76146706acac]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3515471a-2a7e-4dc4-8bf5-81ce51eefbb9]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)
Aug 14 14:06:56 user nova-compute[73484]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a (non-flash)
Aug 14 14:06:56 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)
Aug 14 14:06:56 user nova-compute[73484]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a (non-flash)
Aug 14 14:06:56 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa899bd-f20e-4473-afca-26174e36b1b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1, portal: 172.16.0.220,3260]
Aug 14 14:06:56 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1, portal: 172.16.0.220,3260] successful.
Aug 14 14:06:56 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ef813d-efa2-4b3e-ae58-d97d639bcdc9]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de71216-a664-408a-b474-637fbe680fd5]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)
Aug 14 14:06:56 user nova-compute[73484]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a (non-flash)
Aug 14 14:06:56 user nova-compute[73484]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 (non-flash)
Aug 14 14:06:56 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)
Aug 14 14:06:56 user nova-compute[73484]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a (non-flash)
Aug 14 14:06:56 user nova-compute[73484]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 (non-flash)
Aug 14 14:06:56 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] HCTL ('35', '-', '-', 0) found on session 56 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eaadf01-cbd7-4d01-b76f-83c7c041b50a]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXxfuUpi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "8bce4703-8877-40ea-8615-323c70a5b47d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "8bce4703-8877-40ea-8615-323c70a5b47d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:06:56 user nova-compute[73484]: INFO nova.compute.manager [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Detaching volume 2a807e53-0bdf-4454-9e41-39188cf0ca3a
Aug 14 14:06:56 user nova-compute[73484]: INFO nova.virt.block_device [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Attempting to driver detach volume 2a807e53-0bdf-4454-9e41-39188cf0ca3a from mountpoint /dev/vdb
Aug 14 14:06:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Attempting to detach device vdb from instance 8bce4703-8877-40ea-8615-323c70a5b47d from the persistent domain config. {{(pid=73484) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 14:06:56 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:06:56 user nova-compute[73484]:   <source dev="/dev/sdb"/>
Aug 14 14:06:56 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 14:06:56 user nova-compute[73484]:   <serial>2a807e53-0bdf-4454-9e41-39188cf0ca3a</serial>
Aug 14 14:06:56 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 14:06:56 user nova-compute[73484]: </disk>
Aug 14 14:06:56 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 14:06:56 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Successfully detached device vdb from instance 8bce4703-8877-40ea-8615-323c70a5b47d from the persistent domain config.
Aug 14 14:06:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8bce4703-8877-40ea-8615-323c70a5b47d from the live domain config. {{(pid=73484) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 14:06:56 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 14:06:56 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:06:56 user nova-compute[73484]:   <source dev="/dev/sdb"/>
Aug 14 14:06:56 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 14:06:56 user nova-compute[73484]:   <serial>2a807e53-0bdf-4454-9e41-39188cf0ca3a</serial>
Aug 14 14:06:56 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 14:06:56 user nova-compute[73484]: </disk>
Aug 14 14:06:56 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Received event <DeviceRemovedEvent: 1692022017.1686456, 8bce4703-8877-40ea-8615-323c70a5b47d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73484) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8bce4703-8877-40ea-8615-323c70a5b47d {{(pid=73484) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 14:06:57 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Successfully detached device vdb from instance 8bce4703-8877-40ea-8615-323c70a5b47d from the live domain config.
Aug 14 14:06:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dxqVNHRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:06:57 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:06:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23636643536383239', 'path': '/dev/sdd'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636643536383239', 'path': '/dev/sdd'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.264s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:06:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1165337161',display_name='tempest-TestVolumeBootPattern-server-1165337161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1165337161',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d5f985c3a8447e4870782d5e8709609',ramdisk_id='',reservation_id='r-lju8vn6f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1241691583',owner_user_name='tempest-TestVolumeBootPattern-1241691583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:06:41Z,user_data=None,user_id='06a79841cf6743a7bd565a6084383f6c',uuid=f3fdfa01-354e-4b59-9c1c-e82787ddcd02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "631f3e90-984d-443a-baff-c1f4677b6da9", "address": "fa:16:3e:89:d0:2d", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap631f3e90-98", "ovs_interfaceid": "631f3e90-984d-443a-baff-c1f4677b6da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converting VIF {"id": "631f3e90-984d-443a-baff-c1f4677b6da9", "address": "fa:16:3e:89:d0:2d", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap631f3e90-98", "ovs_interfaceid": "631f3e90-984d-443a-baff-c1f4677b6da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:d0:2d,bridge_name='br-int',has_traffic_filtering=True,id=631f3e90-984d-443a-baff-c1f4677b6da9,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap631f3e90-98') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG nova.objects.instance [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lazy-loading 'pci_devices' on Instance uuid f3fdfa01-354e-4b59-9c1c-e82787ddcd02 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8b11aa-dd07-42a7-ab2a-ef1a205aa2c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] End _get_guest_xml xml=<domain type="kvm">
Aug 14 14:06:57 user nova-compute[73484]:   <uuid>f3fdfa01-354e-4b59-9c1c-e82787ddcd02</uuid>
Aug 14 14:06:57 user nova-compute[73484]:   <name>instance-0000002e</name>
Aug 14 14:06:57 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 14:06:57 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 14:06:57 user nova-compute[73484]:   <metadata>
Aug 14 14:06:57 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 14:06:57 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 14:06:57 user nova-compute[73484]:       <nova:name>tempest-TestVolumeBootPattern-server-1165337161</nova:name>
Aug 14 14:06:57 user nova-compute[73484]:       <nova:creationTime>2023-08-14 14:06:56</nova:creationTime>
Aug 14 14:06:57 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 14:06:57 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 14:06:57 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 14:06:57 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 14:06:57 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 14:06:57 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 14:06:57 user nova-compute[73484]:       </nova:flavor>
Aug 14 14:06:57 user nova-compute[73484]:       <nova:owner>
Aug 14 14:06:57 user nova-compute[73484]:         <nova:user uuid="06a79841cf6743a7bd565a6084383f6c">tempest-TestVolumeBootPattern-1241691583-project-member</nova:user>
Aug 14 14:06:57 user nova-compute[73484]:         <nova:project uuid="1d5f985c3a8447e4870782d5e8709609">tempest-TestVolumeBootPattern-1241691583</nova:project>
Aug 14 14:06:57 user nova-compute[73484]:       </nova:owner>
Aug 14 14:06:57 user nova-compute[73484]:       <nova:ports>
Aug 14 14:06:57 user nova-compute[73484]:         <nova:port uuid="631f3e90-984d-443a-baff-c1f4677b6da9">
Aug 14 14:06:57 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 14:06:57 user nova-compute[73484]:         </nova:port>
Aug 14 14:06:57 user nova-compute[73484]:       </nova:ports>
Aug 14 14:06:57 user nova-compute[73484]:     </nova:instance>
Aug 14 14:06:57 user nova-compute[73484]:   </metadata>
Aug 14 14:06:57 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 14:06:57 user nova-compute[73484]:     <system>
Aug 14 14:06:57 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 14:06:57 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 14:06:57 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 14:06:57 user nova-compute[73484]:       <entry name="serial">f3fdfa01-354e-4b59-9c1c-e82787ddcd02</entry>
Aug 14 14:06:57 user nova-compute[73484]:       <entry name="uuid">f3fdfa01-354e-4b59-9c1c-e82787ddcd02</entry>
Aug 14 14:06:57 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 14:06:57 user nova-compute[73484]:     </system>
Aug 14 14:06:57 user nova-compute[73484]:   </sysinfo>
Aug 14 14:06:57 user nova-compute[73484]:   <os>
Aug 14 14:06:57 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 14:06:57 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 14:06:57 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 14:06:57 user nova-compute[73484]:   </os>
Aug 14 14:06:57 user nova-compute[73484]:   <features>
Aug 14 14:06:57 user nova-compute[73484]:     <acpi/>
Aug 14 14:06:57 user nova-compute[73484]:     <apic/>
Aug 14 14:06:57 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 14:06:57 user nova-compute[73484]:   </features>
Aug 14 14:06:57 user nova-compute[73484]:   <clock offset="utc">
Aug 14 14:06:57 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 14:06:57 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 14:06:57 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 14:06:57 user nova-compute[73484]:   </clock>
Aug 14 14:06:57 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 14:06:57 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 14:06:57 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 14:06:57 user nova-compute[73484]:   </cpu>
Aug 14 14:06:57 user nova-compute[73484]:   <devices>
Aug 14 14:06:57 user nova-compute[73484]:     <disk type="block" device="disk">
Aug 14 14:06:57 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:06:57 user nova-compute[73484]:       <source dev="/dev/sdd"/>
Aug 14 14:06:57 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 14:06:57 user nova-compute[73484]:       <serial>5ca286e8-a70d-4260-b3ce-3eb4a46c16a1</serial>
Aug 14 14:06:57 user nova-compute[73484]:     </disk>
Aug 14 14:06:57 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 14:06:57 user nova-compute[73484]:       <mac address="fa:16:3e:89:d0:2d"/>
Aug 14 14:06:57 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 14:06:57 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 14:06:57 user nova-compute[73484]:       <target dev="tap631f3e90-98"/>
Aug 14 14:06:57 user nova-compute[73484]:     </interface>
Aug 14 14:06:57 user nova-compute[73484]:     <serial type="pty">
Aug 14 14:06:57 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/f3fdfa01-354e-4b59-9c1c-e82787ddcd02/console.log" append="off"/>
Aug 14 14:06:57 user nova-compute[73484]:     </serial>
Aug 14 14:06:57 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 14:06:57 user nova-compute[73484]:     <video>
Aug 14 14:06:57 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 14:06:57 user nova-compute[73484]:     </video>
Aug 14 14:06:57 user nova-compute[73484]:     <rng model="virtio">
Aug 14 14:06:57 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 14:06:57 user nova-compute[73484]:     </rng>
Aug 14 14:06:57 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 14:06:57 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 14:06:57 user nova-compute[73484]:       <stats period="10"/>
Aug 14 14:06:57 user nova-compute[73484]:     </memballoon>
Aug 14 14:06:57 user nova-compute[73484]:   </devices>
Aug 14 14:06:57 user nova-compute[73484]: </domain>
Aug 14 14:06:57 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:06:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1165337161',display_name='tempest-TestVolumeBootPattern-server-1165337161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1165337161',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d5f985c3a8447e4870782d5e8709609',ramdisk_id='',reservation_id='r-lju8vn6f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1241691583',owner_user_name='tempest-TestVolumeBootPattern-1241691583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:06:41Z,user_data=None,user_id='06a79841cf6743a7bd565a6084383f6c',uuid=f3fdfa01-354e-4b59-9c1c-e82787ddcd02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "631f3e90-984d-443a-baff-c1f4677b6da9", "address": "fa:16:3e:89:d0:2d", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap631f3e90-98", "ovs_interfaceid": "631f3e90-984d-443a-baff-c1f4677b6da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converting VIF {"id": "631f3e90-984d-443a-baff-c1f4677b6da9", "address": "fa:16:3e:89:d0:2d", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap631f3e90-98", "ovs_interfaceid": "631f3e90-984d-443a-baff-c1f4677b6da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:d0:2d,bridge_name='br-int',has_traffic_filtering=True,id=631f3e90-984d-443a-baff-c1f4677b6da9,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap631f3e90-98') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG os_vif [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:d0:2d,bridge_name='br-int',has_traffic_filtering=True,id=631f3e90-984d-443a-baff-c1f4677b6da9,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap631f3e90-98') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap631f3e90-98, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap631f3e90-98, col_values=(('external_ids', {'iface-id': '631f3e90-984d-443a-baff-c1f4677b6da9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:d0:2d', 'vm-uuid': 'f3fdfa01-354e-4b59-9c1c-e82787ddcd02'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6154d36-5da9-469f-b879-6f5453ae7eb5]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)
Aug 14 14:06:57 user nova-compute[73484]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a (non-flash)
Aug 14 14:06:57 user nova-compute[73484]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 (non-flash)
Aug 14 14:06:57 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)
Aug 14 14:06:57 user nova-compute[73484]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a (non-flash)
Aug 14 14:06:57 user nova-compute[73484]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 (non-flash)
Aug 14 14:06:57 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc45834f910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a'): ({'sdb'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Removing single pathed devices sdb {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:57 user nova-compute[73484]: INFO os_vif [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:d0:2d,bridge_name='br-int',has_traffic_filtering=True,id=631f3e90-984d-443a-baff-c1f4677b6da9,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap631f3e90-98')
Aug 14 14:06:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08e1d7f-44b2-489e-9617-e772c9ac3467]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0846b071-bbfd-451e-a32d-2d45764d6741]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Flushing IO for device /dev/sdb {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] No VIF found with MAC fa:16:3e:89:d0:2d, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e42b2a-17f2-47e6-89cd-c98939d9ea4c]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f493b23c-087b-4dcc-8789-b4b4cb13eed0]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] SCSI volumes sdb have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb0ef57-098b-448e-ac51-85f211712406]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8cf166-7578-49c6-af5f-33e679c871f0]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a, portal: 172.16.0.220,3260]
Aug 14 14:06:57 user nova-compute[73484]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a, portal: 172.16.0.220,3260] successful.
Aug 14 14:06:57 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a807e53-0bdf-4454-9e41-39188cf0ca3a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[094bce95-5d53-47b3-8e61-f177eafb0179]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] <== disconnect_volume: return (559ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:06:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 14:06:58 user nova-compute[73484]: DEBUG nova.objects.instance [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lazy-loading 'flavor' on Instance uuid 8bce4703-8877-40ea-8615-323c70a5b47d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:06:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-aaf03056-536b-4f60-bd41-942ecad8821a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "8bce4703-8877-40ea-8615-323c70a5b47d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.999s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:06:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:59 user nova-compute[73484]: DEBUG nova.compute.manager [req-e2eabd02-097e-47bf-8a46-0cd18756e867 req-4dcfae5c-d6a1-4190-afd8-52c1ba75c954 service nova] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Received event network-vif-plugged-631f3e90-984d-443a-baff-c1f4677b6da9 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:06:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e2eabd02-097e-47bf-8a46-0cd18756e867 req-4dcfae5c-d6a1-4190-afd8-52c1ba75c954 service nova] Acquiring lock "f3fdfa01-354e-4b59-9c1c-e82787ddcd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:06:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e2eabd02-097e-47bf-8a46-0cd18756e867 req-4dcfae5c-d6a1-4190-afd8-52c1ba75c954 service nova] Lock "f3fdfa01-354e-4b59-9c1c-e82787ddcd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:06:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e2eabd02-097e-47bf-8a46-0cd18756e867 req-4dcfae5c-d6a1-4190-afd8-52c1ba75c954 service nova] Lock "f3fdfa01-354e-4b59-9c1c-e82787ddcd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:06:59 user nova-compute[73484]: DEBUG nova.compute.manager [req-e2eabd02-097e-47bf-8a46-0cd18756e867 req-4dcfae5c-d6a1-4190-afd8-52c1ba75c954 service nova] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] No waiting events found dispatching network-vif-plugged-631f3e90-984d-443a-baff-c1f4677b6da9 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:06:59 user nova-compute[73484]: WARNING nova.compute.manager [req-e2eabd02-097e-47bf-8a46-0cd18756e867 req-4dcfae5c-d6a1-4190-afd8-52c1ba75c954 service nova] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Received unexpected event network-vif-plugged-631f3e90-984d-443a-baff-c1f4677b6da9 for instance with vm_state building and task_state spawning.
Aug 14 14:06:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:06:59 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:06:59 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 14:06:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:01 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692022021.0247838, f3fdfa01-354e-4b59-9c1c-e82787ddcd02 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:07:01 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] VM Resumed (Lifecycle Event)
Aug 14 14:07:01 user nova-compute[73484]: DEBUG nova.compute.manager [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 14:07:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 14:07:01 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Instance spawned successfully.
Aug 14 14:07:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 14:07:01 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:07:01 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:07:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:07:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:07:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:07:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:07:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:07:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:07:01 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:07:01 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692022021.0287566, f3fdfa01-354e-4b59-9c1c-e82787ddcd02 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:07:01 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] VM Started (Lifecycle Event)
Aug 14 14:07:01 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:07:01 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:07:01 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:07:01 user nova-compute[73484]: INFO nova.compute.manager [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Took 5.08 seconds to spawn the instance on the hypervisor.
Aug 14 14:07:01 user nova-compute[73484]: DEBUG nova.compute.manager [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:07:01 user nova-compute[73484]: DEBUG nova.compute.manager [req-43742230-fb47-4b18-b195-19e4f4cc1e9d req-ce838dcf-6e6b-4a42-824d-1dc6a6848d54 service nova] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Received event network-vif-plugged-631f3e90-984d-443a-baff-c1f4677b6da9 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:07:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-43742230-fb47-4b18-b195-19e4f4cc1e9d req-ce838dcf-6e6b-4a42-824d-1dc6a6848d54 service nova] Acquiring lock "f3fdfa01-354e-4b59-9c1c-e82787ddcd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:07:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-43742230-fb47-4b18-b195-19e4f4cc1e9d req-ce838dcf-6e6b-4a42-824d-1dc6a6848d54 service nova] Lock "f3fdfa01-354e-4b59-9c1c-e82787ddcd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:07:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-43742230-fb47-4b18-b195-19e4f4cc1e9d req-ce838dcf-6e6b-4a42-824d-1dc6a6848d54 service nova] Lock "f3fdfa01-354e-4b59-9c1c-e82787ddcd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:07:01 user nova-compute[73484]: DEBUG nova.compute.manager [req-43742230-fb47-4b18-b195-19e4f4cc1e9d req-ce838dcf-6e6b-4a42-824d-1dc6a6848d54 service nova] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] No waiting events found dispatching network-vif-plugged-631f3e90-984d-443a-baff-c1f4677b6da9 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:07:01 user nova-compute[73484]: WARNING nova.compute.manager [req-43742230-fb47-4b18-b195-19e4f4cc1e9d req-ce838dcf-6e6b-4a42-824d-1dc6a6848d54 service nova] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Received unexpected event network-vif-plugged-631f3e90-984d-443a-baff-c1f4677b6da9 for instance with vm_state building and task_state spawning.
Aug 14 14:07:01 user nova-compute[73484]: INFO nova.compute.manager [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Took 20.29 seconds to build instance.
Aug 14 14:07:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-332baa2a-ee69-45b5-a979-45a90ee07056 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "f3fdfa01-354e-4b59-9c1c-e82787ddcd02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.385s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:07:01 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:07:01 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:07:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:03 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:07:03 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:07:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:07:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:07:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:07:03 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 14:07:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 14:07:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 14:07:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:05 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:07:05 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:07:05 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=8483MB free_disk=25.214622497558594GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 14:07:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:07:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:07:05 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance ee776e8c-6c86-450c-a020-1778e32e4d9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:07:05 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 8bce4703-8877-40ea-8615-323c70a5b47d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:07:05 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance f3fdfa01-354e-4b59-9c1c-e82787ddcd02 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:07:05 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 14:07:05 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 14:07:05 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:07:05 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:07:05 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 14:07:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:07:07 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:10 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:07:10 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:07:11 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:07:11 user nova-compute[73484]: DEBUG nova.compute.manager [req-d281f656-bbe7-4ff7-890f-dcc3b78d4a3b req-5e0bd5f8-5ea8-48fd-bbf4-d6f69184197b service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Received event network-changed-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:07:11 user nova-compute[73484]: DEBUG nova.compute.manager [req-d281f656-bbe7-4ff7-890f-dcc3b78d4a3b req-5e0bd5f8-5ea8-48fd-bbf4-d6f69184197b service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Refreshing instance network info cache due to event network-changed-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:07:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d281f656-bbe7-4ff7-890f-dcc3b78d4a3b req-5e0bd5f8-5ea8-48fd-bbf4-d6f69184197b service nova] Acquiring lock "refresh_cache-ee776e8c-6c86-450c-a020-1778e32e4d9c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:07:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d281f656-bbe7-4ff7-890f-dcc3b78d4a3b req-5e0bd5f8-5ea8-48fd-bbf4-d6f69184197b service nova] Acquired lock "refresh_cache-ee776e8c-6c86-450c-a020-1778e32e4d9c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:07:11 user nova-compute[73484]: DEBUG nova.network.neutron [req-d281f656-bbe7-4ff7-890f-dcc3b78d4a3b req-5e0bd5f8-5ea8-48fd-bbf4-d6f69184197b service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Refreshing network info cache for port 2ab1c5ec-bc00-45c2-9cc0-9a24367e044e {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:07:12 user nova-compute[73484]: DEBUG nova.network.neutron [req-d281f656-bbe7-4ff7-890f-dcc3b78d4a3b req-5e0bd5f8-5ea8-48fd-bbf4-d6f69184197b service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Updated VIF entry in instance network info cache for port 2ab1c5ec-bc00-45c2-9cc0-9a24367e044e. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:07:12 user nova-compute[73484]: DEBUG nova.network.neutron [req-d281f656-bbe7-4ff7-890f-dcc3b78d4a3b req-5e0bd5f8-5ea8-48fd-bbf4-d6f69184197b service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Updating instance_info_cache with network_info: [{"id": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "address": "fa:16:3e:e0:52:91", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab1c5ec-bc", "ovs_interfaceid": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:07:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d281f656-bbe7-4ff7-890f-dcc3b78d4a3b req-5e0bd5f8-5ea8-48fd-bbf4-d6f69184197b service nova] Releasing lock "refresh_cache-ee776e8c-6c86-450c-a020-1778e32e4d9c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:07:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:07:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:07:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:07:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:07:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:07:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:12 user nova-compute[73484]: DEBUG nova.compute.manager [req-75c10101-4d53-4056-9278-417c2ed6b7e7 req-6edf2a60-061d-48ee-b3da-7a86dfd41edd service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Received event network-changed-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:07:12 user nova-compute[73484]: DEBUG nova.compute.manager [req-75c10101-4d53-4056-9278-417c2ed6b7e7 req-6edf2a60-061d-48ee-b3da-7a86dfd41edd service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Refreshing instance network info cache due to event network-changed-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:07:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-75c10101-4d53-4056-9278-417c2ed6b7e7 req-6edf2a60-061d-48ee-b3da-7a86dfd41edd service nova] Acquiring lock "refresh_cache-ee776e8c-6c86-450c-a020-1778e32e4d9c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:07:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-75c10101-4d53-4056-9278-417c2ed6b7e7 req-6edf2a60-061d-48ee-b3da-7a86dfd41edd service nova] Acquired lock "refresh_cache-ee776e8c-6c86-450c-a020-1778e32e4d9c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:07:12 user nova-compute[73484]: DEBUG nova.network.neutron [req-75c10101-4d53-4056-9278-417c2ed6b7e7 req-6edf2a60-061d-48ee-b3da-7a86dfd41edd service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Refreshing network info cache for port 2ab1c5ec-bc00-45c2-9cc0-9a24367e044e {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "ee776e8c-6c86-450c-a020-1778e32e4d9c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:07:13 user nova-compute[73484]: INFO nova.compute.manager [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Detaching volume 90f6e412-ffa9-4b7d-8a08-276e00dad159
Aug 14 14:07:13 user nova-compute[73484]: INFO nova.virt.block_device [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Attempting to driver detach volume 90f6e412-ffa9-4b7d-8a08-276e00dad159 from mountpoint /dev/vdb
Aug 14 14:07:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Attempting to detach device vdb from instance ee776e8c-6c86-450c-a020-1778e32e4d9c from the persistent domain config. {{(pid=73484) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 14:07:13 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:07:13 user nova-compute[73484]:   <source dev="/dev/sdc"/>
Aug 14 14:07:13 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 14:07:13 user nova-compute[73484]:   <serial>90f6e412-ffa9-4b7d-8a08-276e00dad159</serial>
Aug 14 14:07:13 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 14:07:13 user nova-compute[73484]: </disk>
Aug 14 14:07:13 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 14:07:13 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Successfully detached device vdb from instance ee776e8c-6c86-450c-a020-1778e32e4d9c from the persistent domain config.
Aug 14 14:07:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ee776e8c-6c86-450c-a020-1778e32e4d9c from the live domain config. {{(pid=73484) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 14:07:13 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:07:13 user nova-compute[73484]:   <source dev="/dev/sdc"/>
Aug 14 14:07:13 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 14:07:13 user nova-compute[73484]:   <serial>90f6e412-ffa9-4b7d-8a08-276e00dad159</serial>
Aug 14 14:07:13 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 14:07:13 user nova-compute[73484]: </disk>
Aug 14 14:07:13 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG nova.network.neutron [req-75c10101-4d53-4056-9278-417c2ed6b7e7 req-6edf2a60-061d-48ee-b3da-7a86dfd41edd service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Updated VIF entry in instance network info cache for port 2ab1c5ec-bc00-45c2-9cc0-9a24367e044e. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG nova.network.neutron [req-75c10101-4d53-4056-9278-417c2ed6b7e7 req-6edf2a60-061d-48ee-b3da-7a86dfd41edd service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Updating instance_info_cache with network_info: [{"id": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "address": "fa:16:3e:e0:52:91", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab1c5ec-bc", "ovs_interfaceid": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-75c10101-4d53-4056-9278-417c2ed6b7e7 req-6edf2a60-061d-48ee-b3da-7a86dfd41edd service nova] Releasing lock "refresh_cache-ee776e8c-6c86-450c-a020-1778e32e4d9c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Received event <DeviceRemovedEvent: 1692022033.6878505, ee776e8c-6c86-450c-a020-1778e32e4d9c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73484) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ee776e8c-6c86-450c-a020-1778e32e4d9c {{(pid=73484) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 14:07:13 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Successfully detached device vdb from instance ee776e8c-6c86-450c-a020-1778e32e4d9c from the live domain config.
Aug 14 14:07:13 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yDoHGncV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:07:13 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:07:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b18c081-c9b2-42e6-95b1-c10ab55869f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[67303f52-0910-4863-ad6c-80b3460d2c7d]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)
Aug 14 14:07:13 user nova-compute[73484]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 (non-flash)
Aug 14 14:07:13 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 (non-flash)
Aug 14 14:07:13 user nova-compute[73484]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 (non-flash)
Aug 14 14:07:13 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4586e77f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159'): ({'sdc'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Removing single pathed devices sdc {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74ad4b5-ed23-412e-8a2c-110a13c5f685]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[68008465-db5f-4003-bb94-829d2e7faf66]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Flushing IO for device /dev/sdc {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ae793a-edcb-46e9-9b50-c511a26d6002]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc46d2ef-31b3-4bdd-9e74-24463956beec]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f37ba9-6812-4190-a231-754370ed8b80]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49272a0-952f-40c2-99b3-a618250233d8]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159, portal: 172.16.0.220,3260]
Aug 14 14:07:13 user nova-compute[73484]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159, portal: 172.16.0.220,3260] successful.
Aug 14 14:07:13 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:07:13 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:14 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90f6e412-ffa9-4b7d-8a08-276e00dad159 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:14 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9902b319-72cc-43ec-b275-29c3ad287d81]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:07:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:07:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:07:14 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] <== disconnect_volume: return (312ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:07:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 14:07:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:17 user nova-compute[73484]: DEBUG nova.objects.instance [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lazy-loading 'flavor' on Instance uuid ee776e8c-6c86-450c-a020-1778e32e4d9c {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:07:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c7bdf15e-36ab-4973-9ac8-0e0ca6634b66 tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.364s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:07:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:22 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Acquiring lock "03cf790d-ef81-4a59-8dd3-af036da8b741" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:07:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lock "03cf790d-ef81-4a59-8dd3-af036da8b741" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:07:38 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 14:07:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:07:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:07:38 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 14:07:38 user nova-compute[73484]: INFO nova.compute.claims [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Claim successful on node user
Aug 14 14:07:38 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:07:38 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:07:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.241s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:07:38 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 14:07:38 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 14:07:38 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 14:07:38 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 14:07:38 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 14:07:38 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 14:07:38 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 14:07:38 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Creating image(s)
Aug 14 14:07:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Acquiring lock "/opt/stack/data/nova/instances/03cf790d-ef81-4a59-8dd3-af036da8b741/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:07:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lock "/opt/stack/data/nova/instances/03cf790d-ef81-4a59-8dd3-af036da8b741/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:07:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lock "/opt/stack/data/nova/instances/03cf790d-ef81-4a59-8dd3-af036da8b741/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:07:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:38 user nova-compute[73484]: DEBUG nova.policy [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52a1092e60ba417dbfcf19eabf6da784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921f66eafb204995915231c86e234e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 14:07:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.194s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Acquiring lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:07:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:07:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.186s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/03cf790d-ef81-4a59-8dd3-af036da8b741/disk 1073741824 {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03,backing_fmt=raw /opt/stack/data/nova/instances/03cf790d-ef81-4a59-8dd3-af036da8b741/disk 1073741824" returned: 0 in 0.047s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lock "3507b9f30b1fcbea95c0686b60a5573487b12a03" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:07:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 --force-share --output=json" returned: 0 in 0.176s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:39 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03cf790d-ef81-4a59-8dd3-af036da8b741/disk. size=1073741824 {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 14:07:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cf790d-ef81-4a59-8dd3-af036da8b741/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:39 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Successfully created port: de3e32f0-9cda-404c-887c-e80e4c261827 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 14:07:39 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cf790d-ef81-4a59-8dd3-af036da8b741/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:39 user nova-compute[73484]: DEBUG nova.virt.disk.api [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Cannot resize image /opt/stack/data/nova/instances/03cf790d-ef81-4a59-8dd3-af036da8b741/disk to a smaller size. {{(pid=73484) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 14:07:39 user nova-compute[73484]: DEBUG nova.objects.instance [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lazy-loading 'migration_context' on Instance uuid 03cf790d-ef81-4a59-8dd3-af036da8b741 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:07:39 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Created local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 14:07:39 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Ensure instance console log exists: /opt/stack/data/nova/instances/03cf790d-ef81-4a59-8dd3-af036da8b741/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 14:07:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:07:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:07:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Successfully updated port: de3e32f0-9cda-404c-887c-e80e4c261827 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Acquiring lock "refresh_cache-03cf790d-ef81-4a59-8dd3-af036da8b741" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Acquired lock "refresh_cache-03cf790d-ef81-4a59-8dd3-af036da8b741" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-39eca2d2-e7d0-4fe6-a4f4-718e49985a40 req-6aeb1d98-e3a8-440d-9685-7a2b2a0ccc78 service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Received event network-changed-de3e32f0-9cda-404c-887c-e80e4c261827 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-39eca2d2-e7d0-4fe6-a4f4-718e49985a40 req-6aeb1d98-e3a8-440d-9685-7a2b2a0ccc78 service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Refreshing instance network info cache due to event network-changed-de3e32f0-9cda-404c-887c-e80e4c261827. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-39eca2d2-e7d0-4fe6-a4f4-718e49985a40 req-6aeb1d98-e3a8-440d-9685-7a2b2a0ccc78 service nova] Acquiring lock "refresh_cache-03cf790d-ef81-4a59-8dd3-af036da8b741" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Updating instance_info_cache with network_info: [{"id": "de3e32f0-9cda-404c-887c-e80e4c261827", "address": "fa:16:3e:a1:3d:37", "network": {"id": "c009336f-39d9-4498-b6d5-fad59509221a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-503385962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921f66eafb204995915231c86e234e62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3e32f0-9c", "ovs_interfaceid": "de3e32f0-9cda-404c-887c-e80e4c261827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Releasing lock "refresh_cache-03cf790d-ef81-4a59-8dd3-af036da8b741" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Instance network_info: |[{"id": "de3e32f0-9cda-404c-887c-e80e4c261827", "address": "fa:16:3e:a1:3d:37", "network": {"id": "c009336f-39d9-4498-b6d5-fad59509221a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-503385962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921f66eafb204995915231c86e234e62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3e32f0-9c", "ovs_interfaceid": "de3e32f0-9cda-404c-887c-e80e4c261827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-39eca2d2-e7d0-4fe6-a4f4-718e49985a40 req-6aeb1d98-e3a8-440d-9685-7a2b2a0ccc78 service nova] Acquired lock "refresh_cache-03cf790d-ef81-4a59-8dd3-af036da8b741" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.network.neutron [req-39eca2d2-e7d0-4fe6-a4f4-718e49985a40 req-6aeb1d98-e3a8-440d-9685-7a2b2a0ccc78 service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Refreshing network info cache for port de3e32f0-9cda-404c-887c-e80e4c261827 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Start _get_guest_xml network_info=[{"id": "de3e32f0-9cda-404c-887c-e80e4c261827", "address": "fa:16:3e:a1:3d:37", "network": {"id": "c009336f-39d9-4498-b6d5-fad59509221a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-503385962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921f66eafb204995915231c86e234e62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3e32f0-9c", "ovs_interfaceid": "de3e32f0-9cda-404c-887c-e80e4c261827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'size': 0, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'encryption_format': None, 'device_type': 'disk', 'image_id': '35547d66-318f-468f-9286-e10554f69bf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 14:07:40 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:07:40 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T13:33:02Z,direct_url=<?>,disk_format='qcow2',id=35547d66-318f-468f-9286-e10554f69bf8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a23940f0738942409fd00984c52e7e65',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T13:33:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:07:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1760024785',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1760024785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1760024',id=47,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMK6FTUVlpEstZsKBfvNiVROkVdgZCZ44mhVUHerOnfqQoFqK4nVmYwYa8qC2eUyBq6mql7HaVni/xX6m5vwaNaqz8KPjZDhPA9qlVvMzKGhJeE39ULS4IyC3cIvcDCrmA==',key_name='tempest-keypair-1183284852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='921f66eafb204995915231c86e234e62',ramdisk_id='',reservation_id='r-sz44k3nm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-401699136',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:07:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52a1092e60ba417dbfcf19eabf6da784',uuid=03cf790d-ef81-4a59-8dd3-af036da8b741,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de3e32f0-9cda-404c-887c-e80e4c261827", "address": "fa:16:3e:a1:3d:37", "network": {"id": "c009336f-39d9-4498-b6d5-fad59509221a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-503385962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921f66eafb204995915231c86e234e62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3e32f0-9c", "ovs_interfaceid": "de3e32f0-9cda-404c-887c-e80e4c261827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Converting VIF {"id": "de3e32f0-9cda-404c-887c-e80e4c261827", "address": "fa:16:3e:a1:3d:37", "network": {"id": "c009336f-39d9-4498-b6d5-fad59509221a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-503385962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921f66eafb204995915231c86e234e62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3e32f0-9c", "ovs_interfaceid": "de3e32f0-9cda-404c-887c-e80e4c261827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:3d:37,bridge_name='br-int',has_traffic_filtering=True,id=de3e32f0-9cda-404c-887c-e80e4c261827,network=Network(c009336f-39d9-4498-b6d5-fad59509221a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3e32f0-9c') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.objects.instance [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lazy-loading 'pci_devices' on Instance uuid 03cf790d-ef81-4a59-8dd3-af036da8b741 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] End _get_guest_xml xml=<domain type="kvm">
Aug 14 14:07:40 user nova-compute[73484]:   <uuid>03cf790d-ef81-4a59-8dd3-af036da8b741</uuid>
Aug 14 14:07:40 user nova-compute[73484]:   <name>instance-0000002f</name>
Aug 14 14:07:40 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 14:07:40 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 14:07:40 user nova-compute[73484]:   <metadata>
Aug 14 14:07:40 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 14:07:40 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 14:07:40 user nova-compute[73484]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1760024785</nova:name>
Aug 14 14:07:40 user nova-compute[73484]:       <nova:creationTime>2023-08-14 14:07:40</nova:creationTime>
Aug 14 14:07:40 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 14:07:40 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 14:07:40 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 14:07:40 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 14:07:40 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 14:07:40 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 14:07:40 user nova-compute[73484]:       </nova:flavor>
Aug 14 14:07:40 user nova-compute[73484]:       <nova:owner>
Aug 14 14:07:40 user nova-compute[73484]:         <nova:user uuid="52a1092e60ba417dbfcf19eabf6da784">tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member</nova:user>
Aug 14 14:07:40 user nova-compute[73484]:         <nova:project uuid="921f66eafb204995915231c86e234e62">tempest-TestServerVolumeAttachScenarioOldVersion-401699136</nova:project>
Aug 14 14:07:40 user nova-compute[73484]:       </nova:owner>
Aug 14 14:07:40 user nova-compute[73484]:       <nova:root type="image" uuid="35547d66-318f-468f-9286-e10554f69bf8"/>
Aug 14 14:07:40 user nova-compute[73484]:       <nova:ports>
Aug 14 14:07:40 user nova-compute[73484]:         <nova:port uuid="de3e32f0-9cda-404c-887c-e80e4c261827">
Aug 14 14:07:40 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 14:07:40 user nova-compute[73484]:         </nova:port>
Aug 14 14:07:40 user nova-compute[73484]:       </nova:ports>
Aug 14 14:07:40 user nova-compute[73484]:     </nova:instance>
Aug 14 14:07:40 user nova-compute[73484]:   </metadata>
Aug 14 14:07:40 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 14:07:40 user nova-compute[73484]:     <system>
Aug 14 14:07:40 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 14:07:40 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 14:07:40 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 14:07:40 user nova-compute[73484]:       <entry name="serial">03cf790d-ef81-4a59-8dd3-af036da8b741</entry>
Aug 14 14:07:40 user nova-compute[73484]:       <entry name="uuid">03cf790d-ef81-4a59-8dd3-af036da8b741</entry>
Aug 14 14:07:40 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 14:07:40 user nova-compute[73484]:     </system>
Aug 14 14:07:40 user nova-compute[73484]:   </sysinfo>
Aug 14 14:07:40 user nova-compute[73484]:   <os>
Aug 14 14:07:40 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 14:07:40 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 14:07:40 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 14:07:40 user nova-compute[73484]:   </os>
Aug 14 14:07:40 user nova-compute[73484]:   <features>
Aug 14 14:07:40 user nova-compute[73484]:     <acpi/>
Aug 14 14:07:40 user nova-compute[73484]:     <apic/>
Aug 14 14:07:40 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 14:07:40 user nova-compute[73484]:   </features>
Aug 14 14:07:40 user nova-compute[73484]:   <clock offset="utc">
Aug 14 14:07:40 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 14:07:40 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 14:07:40 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 14:07:40 user nova-compute[73484]:   </clock>
Aug 14 14:07:40 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 14:07:40 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 14:07:40 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 14:07:40 user nova-compute[73484]:   </cpu>
Aug 14 14:07:40 user nova-compute[73484]:   <devices>
Aug 14 14:07:40 user nova-compute[73484]:     <disk type="file" device="disk">
Aug 14 14:07:40 user nova-compute[73484]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 14:07:40 user nova-compute[73484]:       <source file="/opt/stack/data/nova/instances/03cf790d-ef81-4a59-8dd3-af036da8b741/disk"/>
Aug 14 14:07:40 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 14:07:40 user nova-compute[73484]:     </disk>
Aug 14 14:07:40 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 14:07:40 user nova-compute[73484]:       <mac address="fa:16:3e:a1:3d:37"/>
Aug 14 14:07:40 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 14:07:40 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 14:07:40 user nova-compute[73484]:       <target dev="tapde3e32f0-9c"/>
Aug 14 14:07:40 user nova-compute[73484]:     </interface>
Aug 14 14:07:40 user nova-compute[73484]:     <serial type="pty">
Aug 14 14:07:40 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/03cf790d-ef81-4a59-8dd3-af036da8b741/console.log" append="off"/>
Aug 14 14:07:40 user nova-compute[73484]:     </serial>
Aug 14 14:07:40 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 14:07:40 user nova-compute[73484]:     <video>
Aug 14 14:07:40 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 14:07:40 user nova-compute[73484]:     </video>
Aug 14 14:07:40 user nova-compute[73484]:     <rng model="virtio">
Aug 14 14:07:40 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 14:07:40 user nova-compute[73484]:     </rng>
Aug 14 14:07:40 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 14:07:40 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 14:07:40 user nova-compute[73484]:       <stats period="10"/>
Aug 14 14:07:40 user nova-compute[73484]:     </memballoon>
Aug 14 14:07:40 user nova-compute[73484]:   </devices>
Aug 14 14:07:40 user nova-compute[73484]: </domain>
Aug 14 14:07:40 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:07:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1760024785',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1760024785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1760024',id=47,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMK6FTUVlpEstZsKBfvNiVROkVdgZCZ44mhVUHerOnfqQoFqK4nVmYwYa8qC2eUyBq6mql7HaVni/xX6m5vwaNaqz8KPjZDhPA9qlVvMzKGhJeE39ULS4IyC3cIvcDCrmA==',key_name='tempest-keypair-1183284852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='921f66eafb204995915231c86e234e62',ramdisk_id='',reservation_id='r-sz44k3nm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-401699136',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:07:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52a1092e60ba417dbfcf19eabf6da784',uuid=03cf790d-ef81-4a59-8dd3-af036da8b741,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de3e32f0-9cda-404c-887c-e80e4c261827", "address": "fa:16:3e:a1:3d:37", "network": {"id": "c009336f-39d9-4498-b6d5-fad59509221a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-503385962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921f66eafb204995915231c86e234e62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3e32f0-9c", "ovs_interfaceid": "de3e32f0-9cda-404c-887c-e80e4c261827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Converting VIF {"id": "de3e32f0-9cda-404c-887c-e80e4c261827", "address": "fa:16:3e:a1:3d:37", "network": {"id": "c009336f-39d9-4498-b6d5-fad59509221a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-503385962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921f66eafb204995915231c86e234e62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3e32f0-9c", "ovs_interfaceid": "de3e32f0-9cda-404c-887c-e80e4c261827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:3d:37,bridge_name='br-int',has_traffic_filtering=True,id=de3e32f0-9cda-404c-887c-e80e4c261827,network=Network(c009336f-39d9-4498-b6d5-fad59509221a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3e32f0-9c') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG os_vif [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:3d:37,bridge_name='br-int',has_traffic_filtering=True,id=de3e32f0-9cda-404c-887c-e80e4c261827,network=Network(c009336f-39d9-4498-b6d5-fad59509221a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3e32f0-9c') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde3e32f0-9c, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapde3e32f0-9c, col_values=(('external_ids', {'iface-id': 'de3e32f0-9cda-404c-887c-e80e4c261827', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:3d:37', 'vm-uuid': '03cf790d-ef81-4a59-8dd3-af036da8b741'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:40 user nova-compute[73484]: INFO os_vif [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:3d:37,bridge_name='br-int',has_traffic_filtering=True,id=de3e32f0-9cda-404c-887c-e80e4c261827,network=Network(c009336f-39d9-4498-b6d5-fad59509221a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3e32f0-9c')
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] No VIF found with MAC fa:16:3e:a1:3d:37, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.network.neutron [req-39eca2d2-e7d0-4fe6-a4f4-718e49985a40 req-6aeb1d98-e3a8-440d-9685-7a2b2a0ccc78 service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Updated VIF entry in instance network info cache for port de3e32f0-9cda-404c-887c-e80e4c261827. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:07:40 user nova-compute[73484]: DEBUG nova.network.neutron [req-39eca2d2-e7d0-4fe6-a4f4-718e49985a40 req-6aeb1d98-e3a8-440d-9685-7a2b2a0ccc78 service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Updating instance_info_cache with network_info: [{"id": "de3e32f0-9cda-404c-887c-e80e4c261827", "address": "fa:16:3e:a1:3d:37", "network": {"id": "c009336f-39d9-4498-b6d5-fad59509221a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-503385962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921f66eafb204995915231c86e234e62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3e32f0-9c", "ovs_interfaceid": "de3e32f0-9cda-404c-887c-e80e4c261827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:07:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-39eca2d2-e7d0-4fe6-a4f4-718e49985a40 req-6aeb1d98-e3a8-440d-9685-7a2b2a0ccc78 service nova] Releasing lock "refresh_cache-03cf790d-ef81-4a59-8dd3-af036da8b741" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:07:41 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:41 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:41 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:42 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:42 user nova-compute[73484]: DEBUG nova.compute.manager [req-3ff3c1b1-c1eb-4a1d-9276-1b266e1c9970 req-25d4b69b-dc50-49ac-b810-c448f666d9c9 service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Received event network-vif-plugged-de3e32f0-9cda-404c-887c-e80e4c261827 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:07:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3ff3c1b1-c1eb-4a1d-9276-1b266e1c9970 req-25d4b69b-dc50-49ac-b810-c448f666d9c9 service nova] Acquiring lock "03cf790d-ef81-4a59-8dd3-af036da8b741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:07:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3ff3c1b1-c1eb-4a1d-9276-1b266e1c9970 req-25d4b69b-dc50-49ac-b810-c448f666d9c9 service nova] Lock "03cf790d-ef81-4a59-8dd3-af036da8b741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:07:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3ff3c1b1-c1eb-4a1d-9276-1b266e1c9970 req-25d4b69b-dc50-49ac-b810-c448f666d9c9 service nova] Lock "03cf790d-ef81-4a59-8dd3-af036da8b741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:07:42 user nova-compute[73484]: DEBUG nova.compute.manager [req-3ff3c1b1-c1eb-4a1d-9276-1b266e1c9970 req-25d4b69b-dc50-49ac-b810-c448f666d9c9 service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] No waiting events found dispatching network-vif-plugged-de3e32f0-9cda-404c-887c-e80e4c261827 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:07:42 user nova-compute[73484]: WARNING nova.compute.manager [req-3ff3c1b1-c1eb-4a1d-9276-1b266e1c9970 req-25d4b69b-dc50-49ac-b810-c448f666d9c9 service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Received unexpected event network-vif-plugged-de3e32f0-9cda-404c-887c-e80e4c261827 for instance with vm_state building and task_state spawning.
Aug 14 14:07:42 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:42 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:42 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:44 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692022064.1330273, 03cf790d-ef81-4a59-8dd3-af036da8b741 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:07:44 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] VM Resumed (Lifecycle Event)
Aug 14 14:07:44 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 14:07:44 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 14:07:44 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Instance spawned successfully.
Aug 14 14:07:44 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 14:07:44 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:07:44 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:07:44 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:07:44 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:07:44 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:07:44 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:07:44 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:07:44 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:07:44 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:07:44 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692022064.1342046, 03cf790d-ef81-4a59-8dd3-af036da8b741 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:07:44 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] VM Started (Lifecycle Event)
Aug 14 14:07:44 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:07:44 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:07:44 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:07:44 user nova-compute[73484]: INFO nova.compute.manager [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Took 5.51 seconds to spawn the instance on the hypervisor.
Aug 14 14:07:44 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:07:44 user nova-compute[73484]: DEBUG nova.compute.manager [req-0a6109a9-f690-4e58-8e49-d14a530cb728 req-e6f6e26a-66d5-4868-ac17-2f48e7e9faf6 service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Received event network-vif-plugged-de3e32f0-9cda-404c-887c-e80e4c261827 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:07:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0a6109a9-f690-4e58-8e49-d14a530cb728 req-e6f6e26a-66d5-4868-ac17-2f48e7e9faf6 service nova] Acquiring lock "03cf790d-ef81-4a59-8dd3-af036da8b741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:07:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0a6109a9-f690-4e58-8e49-d14a530cb728 req-e6f6e26a-66d5-4868-ac17-2f48e7e9faf6 service nova] Lock "03cf790d-ef81-4a59-8dd3-af036da8b741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:07:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0a6109a9-f690-4e58-8e49-d14a530cb728 req-e6f6e26a-66d5-4868-ac17-2f48e7e9faf6 service nova] Lock "03cf790d-ef81-4a59-8dd3-af036da8b741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:07:44 user nova-compute[73484]: DEBUG nova.compute.manager [req-0a6109a9-f690-4e58-8e49-d14a530cb728 req-e6f6e26a-66d5-4868-ac17-2f48e7e9faf6 service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] No waiting events found dispatching network-vif-plugged-de3e32f0-9cda-404c-887c-e80e4c261827 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:07:44 user nova-compute[73484]: WARNING nova.compute.manager [req-0a6109a9-f690-4e58-8e49-d14a530cb728 req-e6f6e26a-66d5-4868-ac17-2f48e7e9faf6 service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Received unexpected event network-vif-plugged-de3e32f0-9cda-404c-887c-e80e4c261827 for instance with vm_state building and task_state spawning.
Aug 14 14:07:44 user nova-compute[73484]: INFO nova.compute.manager [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Took 6.07 seconds to build instance.
Aug 14 14:07:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6c9010e8-55a4-461d-bf8a-1f37675eef6d tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lock "03cf790d-ef81-4a59-8dd3-af036da8b741" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.173s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:07:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "8bce4703-8877-40ea-8615-323c70a5b47d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:07:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "8bce4703-8877-40ea-8615-323c70a5b47d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:07:50 user nova-compute[73484]: DEBUG nova.objects.instance [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lazy-loading 'flavor' on Instance uuid 8bce4703-8877-40ea-8615-323c70a5b47d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:07:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "8bce4703-8877-40ea-8615-323c70a5b47d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:07:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "8bce4703-8877-40ea-8615-323c70a5b47d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:07:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "8bce4703-8877-40ea-8615-323c70a5b47d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:07:51 user nova-compute[73484]: INFO nova.compute.manager [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Attaching volume c1dbe39f-8b37-4b63-91b4-966c5093cedc to /dev/vdb
Aug 14 14:07:51 user nova-compute[73484]: DEBUG os_brick.utils [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:07:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:51 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc2deb2-44c5-47e2-aac1-69b99952d81e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:07:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:51 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43cb5db-924f-45d4-827c-eda48b190666]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:07:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:51 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfb3db1-7975-4f22-b965-0ebab79b5d1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:07:51 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ade51f5-76c5-4130-ad07-aa030171834e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:07:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:07:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 14:07:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:51 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:07:51 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 14:07:51 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd4ce9f-17ea-405d-9a5f-85916b455322]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:07:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 14:07:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 14:07:51 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 14:07:51 user nova-compute[73484]: DEBUG os_brick.utils [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:07:51 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Updating existing volume attachment record: e70c1e58-55d8-433f-b717-86fdca38a98f {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 14:07:53 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:07:54 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:07:54 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 14:07:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-8bce4703-8877-40ea-8615-323c70a5b47d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:07:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-8bce4703-8877-40ea-8615-323c70a5b47d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:07:54 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 14:07:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:07:55 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Updating instance_info_cache with network_info: [{"id": "8829dabb-317a-48a1-b26f-145fd4a441bc", "address": "fa:16:3e:6b:5d:48", "network": {"id": "e5777564-99ba-44b7-b752-efaf236d840c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-601395130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0208e39a3304b7383d1c01e070a4c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8829dabb-31", "ovs_interfaceid": "8829dabb-317a-48a1-b26f-145fd4a441bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:07:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-8bce4703-8877-40ea-8615-323c70a5b47d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:07:55 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPrgsmOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:07:59 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:07:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:07:59 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:07:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:07:59 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c280ca8-d7a5-45a6-8d1b-4401870e9589]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 14:07:59 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[42877d29-d6d2-4d29-89f2-e4c0eb335814]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc] added
Aug 14 14:07:59 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4178c734-8ebb-451e-8460-fb2d0f46727f]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d38f86b-1f15-43a9-b739-5b5cb31c68f9]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WPrgsmOl {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WPrgsmOl" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[939522bf-c245-41e5-be83-33ff39e2ea75]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WPrgsmOl'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c824eeb-887a-4e7e-a248-1e88766e0130]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[5809604f-e6d3-45e2-b6ec-e5307f602d2a]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 (non-flash)
Aug 14 14:07:59 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 (non-flash)
Aug 14 14:07:59 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[5945d666-bcc1-4360-9ac8-24dd80299da9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc, portal: 172.16.0.220,3260]
Aug 14 14:07:59 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc, portal: 172.16.0.220,3260] successful.
Aug 14 14:07:59 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d516d56-ecc9-418c-8c72-d1280d40ef90]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a99a5cb-4a60-43ac-9cb7-b93c8d50430a]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 (non-flash)
Aug 14 14:07:59 user nova-compute[73484]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc (non-flash)
Aug 14 14:07:59 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 (non-flash)
Aug 14 14:07:59 user nova-compute[73484]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc (non-flash)
Aug 14 14:07:59 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7e7608-6bab-40c9-908f-e3b164d760a6]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 14:07:59 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPrgsmOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 14:08:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:08:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:08:00 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:08:00 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26336306232626261', 'path': '/dev/sdb'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:08:00 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336306232626261', 'path': '/dev/sdb'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 14:08:00 user nova-compute[73484]: DEBUG nova.objects.instance [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lazy-loading 'flavor' on Instance uuid 8bce4703-8877-40ea-8615-323c70a5b47d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:08:00 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 14:08:00 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:08:00 user nova-compute[73484]:   <source dev="/dev/sdb"/>
Aug 14 14:08:00 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 14:08:00 user nova-compute[73484]:   <serial>c1dbe39f-8b37-4b63-91b4-966c5093cedc</serial>
Aug 14 14:08:00 user nova-compute[73484]: </disk>
Aug 14 14:08:00 user nova-compute[73484]:  {{(pid=73484) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 14:08:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:08:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:08:01 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] No VIF found with MAC fa:16:3e:6b:5d:48, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:08:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-b2e8b0a1-1742-4141-b791-b26e2553654a tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "8bce4703-8877-40ea-8615-323c70a5b47d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.415s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:08:01 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:08:01 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:08:01 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 14:08:02 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:08:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "8bce4703-8877-40ea-8615-323c70a5b47d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:08:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "8bce4703-8877-40ea-8615-323c70a5b47d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:08:03 user nova-compute[73484]: INFO nova.compute.manager [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Detaching volume c1dbe39f-8b37-4b63-91b4-966c5093cedc
Aug 14 14:08:03 user nova-compute[73484]: INFO nova.virt.block_device [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Attempting to driver detach volume c1dbe39f-8b37-4b63-91b4-966c5093cedc from mountpoint /dev/vdb
Aug 14 14:08:03 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Attempting to detach device vdb from instance 8bce4703-8877-40ea-8615-323c70a5b47d from the persistent domain config. {{(pid=73484) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 14:08:03 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 14:08:03 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:08:03 user nova-compute[73484]:   <source dev="/dev/sdb"/>
Aug 14 14:08:03 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 14:08:03 user nova-compute[73484]:   <serial>c1dbe39f-8b37-4b63-91b4-966c5093cedc</serial>
Aug 14 14:08:03 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 14:08:03 user nova-compute[73484]: </disk>
Aug 14 14:08:03 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 14:08:03 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Successfully detached device vdb from instance 8bce4703-8877-40ea-8615-323c70a5b47d from the persistent domain config.
Aug 14 14:08:03 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8bce4703-8877-40ea-8615-323c70a5b47d from the live domain config. {{(pid=73484) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 14:08:03 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 14:08:03 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:08:03 user nova-compute[73484]:   <source dev="/dev/sdb"/>
Aug 14 14:08:03 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 14:08:03 user nova-compute[73484]:   <serial>c1dbe39f-8b37-4b63-91b4-966c5093cedc</serial>
Aug 14 14:08:03 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 14:08:03 user nova-compute[73484]: </disk>
Aug 14 14:08:03 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 14:08:03 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:08:03 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73484) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 14:08:03 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Received event <DeviceRemovedEvent: 1692022084.087168, 8bce4703-8877-40ea-8615-323c70a5b47d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73484) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8bce4703-8877-40ea-8615-323c70a5b47d {{(pid=73484) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 14:08:04 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Successfully detached device vdb from instance 8bce4703-8877-40ea-8615-323c70a5b47d from the live domain config.
Aug 14 14:08:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPrgsmOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:08:04 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:08:04 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e7dc44-c169-4ad2-a0aa-db9990d3787b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af2c55d-f8f9-46f0-bf9f-74929f7c6bcc]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 (non-flash)
Aug 14 14:08:04 user nova-compute[73484]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc (non-flash)
Aug 14 14:08:04 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 (non-flash)
Aug 14 14:08:04 user nova-compute[73484]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc (non-flash)
Aug 14 14:08:04 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc491fbb5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc'): ({'sdb'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Removing single pathed devices sdb {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f0d2b1-174c-4a79-8995-0dc04849fabd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fb8047-50fd-4ef7-aac3-49fe2c4c3e89]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Flushing IO for device /dev/sdb {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8664f6f9-04cb-4123-b371-24fa1ae5aff1]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2031e1a5-84ae-46a3-8ec7-2ed77f22af7e]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] SCSI volumes sdb have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbe4e7c-6c46-4a64-a2ec-5ddab8c4eb02]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1e1225-7d72-4baf-ab48-3c86e17032e6]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc, portal: 172.16.0.220,3260]
Aug 14 14:08:04 user nova-compute[73484]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc, portal: 172.16.0.220,3260] successful.
Aug 14 14:08:04 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1dbe39f-8b37-4b63-91b4-966c5093cedc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2429c7c8-c956-4a35-ae73-348b97560dd8]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] <== disconnect_volume: return (335ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 14:08:04 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:08:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:08:05 user nova-compute[73484]: DEBUG nova.objects.instance [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lazy-loading 'flavor' on Instance uuid 8bce4703-8877-40ea-8615-323c70a5b47d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:08:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0e92aa8c-6129-485a-bebd-77c6b412d62f tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "8bce4703-8877-40ea-8615-323c70a5b47d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.822s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:08:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:08:05 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:08:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:08:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:08:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:08:05 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 14:08:05 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:08:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:08:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:08:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:08:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:08:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:08:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:08:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:08:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 14:08:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cf790d-ef81-4a59-8dd3-af036da8b741/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:08:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cf790d-ef81-4a59-8dd3-af036da8b741/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:08:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cf790d-ef81-4a59-8dd3-af036da8b741/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:08:07 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cf790d-ef81-4a59-8dd3-af036da8b741/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:08:07 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:08:07 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:08:07 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=8237MB free_disk=25.18435287475586GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 14:08:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:08:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:08:07 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance ee776e8c-6c86-450c-a020-1778e32e4d9c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:08:07 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 8bce4703-8877-40ea-8615-323c70a5b47d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:08:07 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance f3fdfa01-354e-4b59-9c1c-e82787ddcd02 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:08:07 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 03cf790d-ef81-4a59-8dd3-af036da8b741 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:08:07 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 14:08:07 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 14:08:07 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Refreshing inventories for resource provider 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 14:08:07 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Updating ProviderTree inventory for provider 165d4635-93b4-49a6-879a-21c1324822ab from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 14:08:07 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Updating inventory in ProviderTree for provider 165d4635-93b4-49a6-879a-21c1324822ab with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 14:08:07 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Refreshing aggregate associations for resource provider 165d4635-93b4-49a6-879a-21c1324822ab, aggregates: None {{(pid=73484) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 14:08:07 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Refreshing trait associations for resource provider 165d4635-93b4-49a6-879a-21c1324822ab, traits: COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS {{(pid=73484) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 14:08:08 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:08:08 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:08:08 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 14:08:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:08:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-70a5beca-0020-4a52-9bc1-c40ca4aa568c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "ee776e8c-6c86-450c-a020-1778e32e4d9c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:08:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-70a5beca-0020-4a52-9bc1-c40ca4aa568c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:08:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-70a5beca-0020-4a52-9bc1-c40ca4aa568c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "ee776e8c-6c86-450c-a020-1778e32e4d9c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:08:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-70a5beca-0020-4a52-9bc1-c40ca4aa568c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:08:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-70a5beca-0020-4a52-9bc1-c40ca4aa568c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:08:09 user nova-compute[73484]: INFO nova.compute.manager [None req-70a5beca-0020-4a52-9bc1-c40ca4aa568c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Terminating instance
Aug 14 14:08:09 user nova-compute[73484]: DEBUG nova.compute.manager [None req-70a5beca-0020-4a52-9bc1-c40ca4aa568c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 14:08:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:08:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:08:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:08:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:08:09 user nova-compute[73484]: DEBUG nova.compute.manager [req-525cdd89-1f98-4a33-af23-2a54084db47c req-3c858194-2d3a-4c7b-a962-f06c9399984f service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Received event network-vif-unplugged-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:08:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-525cdd89-1f98-4a33-af23-2a54084db47c req-3c858194-2d3a-4c7b-a962-f06c9399984f service nova] Acquiring lock "ee776e8c-6c86-450c-a020-1778e32e4d9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:08:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-525cdd89-1f98-4a33-af23-2a54084db47c req-3c858194-2d3a-4c7b-a962-f06c9399984f service nova] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:08:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-525cdd89-1f98-4a33-af23-2a54084db47c req-3c858194-2d3a-4c7b-a962-f06c9399984f service nova] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:08:09 user nova-compute[73484]: DEBUG nova.compute.manager [req-525cdd89-1f98-4a33-af23-2a54084db47c req-3c858194-2d3a-4c7b-a962-f06c9399984f service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] No waiting events found dispatching network-vif-unplugged-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:08:09 user nova-compute[73484]: DEBUG nova.compute.manager [req-525cdd89-1f98-4a33-af23-2a54084db47c req-3c858194-2d3a-4c7b-a962-f06c9399984f service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Received event network-vif-unplugged-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 14:08:09 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Instance destroyed successfully.
Aug 14 14:08:09 user nova-compute[73484]: DEBUG nova.objects.instance [None req-70a5beca-0020-4a52-9bc1-c40ca4aa568c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lazy-loading 'resources' on Instance uuid ee776e8c-6c86-450c-a020-1778e32e4d9c {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:08:09 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-70a5beca-0020-4a52-9bc1-c40ca4aa568c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:03:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-530409438',display_name='tempest-TestMinimumBasicScenario-server-530409438',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-530409438',id=44,image_ref='ce87f5cd-6b5d-4429-b657-1801c6e5a64a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSxYsMa2lpFaIzg2BTLUUmAtOBOvy5MRlLHoqnFS9a/fnz22lw4CLm+3C/lSGK4vZ+yXzuyyG9Xw3xej5fA/MKaQWNJBVlRMulQBB5tnrf+EOlakHUGw+CdjPIvZP3uRA==',key_name='tempest-TestMinimumBasicScenario-460265953',keypairs=<?>,launch_index=0,launched_at=2023-08-14T14:03:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1934a2112a584b82a20c4ae8c13a70db',ramdisk_id='',reservation_id='r-h48umtmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ce87f5cd-6b5d-4429-b657-1801c6e5a64a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-227652473',owner_user_name='tempest-TestMinimumBasicScenario-227652473-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T14:05:27Z,user_data=None,user_id='be2ee7c7641d4d0892cc3bc03f8340f1',uuid=ee776e8c-6c86-450c-a020-1778e32e4d9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "address": "fa:16:3e:e0:52:91", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab1c5ec-bc", "ovs_interfaceid": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 14:08:09 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-70a5beca-0020-4a52-9bc1-c40ca4aa568c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Converting VIF {"id": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "address": "fa:16:3e:e0:52:91", "network": {"id": "b63f0a71-864e-4b2c-9602-fd57c50c5501", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1318200030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1934a2112a584b82a20c4ae8c13a70db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab1c5ec-bc", "ovs_interfaceid": "2ab1c5ec-bc00-45c2-9cc0-9a24367e044e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:08:09 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-70a5beca-0020-4a52-9bc1-c40ca4aa568c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:52:91,bridge_name='br-int',has_traffic_filtering=True,id=2ab1c5ec-bc00-45c2-9cc0-9a24367e044e,network=Network(b63f0a71-864e-4b2c-9602-fd57c50c5501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab1c5ec-bc') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:08:09 user nova-compute[73484]: DEBUG os_vif [None req-70a5beca-0020-4a52-9bc1-c40ca4aa568c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:52:91,bridge_name='br-int',has_traffic_filtering=True,id=2ab1c5ec-bc00-45c2-9cc0-9a24367e044e,network=Network(b63f0a71-864e-4b2c-9602-fd57c50c5501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab1c5ec-bc') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 14:08:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:08:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ab1c5ec-bc, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:08:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:08:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:08:09 user nova-compute[73484]: INFO os_vif [None req-70a5beca-0020-4a52-9bc1-c40ca4aa568c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:52:91,bridge_name='br-int',has_traffic_filtering=True,id=2ab1c5ec-bc00-45c2-9cc0-9a24367e044e,network=Network(b63f0a71-864e-4b2c-9602-fd57c50c5501),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab1c5ec-bc')
Aug 14 14:08:09 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-70a5beca-0020-4a52-9bc1-c40ca4aa568c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Deleting instance files /opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c_del
Aug 14 14:08:09 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-70a5beca-0020-4a52-9bc1-c40ca4aa568c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Deletion of /opt/stack/data/nova/instances/ee776e8c-6c86-450c-a020-1778e32e4d9c_del complete
Aug 14 14:08:09 user nova-compute[73484]: INFO nova.compute.manager [None req-70a5beca-0020-4a52-9bc1-c40ca4aa568c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 14 14:08:09 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-70a5beca-0020-4a52-9bc1-c40ca4aa568c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 14:08:09 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 14:08:09 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 14:08:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:08:10 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:08:10 user nova-compute[73484]: DEBUG nova.compute.manager [req-7852d246-3bcc-42b7-af13-1d1469e8cde1 req-f2205b07-4689-49b3-9df5-b84ad9f8146c service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Received event network-vif-deleted-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:08:10 user nova-compute[73484]: INFO nova.compute.manager [req-7852d246-3bcc-42b7-af13-1d1469e8cde1 req-f2205b07-4689-49b3-9df5-b84ad9f8146c service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Neutron deleted interface 2ab1c5ec-bc00-45c2-9cc0-9a24367e044e; detaching it from the instance and deleting it from the info cache
Aug 14 14:08:10 user nova-compute[73484]: DEBUG nova.network.neutron [req-7852d246-3bcc-42b7-af13-1d1469e8cde1 req-f2205b07-4689-49b3-9df5-b84ad9f8146c service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:08:10 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Took 0.53 seconds to deallocate network for instance.
Aug 14 14:08:10 user nova-compute[73484]: DEBUG nova.compute.manager [req-7852d246-3bcc-42b7-af13-1d1469e8cde1 req-f2205b07-4689-49b3-9df5-b84ad9f8146c service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Detach interface failed, port_id=2ab1c5ec-bc00-45c2-9cc0-9a24367e044e, reason: Instance ee776e8c-6c86-450c-a020-1778e32e4d9c could not be found. {{(pid=73484) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 14:08:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-70a5beca-0020-4a52-9bc1-c40ca4aa568c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:08:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-70a5beca-0020-4a52-9bc1-c40ca4aa568c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:08:10 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-70a5beca-0020-4a52-9bc1-c40ca4aa568c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:08:10 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-70a5beca-0020-4a52-9bc1-c40ca4aa568c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:08:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-70a5beca-0020-4a52-9bc1-c40ca4aa568c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:08:10 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-70a5beca-0020-4a52-9bc1-c40ca4aa568c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Deleted allocations for instance ee776e8c-6c86-450c-a020-1778e32e4d9c
Aug 14 14:08:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-70a5beca-0020-4a52-9bc1-c40ca4aa568c tempest-TestMinimumBasicScenario-227652473 tempest-TestMinimumBasicScenario-227652473-project-member] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.898s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:08:11 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:08:11 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:08:11 user nova-compute[73484]: DEBUG nova.compute.manager [req-54023f84-ebdc-4f53-bd69-1cb707e0bcc1 req-75a6f341-c54a-4157-b121-b1d00b9b21d6 service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Received event network-vif-plugged-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:08:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-54023f84-ebdc-4f53-bd69-1cb707e0bcc1 req-75a6f341-c54a-4157-b121-b1d00b9b21d6 service nova] Acquiring lock "ee776e8c-6c86-450c-a020-1778e32e4d9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:08:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-54023f84-ebdc-4f53-bd69-1cb707e0bcc1 req-75a6f341-c54a-4157-b121-b1d00b9b21d6 service nova] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:08:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-54023f84-ebdc-4f53-bd69-1cb707e0bcc1 req-75a6f341-c54a-4157-b121-b1d00b9b21d6 service nova] Lock "ee776e8c-6c86-450c-a020-1778e32e4d9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:08:11 user nova-compute[73484]: DEBUG nova.compute.manager [req-54023f84-ebdc-4f53-bd69-1cb707e0bcc1 req-75a6f341-c54a-4157-b121-b1d00b9b21d6 service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] No waiting events found dispatching network-vif-plugged-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:08:11 user nova-compute[73484]: WARNING nova.compute.manager [req-54023f84-ebdc-4f53-bd69-1cb707e0bcc1 req-75a6f341-c54a-4157-b121-b1d00b9b21d6 service nova] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Received unexpected event network-vif-plugged-2ab1c5ec-bc00-45c2-9cc0-9a24367e044e for instance with vm_state deleted and task_state None.
Aug 14 14:08:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:08:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:08:18 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:08:18 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Cleaning up deleted instances {{(pid=73484) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 14:08:18 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] There are 0 instances to clean {{(pid=73484) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 14:08:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:08:24 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692022089.862775, ee776e8c-6c86-450c-a020-1778e32e4d9c => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:08:24 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] VM Stopped (Lifecycle Event)
Aug 14 14:08:24 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0e64c27e-1065-46f1-af37-42190a2d5cb6 None None] [instance: ee776e8c-6c86-450c-a020-1778e32e4d9c] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:08:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:08:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:08:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:08:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:08:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:08:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:08:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:08:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "f3fdfa01-354e-4b59-9c1c-e82787ddcd02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:08:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "f3fdfa01-354e-4b59-9c1c-e82787ddcd02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:08:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "f3fdfa01-354e-4b59-9c1c-e82787ddcd02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:08:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "f3fdfa01-354e-4b59-9c1c-e82787ddcd02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:08:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "f3fdfa01-354e-4b59-9c1c-e82787ddcd02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:08:31 user nova-compute[73484]: INFO nova.compute.manager [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Terminating instance
Aug 14 14:08:31 user nova-compute[73484]: DEBUG nova.compute.manager [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 14:08:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG nova.compute.manager [req-0925b8ad-0e4b-496b-ba28-94a267dff135 req-57164a06-05c3-4f64-9a7d-3e98cd0e968b service nova] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Received event network-vif-unplugged-631f3e90-984d-443a-baff-c1f4677b6da9 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0925b8ad-0e4b-496b-ba28-94a267dff135 req-57164a06-05c3-4f64-9a7d-3e98cd0e968b service nova] Acquiring lock "f3fdfa01-354e-4b59-9c1c-e82787ddcd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0925b8ad-0e4b-496b-ba28-94a267dff135 req-57164a06-05c3-4f64-9a7d-3e98cd0e968b service nova] Lock "f3fdfa01-354e-4b59-9c1c-e82787ddcd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0925b8ad-0e4b-496b-ba28-94a267dff135 req-57164a06-05c3-4f64-9a7d-3e98cd0e968b service nova] Lock "f3fdfa01-354e-4b59-9c1c-e82787ddcd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG nova.compute.manager [req-0925b8ad-0e4b-496b-ba28-94a267dff135 req-57164a06-05c3-4f64-9a7d-3e98cd0e968b service nova] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] No waiting events found dispatching network-vif-unplugged-631f3e90-984d-443a-baff-c1f4677b6da9 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG nova.compute.manager [req-0925b8ad-0e4b-496b-ba28-94a267dff135 req-57164a06-05c3-4f64-9a7d-3e98cd0e968b service nova] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Received event network-vif-unplugged-631f3e90-984d-443a-baff-c1f4677b6da9 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:08:32 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Instance destroyed successfully.
Aug 14 14:08:32 user nova-compute[73484]: DEBUG nova.objects.instance [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lazy-loading 'resources' on Instance uuid f3fdfa01-354e-4b59-9c1c-e82787ddcd02 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:06:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1165337161',display_name='tempest-TestVolumeBootPattern-server-1165337161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1165337161',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T14:07:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d5f985c3a8447e4870782d5e8709609',ramdisk_id='',reservation_id='r-lju8vn6f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1241691583',owner_user_name='tempest-TestVolumeBootPattern-1241691583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T14:07:01Z,user_data=None,user_id='06a79841cf6743a7bd565a6084383f6c',uuid=f3fdfa01-354e-4b59-9c1c-e82787ddcd02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "631f3e90-984d-443a-baff-c1f4677b6da9", "address": "fa:16:3e:89:d0:2d", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap631f3e90-98", "ovs_interfaceid": "631f3e90-984d-443a-baff-c1f4677b6da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converting VIF {"id": "631f3e90-984d-443a-baff-c1f4677b6da9", "address": "fa:16:3e:89:d0:2d", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap631f3e90-98", "ovs_interfaceid": "631f3e90-984d-443a-baff-c1f4677b6da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:d0:2d,bridge_name='br-int',has_traffic_filtering=True,id=631f3e90-984d-443a-baff-c1f4677b6da9,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap631f3e90-98') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG os_vif [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:d0:2d,bridge_name='br-int',has_traffic_filtering=True,id=631f3e90-984d-443a-baff-c1f4677b6da9,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap631f3e90-98') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap631f3e90-98, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:08:32 user nova-compute[73484]: INFO os_vif [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:d0:2d,bridge_name='br-int',has_traffic_filtering=True,id=631f3e90-984d-443a-baff-c1f4677b6da9,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap631f3e90-98')
Aug 14 14:08:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXxfuUpi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:08:32 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:08:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a5c711-ac5c-4c71-bf53-2cec276a4410]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[5450b17c-7fb2-4270-aef8-c1beaa11992c]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 (non-flash)
Aug 14 14:08:32 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 (non-flash)
Aug 14 14:08:32 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc48806dab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1'): ({'sdd'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Removing single pathed devices sdd {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f472ef5a-6213-4064-acce-306ac9743d88]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb37200-8614-4fd6-b73e-9b6203164e91]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Flushing IO for device /dev/sdd {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[747863a1-c7a1-4796-9f77-912748447ed1]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e514b651-8a6e-4b32-bf09-c2e2d15a9032]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] SCSI volumes sdd have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23636643536383239', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8b4cdaa6', '/dev/disk/by-id/scsi-1SCST_BIO8b4cdaa6-66d5682927d6bfa6') {{(pid=84315) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[610c12b2-e708-45eb-82bf-3d36ba5efc21]: (4, None) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa49ce7-f4a6-41d0-aef0-f7fc6fb9b7bb]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a921e9d-2f17-48ce-9628-c826a25926ef]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1, portal: 172.16.0.220,3260]
Aug 14 14:08:32 user nova-compute[73484]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1, portal: 172.16.0.220,3260] successful.
Aug 14 14:08:32 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3989003d-95dc-4f7d-b59c-27553cf18b5d]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] <== disconnect_volume: return (272ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:08:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 14:08:32 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Deleting instance files /opt/stack/data/nova/instances/f3fdfa01-354e-4b59-9c1c-e82787ddcd02_del
Aug 14 14:08:32 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Deletion of /opt/stack/data/nova/instances/f3fdfa01-354e-4b59-9c1c-e82787ddcd02_del complete
Aug 14 14:08:33 user nova-compute[73484]: INFO nova.compute.manager [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Took 1.10 seconds to destroy the instance on the hypervisor.
Aug 14 14:08:33 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 14:08:33 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 14:08:33 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 14:08:33 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:08:33 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Took 0.43 seconds to deallocate network for instance.
Aug 14 14:08:33 user nova-compute[73484]: DEBUG nova.compute.manager [req-2f2148f9-22cd-4fcd-a74d-a0f15a82f983 req-b0550a4e-22a4-493f-a111-23b4a67f2d0c service nova] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Received event network-vif-deleted-631f3e90-984d-443a-baff-c1f4677b6da9 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:08:34 user nova-compute[73484]: DEBUG nova.compute.manager [req-24df2edd-dc16-46b8-b0ab-d46469ffb538 req-7116a572-e7f5-4cd5-9c94-bc7dbcc5f530 service nova] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Received event network-vif-plugged-631f3e90-984d-443a-baff-c1f4677b6da9 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:08:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-24df2edd-dc16-46b8-b0ab-d46469ffb538 req-7116a572-e7f5-4cd5-9c94-bc7dbcc5f530 service nova] Acquiring lock "f3fdfa01-354e-4b59-9c1c-e82787ddcd02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:08:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-24df2edd-dc16-46b8-b0ab-d46469ffb538 req-7116a572-e7f5-4cd5-9c94-bc7dbcc5f530 service nova] Lock "f3fdfa01-354e-4b59-9c1c-e82787ddcd02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:08:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-24df2edd-dc16-46b8-b0ab-d46469ffb538 req-7116a572-e7f5-4cd5-9c94-bc7dbcc5f530 service nova] Lock "f3fdfa01-354e-4b59-9c1c-e82787ddcd02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:08:34 user nova-compute[73484]: DEBUG nova.compute.manager [req-24df2edd-dc16-46b8-b0ab-d46469ffb538 req-7116a572-e7f5-4cd5-9c94-bc7dbcc5f530 service nova] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] No waiting events found dispatching network-vif-plugged-631f3e90-984d-443a-baff-c1f4677b6da9 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:08:34 user nova-compute[73484]: WARNING nova.compute.manager [req-24df2edd-dc16-46b8-b0ab-d46469ffb538 req-7116a572-e7f5-4cd5-9c94-bc7dbcc5f530 service nova] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Received unexpected event network-vif-plugged-631f3e90-984d-443a-baff-c1f4677b6da9 for instance with vm_state active and task_state deleting.
Aug 14 14:08:34 user nova-compute[73484]: INFO nova.compute.manager [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Took 0.81 seconds to detach 1 volumes for instance.
Aug 14 14:08:34 user nova-compute[73484]: DEBUG nova.compute.manager [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Deleting volume: 5ca286e8-a70d-4260-b3ce-3eb4a46c16a1 {{(pid=73484) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 14:08:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:08:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:08:34 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:08:34 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:08:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:08:34 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Deleted allocations for instance f3fdfa01-354e-4b59-9c1c-e82787ddcd02
Aug 14 14:08:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-fcabf579-0bac-4204-9f6f-c3e6d96391ad tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "f3fdfa01-354e-4b59-9c1c-e82787ddcd02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.802s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:08:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:08:42 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:08:42 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:08:42 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:08:42 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:08:42 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:08:42 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:08:47 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692022112.663293, f3fdfa01-354e-4b59-9c1c-e82787ddcd02 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:08:47 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] VM Stopped (Lifecycle Event)
Aug 14 14:08:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-cd06de2e-f570-4adc-9fdf-5f469c97f340 None None] [instance: f3fdfa01-354e-4b59-9c1c-e82787ddcd02] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:08:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:08:52 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:08:54 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:08:54 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 14:08:54 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Rebuilding the list of instances to heal {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 14:08:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-8bce4703-8877-40ea-8615-323c70a5b47d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:08:54 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-8bce4703-8877-40ea-8615-323c70a5b47d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:08:54 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 14:08:54 user nova-compute[73484]: DEBUG nova.objects.instance [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lazy-loading 'info_cache' on Instance uuid 8bce4703-8877-40ea-8615-323c70a5b47d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:08:55 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Updating instance_info_cache with network_info: [{"id": "8829dabb-317a-48a1-b26f-145fd4a441bc", "address": "fa:16:3e:6b:5d:48", "network": {"id": "e5777564-99ba-44b7-b752-efaf236d840c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-601395130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0208e39a3304b7383d1c01e070a4c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8829dabb-31", "ovs_interfaceid": "8829dabb-317a-48a1-b26f-145fd4a441bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:08:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-8bce4703-8877-40ea-8615-323c70a5b47d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:08:55 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 14:08:55 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:08:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "8bce4703-8877-40ea-8615-323c70a5b47d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:08:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "8bce4703-8877-40ea-8615-323c70a5b47d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:08:57 user nova-compute[73484]: DEBUG nova.objects.instance [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lazy-loading 'flavor' on Instance uuid 8bce4703-8877-40ea-8615-323c70a5b47d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:08:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "8bce4703-8877-40ea-8615-323c70a5b47d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:08:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:08:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "8bce4703-8877-40ea-8615-323c70a5b47d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:08:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "8bce4703-8877-40ea-8615-323c70a5b47d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:08:57 user nova-compute[73484]: INFO nova.compute.manager [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Attaching volume b8ec4691-6b85-42d4-9449-7383453eb6dc to /dev/vdb
Aug 14 14:08:57 user nova-compute[73484]: DEBUG os_brick.utils [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:08:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:08:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:08:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cbb641-3058-47bf-b154-4a6e9cd6e60f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:08:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:08:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:08:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc8f9d0-9950-4758-a8a2-7936743a861f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:08:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:08:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:08:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6000e4-8d25-439e-b19a-0b4de93113b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:08:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e562027-e3cf-4e5d-ab54-45a91a83c464]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:08:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:08:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:08:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 14:08:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:08:57 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:08:57 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 14:08:57 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1391304b-0c81-417b-bbe2-76d87c7504a3]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:08:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 14:08:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 14:08:57 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 14:08:57 user nova-compute[73484]: DEBUG os_brick.utils [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:08:57 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Updating existing volume attachment record: ad175164-90d1-4206-8ac4-2efa2dcbf68c {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 14:09:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:09:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:09:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:09:02 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:09:02 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:09:02 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 14:09:03 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:09:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:09:05 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YFESrWzJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:09:06 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:09:06 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:09:06 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:09:06 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:09:06 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf23401-2ca6-4d97-aa37-265b30eef809]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 14:09:06 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9161340e-50fa-4672-a6e9-10e07cc953f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc] added
Aug 14 14:09:06 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a799f546-5249-481e-831c-373a6f33e474]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec143386-b3cc-4db4-b670-8d9a7e9dcccb]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YFESrWzJ {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YFESrWzJ" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0419c800-fe0d-4e3e-9fbb-7965bdab944b]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YFESrWzJ'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9463a07-5f31-4de9-b5d7-4bf2fe301132]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8438a90c-e3c8-4714-9a86-4839da18b906]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 14:09:06 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 14:09:06 user nova-compute[73484]:  {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:09:06 user nova-compute[73484]: WARNING os_brick.initiator.connectors.iscsi [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 14:09:06 user nova-compute[73484]: 
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83feb97-8356-4e0c-88b3-d1039ef2596c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc, portal: 172.16.0.220,3260]
Aug 14 14:09:06 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc, portal: 172.16.0.220,3260] successful.
Aug 14 14:09:06 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b4f268-9d2d-48f0-a2ce-e486f6d36b41]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[be81f49f-feb2-4d07-b822-8771dd845551]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc (non-flash)
Aug 14 14:09:06 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc (non-flash)
Aug 14 14:09:06 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[10365be3-cc78-4999-a507-cc1575723a33]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:06 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 14:09:07 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 14:09:07 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YFESrWzJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 14:09:07 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:09:07 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23633363636366232', 'path': '/dev/sdb'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:09:07 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633363636366232', 'path': '/dev/sdb'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 14:09:07 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:09:07 user nova-compute[73484]: DEBUG nova.objects.instance [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lazy-loading 'flavor' on Instance uuid 8bce4703-8877-40ea-8615-323c70a5b47d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:09:07 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 14:09:07 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:09:07 user nova-compute[73484]:   <source dev="/dev/sdb"/>
Aug 14 14:09:07 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 14:09:07 user nova-compute[73484]:   <serial>b8ec4691-6b85-42d4-9449-7383453eb6dc</serial>
Aug 14 14:09:07 user nova-compute[73484]: </disk>
Aug 14 14:09:07 user nova-compute[73484]:  {{(pid=73484) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 14:09:07 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:09:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:09:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:09:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:09:07 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 14:09:08 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:08 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:09:08 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:09:08 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] No VIF found with MAC fa:16:3e:6b:5d:48, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:09:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-09b17451-9d5d-44a2-9f1d-170fbdbc3ee9 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "8bce4703-8877-40ea-8615-323c70a5b47d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.597s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:09:08 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:08 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:08 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:08 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 14:09:08 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cf790d-ef81-4a59-8dd3-af036da8b741/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:08 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cf790d-ef81-4a59-8dd3-af036da8b741/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:08 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cf790d-ef81-4a59-8dd3-af036da8b741/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:08 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cf790d-ef81-4a59-8dd3-af036da8b741/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:09 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:09:09 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:09:09 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=8513MB free_disk=25.241283416748047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 14:09:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:09:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:09:09 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 8bce4703-8877-40ea-8615-323c70a5b47d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:09:09 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 03cf790d-ef81-4a59-8dd3-af036da8b741 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:09:09 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 14:09:09 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 14:09:09 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:09:09 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:09:09 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 14:09:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "8bce4703-8877-40ea-8615-323c70a5b47d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "8bce4703-8877-40ea-8615-323c70a5b47d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:09:10 user nova-compute[73484]: INFO nova.compute.manager [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Detaching volume b8ec4691-6b85-42d4-9449-7383453eb6dc
Aug 14 14:09:10 user nova-compute[73484]: INFO nova.virt.block_device [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Attempting to driver detach volume b8ec4691-6b85-42d4-9449-7383453eb6dc from mountpoint /dev/vdb
Aug 14 14:09:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Attempting to detach device vdb from instance 8bce4703-8877-40ea-8615-323c70a5b47d from the persistent domain config. {{(pid=73484) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 14:09:10 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:09:10 user nova-compute[73484]:   <source dev="/dev/sdb"/>
Aug 14 14:09:10 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 14:09:10 user nova-compute[73484]:   <serial>b8ec4691-6b85-42d4-9449-7383453eb6dc</serial>
Aug 14 14:09:10 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 14:09:10 user nova-compute[73484]: </disk>
Aug 14 14:09:10 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 14:09:10 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Successfully detached device vdb from instance 8bce4703-8877-40ea-8615-323c70a5b47d from the persistent domain config.
Aug 14 14:09:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8bce4703-8877-40ea-8615-323c70a5b47d from the live domain config. {{(pid=73484) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 14:09:10 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:09:10 user nova-compute[73484]:   <source dev="/dev/sdb"/>
Aug 14 14:09:10 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 14:09:10 user nova-compute[73484]:   <serial>b8ec4691-6b85-42d4-9449-7383453eb6dc</serial>
Aug 14 14:09:10 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 14:09:10 user nova-compute[73484]: </disk>
Aug 14 14:09:10 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Received event <DeviceRemovedEvent: 1692022150.6216853, 8bce4703-8877-40ea-8615-323c70a5b47d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73484) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8bce4703-8877-40ea-8615-323c70a5b47d {{(pid=73484) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 14:09:10 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Successfully detached device vdb from instance 8bce4703-8877-40ea-8615-323c70a5b47d from the live domain config.
Aug 14 14:09:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YFESrWzJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:09:10 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:09:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda69515-2646-4c18-8515-8086286341e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b04cca-f0e8-4aa2-978c-553a17cfc746]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc (non-flash)
Aug 14 14:09:10 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc (non-flash)
Aug 14 14:09:10 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4587deb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc'): ({'sdb'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Removing single pathed devices sdb {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcce494b-1ac8-4d0e-a3c2-257b6fff8fcb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b1e278-a8bb-4f71-b192-dfdde49cbaac]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Flushing IO for device /dev/sdb {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[67513e84-7eb3-4fc1-af74-34f8eceb36ee]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0638dbc-08b5-4b71-a680-123833f19b65]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] SCSI volumes sdb have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73e876c-fe8a-4d8b-8670-0e170c316480]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c86ebd-c043-4bce-b7a3-f1b9017be84e]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc, portal: 172.16.0.220,3260]
Aug 14 14:09:10 user nova-compute[73484]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc, portal: 172.16.0.220,3260] successful.
Aug 14 14:09:10 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8ec4691-6b85-42d4-9449-7383453eb6dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d3e003-88ee-46ce-8e7f-a171e2bf93d2]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.254s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] <== disconnect_volume: return (256ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:09:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 14:09:11 user nova-compute[73484]: DEBUG nova.objects.instance [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lazy-loading 'flavor' on Instance uuid 8bce4703-8877-40ea-8615-323c70a5b47d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:09:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-8ed484bd-a813-4c36-b71f-c76e8256c107 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "8bce4703-8877-40ea-8615-323c70a5b47d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.588s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:09:12 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:09:12 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:09:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:09:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:09:16 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:09:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:09:22 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:09:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:09:29 user nova-compute[73484]: DEBUG nova.compute.manager [req-6562f3da-cd9a-4687-9082-317041dd1c0e req-9a4a4bd4-a9c0-474d-a140-670ed71b0eae service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Received event network-changed-de3e32f0-9cda-404c-887c-e80e4c261827 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:09:29 user nova-compute[73484]: DEBUG nova.compute.manager [req-6562f3da-cd9a-4687-9082-317041dd1c0e req-9a4a4bd4-a9c0-474d-a140-670ed71b0eae service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Refreshing instance network info cache due to event network-changed-de3e32f0-9cda-404c-887c-e80e4c261827. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:09:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6562f3da-cd9a-4687-9082-317041dd1c0e req-9a4a4bd4-a9c0-474d-a140-670ed71b0eae service nova] Acquiring lock "refresh_cache-03cf790d-ef81-4a59-8dd3-af036da8b741" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:09:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6562f3da-cd9a-4687-9082-317041dd1c0e req-9a4a4bd4-a9c0-474d-a140-670ed71b0eae service nova] Acquired lock "refresh_cache-03cf790d-ef81-4a59-8dd3-af036da8b741" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:09:29 user nova-compute[73484]: DEBUG nova.network.neutron [req-6562f3da-cd9a-4687-9082-317041dd1c0e req-9a4a4bd4-a9c0-474d-a140-670ed71b0eae service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Refreshing network info cache for port de3e32f0-9cda-404c-887c-e80e4c261827 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:09:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:09:30 user nova-compute[73484]: DEBUG nova.network.neutron [req-6562f3da-cd9a-4687-9082-317041dd1c0e req-9a4a4bd4-a9c0-474d-a140-670ed71b0eae service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Updated VIF entry in instance network info cache for port de3e32f0-9cda-404c-887c-e80e4c261827. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:09:30 user nova-compute[73484]: DEBUG nova.network.neutron [req-6562f3da-cd9a-4687-9082-317041dd1c0e req-9a4a4bd4-a9c0-474d-a140-670ed71b0eae service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Updating instance_info_cache with network_info: [{"id": "de3e32f0-9cda-404c-887c-e80e4c261827", "address": "fa:16:3e:a1:3d:37", "network": {"id": "c009336f-39d9-4498-b6d5-fad59509221a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-503385962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921f66eafb204995915231c86e234e62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3e32f0-9c", "ovs_interfaceid": "de3e32f0-9cda-404c-887c-e80e4c261827", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:09:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-6562f3da-cd9a-4687-9082-317041dd1c0e req-9a4a4bd4-a9c0-474d-a140-670ed71b0eae service nova] Releasing lock "refresh_cache-03cf790d-ef81-4a59-8dd3-af036da8b741" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:09:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:09:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Acquiring lock "03cf790d-ef81-4a59-8dd3-af036da8b741" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:09:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lock "03cf790d-ef81-4a59-8dd3-af036da8b741" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:09:33 user nova-compute[73484]: DEBUG nova.objects.instance [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lazy-loading 'flavor' on Instance uuid 03cf790d-ef81-4a59-8dd3-af036da8b741 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:09:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lock "03cf790d-ef81-4a59-8dd3-af036da8b741" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:09:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Acquiring lock "03cf790d-ef81-4a59-8dd3-af036da8b741" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:09:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lock "03cf790d-ef81-4a59-8dd3-af036da8b741" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:09:33 user nova-compute[73484]: INFO nova.compute.manager [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Attaching volume c1371cd8-a18b-4d84-b2c1-e51bb9126f3c to /dev/vdb
Aug 14 14:09:33 user nova-compute[73484]: DEBUG os_brick.utils [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:09:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2398f9c6-9b3c-4e67-8985-140b25cfe737]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb8390d-e549-4821-92dd-84effa23018e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af96ba5-40a3-4eb8-a0f8-c51dce41c9e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[93da0692-8c25-497a-83de-5bbf476cd6b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:09:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 14:09:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:33 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:09:33 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 14:09:33 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc642b0-9883-4983-af2e-23c1c5a349dc]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 14:09:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 14:09:33 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 14:09:33 user nova-compute[73484]: DEBUG os_brick.utils [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:09:33 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Updating existing volume attachment record: 518d18ae-fba2-430d-99af-da97b9a4abb5 {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 14:09:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:09:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:09:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YuTiWGQr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:09:42 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:09:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:09:42 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:09:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:09:42 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31f61fc-ac48-4d79-86ed-cdd06f34b6f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 14:09:42 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a13748-5b15-426c-bf17-344673ae7816]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c] added
Aug 14 14:09:42 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d0186b-38be-4e6e-986e-aa1459b49b1a]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c14d8f-b18a-4877-9b3a-a9c86c2292cb]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YuTiWGQr {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YuTiWGQr" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc624d8-e935-4c96-ba72-c4d781dacf07]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YuTiWGQr'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97a7311-0801-4356-b72e-3248a6c55816]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[871592da-4b31-418c-899b-72d1c9e31ab5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 14:09:42 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 14:09:42 user nova-compute[73484]:  {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:09:42 user nova-compute[73484]: WARNING os_brick.initiator.connectors.iscsi [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 14:09:42 user nova-compute[73484]: 
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[56961b8c-8369-47fb-9aba-872108ae4d01]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c, portal: 172.16.0.220,3260]
Aug 14 14:09:42 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c, portal: 172.16.0.220,3260] successful.
Aug 14 14:09:42 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[06127e60-1afe-4477-8e5f-1849e96d6de8]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1793bbf-1b49-4c07-8ee8-773af0a2b300]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c (non-flash)
Aug 14 14:09:42 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c (non-flash)
Aug 14 14:09:42 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d825e2d-b4a7-40c3-9edb-5eee90fc3bc2]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 14:09:42 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YuTiWGQr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 14:09:43 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:09:43 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23630306363363761', 'path': '/dev/sdb'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:09:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630306363363761', 'path': '/dev/sdb'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 14:09:43 user nova-compute[73484]: DEBUG nova.objects.instance [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lazy-loading 'flavor' on Instance uuid 03cf790d-ef81-4a59-8dd3-af036da8b741 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:09:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 14:09:43 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:09:43 user nova-compute[73484]:   <source dev="/dev/sdb"/>
Aug 14 14:09:43 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 14:09:43 user nova-compute[73484]:   <serial>c1371cd8-a18b-4d84-b2c1-e51bb9126f3c</serial>
Aug 14 14:09:43 user nova-compute[73484]: </disk>
Aug 14 14:09:43 user nova-compute[73484]:  {{(pid=73484) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 14:09:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "428bf363-4ef9-437c-ad18-0be7c560e08d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:09:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "428bf363-4ef9-437c-ad18-0be7c560e08d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:09:43 user nova-compute[73484]: DEBUG nova.compute.manager [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 14:09:44 user nova-compute[73484]: INFO nova.compute.claims [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Claim successful on node user
Aug 14 14:09:44 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] No VIF found with MAC fa:16:3e:a1:3d:37, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.238s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG nova.compute.manager [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG nova.compute.manager [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG nova.network.neutron [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 14:09:44 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 14:09:44 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-f0f22cbb-7b32-44bc-8ead-754328c2e782 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lock "03cf790d-ef81-4a59-8dd3-af036da8b741" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.629s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG nova.compute.manager [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 14:09:44 user nova-compute[73484]: INFO nova.virt.block_device [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Booting with volume a5f78209-d56b-4229-a103-b8d0471feb46 at /dev/vda
Aug 14 14:09:44 user nova-compute[73484]: DEBUG nova.policy [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06a79841cf6743a7bd565a6084383f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f985c3a8447e4870782d5e8709609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG os_brick.utils [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7427aa-9816-4ff0-a485-3d6601fe399f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c713b1-d1d2-4b09-b6f3-3e3421e70c2e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11adfe9-c485-4894-8c21-673a136c0f3b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa329595-5701-4e61-bd39-c9e70313f96c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:09:44 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 14:09:44 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[41061f91-5a73-4aa1-a8d5-17b88758a725]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG os_brick.utils [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:09:44 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Updating existing volume attachment record: 376a63fa-c0bd-4eee-a2c3-c3559cbd8a04 {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 14:09:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:09:45 user nova-compute[73484]: DEBUG nova.network.neutron [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Successfully created port: 9be38d4d-8bea-41c2-a726-311fa7b05784 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG nova.network.neutron [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Successfully updated port: 9be38d4d-8bea-41c2-a726-311fa7b05784 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "refresh_cache-428bf363-4ef9-437c-ad18-0be7c560e08d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquired lock "refresh_cache-428bf363-4ef9-437c-ad18-0be7c560e08d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG nova.network.neutron [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG nova.compute.manager [req-db1e044e-3991-4608-89a7-0a3af9812ac6 req-2e24cea9-03f0-4f93-aa8d-3d6133b51f66 service nova] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Received event network-changed-9be38d4d-8bea-41c2-a726-311fa7b05784 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG nova.compute.manager [req-db1e044e-3991-4608-89a7-0a3af9812ac6 req-2e24cea9-03f0-4f93-aa8d-3d6133b51f66 service nova] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Refreshing instance network info cache due to event network-changed-9be38d4d-8bea-41c2-a726-311fa7b05784. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-db1e044e-3991-4608-89a7-0a3af9812ac6 req-2e24cea9-03f0-4f93-aa8d-3d6133b51f66 service nova] Acquiring lock "refresh_cache-428bf363-4ef9-437c-ad18-0be7c560e08d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG nova.network.neutron [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Acquiring lock "03cf790d-ef81-4a59-8dd3-af036da8b741" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lock "03cf790d-ef81-4a59-8dd3-af036da8b741" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:09:46 user nova-compute[73484]: INFO nova.compute.manager [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Detaching volume c1371cd8-a18b-4d84-b2c1-e51bb9126f3c
Aug 14 14:09:46 user nova-compute[73484]: INFO nova.virt.block_device [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Attempting to driver detach volume c1371cd8-a18b-4d84-b2c1-e51bb9126f3c from mountpoint /dev/vdb
Aug 14 14:09:46 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Attempting to detach device vdb from instance 03cf790d-ef81-4a59-8dd3-af036da8b741 from the persistent domain config. {{(pid=73484) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 14:09:46 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:09:46 user nova-compute[73484]:   <source dev="/dev/sdb"/>
Aug 14 14:09:46 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 14:09:46 user nova-compute[73484]:   <serial>c1371cd8-a18b-4d84-b2c1-e51bb9126f3c</serial>
Aug 14 14:09:46 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 14:09:46 user nova-compute[73484]: </disk>
Aug 14 14:09:46 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 14:09:46 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Successfully detached device vdb from instance 03cf790d-ef81-4a59-8dd3-af036da8b741 from the persistent domain config.
Aug 14 14:09:46 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 03cf790d-ef81-4a59-8dd3-af036da8b741 from the live domain config. {{(pid=73484) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG nova.virt.libvirt.guest [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 14:09:46 user nova-compute[73484]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:09:46 user nova-compute[73484]:   <source dev="/dev/sdb"/>
Aug 14 14:09:46 user nova-compute[73484]:   <target dev="vdb" bus="virtio"/>
Aug 14 14:09:46 user nova-compute[73484]:   <serial>c1371cd8-a18b-4d84-b2c1-e51bb9126f3c</serial>
Aug 14 14:09:46 user nova-compute[73484]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 14:09:46 user nova-compute[73484]: </disk>
Aug 14 14:09:46 user nova-compute[73484]:  {{(pid=73484) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG nova.network.neutron [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Updating instance_info_cache with network_info: [{"id": "9be38d4d-8bea-41c2-a726-311fa7b05784", "address": "fa:16:3e:3e:41:90", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9be38d4d-8b", "ovs_interfaceid": "9be38d4d-8bea-41c2-a726-311fa7b05784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Releasing lock "refresh_cache-428bf363-4ef9-437c-ad18-0be7c560e08d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG nova.compute.manager [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Instance network_info: |[{"id": "9be38d4d-8bea-41c2-a726-311fa7b05784", "address": "fa:16:3e:3e:41:90", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9be38d4d-8b", "ovs_interfaceid": "9be38d4d-8bea-41c2-a726-311fa7b05784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-db1e044e-3991-4608-89a7-0a3af9812ac6 req-2e24cea9-03f0-4f93-aa8d-3d6133b51f66 service nova] Acquired lock "refresh_cache-428bf363-4ef9-437c-ad18-0be7c560e08d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG nova.network.neutron [req-db1e044e-3991-4608-89a7-0a3af9812ac6 req-2e24cea9-03f0-4f93-aa8d-3d6133b51f66 service nova] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Refreshing network info cache for port 9be38d4d-8bea-41c2-a726-311fa7b05784 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Received event <DeviceRemovedEvent: 1692022186.746673, 03cf790d-ef81-4a59-8dd3-af036da8b741 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73484) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 03cf790d-ef81-4a59-8dd3-af036da8b741 {{(pid=73484) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 14:09:46 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Successfully detached device vdb from instance 03cf790d-ef81-4a59-8dd3-af036da8b741 from the live domain config.
Aug 14 14:09:46 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YuTiWGQr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:09:46 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:09:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd000904-63be-4fb1-82ad-539d959fca38]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d5efd2-2903-47c4-b09b-04984b1d10a5]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c (non-flash)
Aug 14 14:09:46 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c (non-flash)
Aug 14 14:09:46 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4586e63b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c'): ({'sdb'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Removing single pathed devices sdb {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d306e95d-8600-446d-b3a2-406b62192d26]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0589d1-1d71-453b-b5a0-962a0b9e5a41]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Flushing IO for device /dev/sdb {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ac74a2-0071-4b07-9ce4-c30b73edf1e6]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6416702a-ad1a-4a50-9778-5380989e088a]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] SCSI volumes sdb have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e3cd7d-697a-4626-b9a2-e4fd490577b3]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4870b5ac-8259-4d1f-9ac1-ef0c4f8163e1]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c, portal: 172.16.0.220,3260]
Aug 14 14:09:46 user nova-compute[73484]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c, portal: 172.16.0.220,3260] successful.
Aug 14 14:09:46 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:09:46 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1371cd8-a18b-4d84-b2c1-e51bb9126f3c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:47 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[97207c30-e27d-461f-b50b-ba058e979f70]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:09:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.254s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:09:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] <== disconnect_volume: return (255ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:09:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 14:09:47 user nova-compute[73484]: DEBUG nova.network.neutron [req-db1e044e-3991-4608-89a7-0a3af9812ac6 req-2e24cea9-03f0-4f93-aa8d-3d6133b51f66 service nova] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Updated VIF entry in instance network info cache for port 9be38d4d-8bea-41c2-a726-311fa7b05784. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:09:47 user nova-compute[73484]: DEBUG nova.network.neutron [req-db1e044e-3991-4608-89a7-0a3af9812ac6 req-2e24cea9-03f0-4f93-aa8d-3d6133b51f66 service nova] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Updating instance_info_cache with network_info: [{"id": "9be38d4d-8bea-41c2-a726-311fa7b05784", "address": "fa:16:3e:3e:41:90", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9be38d4d-8b", "ovs_interfaceid": "9be38d4d-8bea-41c2-a726-311fa7b05784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:09:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-db1e044e-3991-4608-89a7-0a3af9812ac6 req-2e24cea9-03f0-4f93-aa8d-3d6133b51f66 service nova] Releasing lock "refresh_cache-428bf363-4ef9-437c-ad18-0be7c560e08d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:09:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:09:47 user nova-compute[73484]: DEBUG nova.objects.instance [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lazy-loading 'flavor' on Instance uuid 03cf790d-ef81-4a59-8dd3-af036da8b741 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:09:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-479a3a12-1c0e-4427-87c1-0d5cb603a6e4 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lock "03cf790d-ef81-4a59-8dd3-af036da8b741" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.564s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:09:52 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:09:52 user nova-compute[73484]: DEBUG nova.compute.manager [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 14:09:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 14:09:52 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Creating image(s)
Aug 14 14:09:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Did not create local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 14:09:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Ensure instance console log exists: /opt/stack/data/nova/instances/428bf363-4ef9-437c-ad18-0be7c560e08d/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 14:09:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:09:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:09:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:09:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Start _get_guest_xml network_info=[{"id": "9be38d4d-8bea-41c2-a726-311fa7b05784", "address": "fa:16:3e:3e:41:90", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9be38d4d-8b", "ovs_interfaceid": "9be38d4d-8bea-41c2-a726-311fa7b05784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '376a63fa-c0bd-4eee-a2c3-c3559cbd8a04', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GQBkAWIS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '428bf363-4ef9-437c-ad18-0be7c560e08d', 'attached_at': '', 'detached_at': '', 'volume_id': 'a5f78209-d56b-4229-a103-b8d0471feb46', 'serial': 'a5f78209-d56b-4229-a103-b8d0471feb46'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 14:09:52 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:09:52 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:09:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 14:09:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 14:09:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 14:09:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 14:09:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 14:09:52 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 14:09:52 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 14:09:52 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 14:09:52 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 14:09:52 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 14:09:52 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 14:09:52 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 14:09:52 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 14:09:52 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 14:09:52 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 14:09:52 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 14:09:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 14:09:52 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GQBkAWIS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:09:52 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:09:52 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:09:52 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:09:52 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:09:52 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:09:52 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:09:52 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 14:09:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:52 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ebac01-9c4b-4201-9af9-14ae827a622f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:52 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 14:09:52 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:09:52 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ae197d-d927-4cf8-a018-9068f280ffaf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46] added
Aug 14 14:09:53 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7efa210-a88f-41b9-938d-fd06ac062bf7]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[865e5ca3-bcd4-4f85-836d-5765c9fca53a]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GQBkAWIS {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GQBkAWIS" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[da23d074-0fdc-4ab6-856d-31f802b45e61]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GQBkAWIS'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d179cb-c5cf-4407-9523-33e432a5a693]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9c78f1-896e-43c4-85e2-4c3ba19c632c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 14:09:53 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 14:09:53 user nova-compute[73484]:  {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:09:53 user nova-compute[73484]: WARNING os_brick.initiator.connectors.iscsi [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 14:09:53 user nova-compute[73484]: 
Aug 14 14:09:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc430ef-8f29-4133-a114-2a18e22dfafe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46, portal: 172.16.0.220,3260]
Aug 14 14:09:53 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46, portal: 172.16.0.220,3260] successful.
Aug 14 14:09:53 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40d14d6-30d2-4bff-8050-343a55b2a3d5]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8e3e03-59f8-4927-a83b-ff2e9c7d05eb]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 (non-flash)
Aug 14 14:09:53 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 (non-flash)
Aug 14 14:09:53 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8e7300-4575-483c-9334-6292fdcb980f]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 14:09:53 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GQBkAWIS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 14:09:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:09:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26539373132633833', 'path': '/dev/sdb'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:09:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539373132633833', 'path': '/dev/sdb'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 14:09:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1957592995',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1957592995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1957592995',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmJqvS/iJnZEfEiFdalZKM9NnIAnSumwe5+OGy4HlmOr4vPJQ35Ip5EoUbdNrgvI4K8xTNYs+JkTXOKgP8nuPOK6E1UwC+iKNSxbMykNjWXYJ9uRSBK9FfIebetG761aw==',key_name='tempest-keypair-812835151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d5f985c3a8447e4870782d5e8709609',ramdisk_id='',reservation_id='r-njrxht4w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1241691583',owner_user_name='tempest-TestVolumeBootPattern-1241691583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:09:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06a79841cf6743a7bd565a6084383f6c',uuid=428bf363-4ef9-437c-ad18-0be7c560e08d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9be38d4d-8bea-41c2-a726-311fa7b05784", "address": "fa:16:3e:3e:41:90", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9be38d4d-8b", "ovs_interfaceid": "9be38d4d-8bea-41c2-a726-311fa7b05784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 14:09:54 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converting VIF {"id": "9be38d4d-8bea-41c2-a726-311fa7b05784", "address": "fa:16:3e:3e:41:90", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9be38d4d-8b", "ovs_interfaceid": "9be38d4d-8bea-41c2-a726-311fa7b05784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:09:54 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:41:90,bridge_name='br-int',has_traffic_filtering=True,id=9be38d4d-8bea-41c2-a726-311fa7b05784,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9be38d4d-8b') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:09:54 user nova-compute[73484]: DEBUG nova.objects.instance [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lazy-loading 'pci_devices' on Instance uuid 428bf363-4ef9-437c-ad18-0be7c560e08d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:09:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] End _get_guest_xml xml=<domain type="kvm">
Aug 14 14:09:54 user nova-compute[73484]:   <uuid>428bf363-4ef9-437c-ad18-0be7c560e08d</uuid>
Aug 14 14:09:54 user nova-compute[73484]:   <name>instance-00000030</name>
Aug 14 14:09:54 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 14:09:54 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 14:09:54 user nova-compute[73484]:   <metadata>
Aug 14 14:09:54 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 14:09:54 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 14:09:54 user nova-compute[73484]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1957592995</nova:name>
Aug 14 14:09:54 user nova-compute[73484]:       <nova:creationTime>2023-08-14 14:09:52</nova:creationTime>
Aug 14 14:09:54 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 14:09:54 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 14:09:54 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 14:09:54 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 14:09:54 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 14:09:54 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 14:09:54 user nova-compute[73484]:       </nova:flavor>
Aug 14 14:09:54 user nova-compute[73484]:       <nova:owner>
Aug 14 14:09:54 user nova-compute[73484]:         <nova:user uuid="06a79841cf6743a7bd565a6084383f6c">tempest-TestVolumeBootPattern-1241691583-project-member</nova:user>
Aug 14 14:09:54 user nova-compute[73484]:         <nova:project uuid="1d5f985c3a8447e4870782d5e8709609">tempest-TestVolumeBootPattern-1241691583</nova:project>
Aug 14 14:09:54 user nova-compute[73484]:       </nova:owner>
Aug 14 14:09:54 user nova-compute[73484]:       <nova:ports>
Aug 14 14:09:54 user nova-compute[73484]:         <nova:port uuid="9be38d4d-8bea-41c2-a726-311fa7b05784">
Aug 14 14:09:54 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 14:09:54 user nova-compute[73484]:         </nova:port>
Aug 14 14:09:54 user nova-compute[73484]:       </nova:ports>
Aug 14 14:09:54 user nova-compute[73484]:     </nova:instance>
Aug 14 14:09:54 user nova-compute[73484]:   </metadata>
Aug 14 14:09:54 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 14:09:54 user nova-compute[73484]:     <system>
Aug 14 14:09:54 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 14:09:54 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 14:09:54 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 14:09:54 user nova-compute[73484]:       <entry name="serial">428bf363-4ef9-437c-ad18-0be7c560e08d</entry>
Aug 14 14:09:54 user nova-compute[73484]:       <entry name="uuid">428bf363-4ef9-437c-ad18-0be7c560e08d</entry>
Aug 14 14:09:54 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 14:09:54 user nova-compute[73484]:     </system>
Aug 14 14:09:54 user nova-compute[73484]:   </sysinfo>
Aug 14 14:09:54 user nova-compute[73484]:   <os>
Aug 14 14:09:54 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 14:09:54 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 14:09:54 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 14:09:54 user nova-compute[73484]:   </os>
Aug 14 14:09:54 user nova-compute[73484]:   <features>
Aug 14 14:09:54 user nova-compute[73484]:     <acpi/>
Aug 14 14:09:54 user nova-compute[73484]:     <apic/>
Aug 14 14:09:54 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 14:09:54 user nova-compute[73484]:   </features>
Aug 14 14:09:54 user nova-compute[73484]:   <clock offset="utc">
Aug 14 14:09:54 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 14:09:54 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 14:09:54 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 14:09:54 user nova-compute[73484]:   </clock>
Aug 14 14:09:54 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 14:09:54 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 14:09:54 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 14:09:54 user nova-compute[73484]:   </cpu>
Aug 14 14:09:54 user nova-compute[73484]:   <devices>
Aug 14 14:09:54 user nova-compute[73484]:     <disk type="block" device="disk">
Aug 14 14:09:54 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:09:54 user nova-compute[73484]:       <source dev="/dev/sdb"/>
Aug 14 14:09:54 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 14:09:54 user nova-compute[73484]:       <serial>a5f78209-d56b-4229-a103-b8d0471feb46</serial>
Aug 14 14:09:54 user nova-compute[73484]:     </disk>
Aug 14 14:09:54 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 14:09:54 user nova-compute[73484]:       <mac address="fa:16:3e:3e:41:90"/>
Aug 14 14:09:54 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 14:09:54 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 14:09:54 user nova-compute[73484]:       <target dev="tap9be38d4d-8b"/>
Aug 14 14:09:54 user nova-compute[73484]:     </interface>
Aug 14 14:09:54 user nova-compute[73484]:     <serial type="pty">
Aug 14 14:09:54 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/428bf363-4ef9-437c-ad18-0be7c560e08d/console.log" append="off"/>
Aug 14 14:09:54 user nova-compute[73484]:     </serial>
Aug 14 14:09:54 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 14:09:54 user nova-compute[73484]:     <video>
Aug 14 14:09:54 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 14:09:54 user nova-compute[73484]:     </video>
Aug 14 14:09:54 user nova-compute[73484]:     <rng model="virtio">
Aug 14 14:09:54 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 14:09:54 user nova-compute[73484]:     </rng>
Aug 14 14:09:54 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 14:09:54 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 14:09:54 user nova-compute[73484]:       <stats period="10"/>
Aug 14 14:09:54 user nova-compute[73484]:     </memballoon>
Aug 14 14:09:54 user nova-compute[73484]:   </devices>
Aug 14 14:09:54 user nova-compute[73484]: </domain>
Aug 14 14:09:54 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 14:09:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1957592995',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1957592995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1957592995',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmJqvS/iJnZEfEiFdalZKM9NnIAnSumwe5+OGy4HlmOr4vPJQ35Ip5EoUbdNrgvI4K8xTNYs+JkTXOKgP8nuPOK6E1UwC+iKNSxbMykNjWXYJ9uRSBK9FfIebetG761aw==',key_name='tempest-keypair-812835151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d5f985c3a8447e4870782d5e8709609',ramdisk_id='',reservation_id='r-njrxht4w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1241691583',owner_user_name='tempest-TestVolumeBootPattern-1241691583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:09:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06a79841cf6743a7bd565a6084383f6c',uuid=428bf363-4ef9-437c-ad18-0be7c560e08d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9be38d4d-8bea-41c2-a726-311fa7b05784", "address": "fa:16:3e:3e:41:90", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9be38d4d-8b", "ovs_interfaceid": "9be38d4d-8bea-41c2-a726-311fa7b05784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 14:09:54 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converting VIF {"id": "9be38d4d-8bea-41c2-a726-311fa7b05784", "address": "fa:16:3e:3e:41:90", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9be38d4d-8b", "ovs_interfaceid": "9be38d4d-8bea-41c2-a726-311fa7b05784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:09:54 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:41:90,bridge_name='br-int',has_traffic_filtering=True,id=9be38d4d-8bea-41c2-a726-311fa7b05784,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9be38d4d-8b') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:09:54 user nova-compute[73484]: DEBUG os_vif [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:41:90,bridge_name='br-int',has_traffic_filtering=True,id=9be38d4d-8bea-41c2-a726-311fa7b05784,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9be38d4d-8b') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 14:09:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:09:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:09:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 14:09:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:09:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9be38d4d-8b, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:09:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9be38d4d-8b, col_values=(('external_ids', {'iface-id': '9be38d4d-8bea-41c2-a726-311fa7b05784', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:41:90', 'vm-uuid': '428bf363-4ef9-437c-ad18-0be7c560e08d'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:09:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:09:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:09:54 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:09:54 user nova-compute[73484]: INFO os_vif [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:41:90,bridge_name='br-int',has_traffic_filtering=True,id=9be38d4d-8bea-41c2-a726-311fa7b05784,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9be38d4d-8b')
Aug 14 14:09:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:09:54 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] No VIF found with MAC fa:16:3e:3e:41:90, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:09:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:09:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:09:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:09:55 user nova-compute[73484]: DEBUG nova.compute.manager [req-835205ea-cfdc-4b86-9557-2265ad0d8752 req-5250e7f9-1dc1-4235-b47a-9025fc835d63 service nova] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Received event network-vif-plugged-9be38d4d-8bea-41c2-a726-311fa7b05784 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:09:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-835205ea-cfdc-4b86-9557-2265ad0d8752 req-5250e7f9-1dc1-4235-b47a-9025fc835d63 service nova] Acquiring lock "428bf363-4ef9-437c-ad18-0be7c560e08d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:09:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-835205ea-cfdc-4b86-9557-2265ad0d8752 req-5250e7f9-1dc1-4235-b47a-9025fc835d63 service nova] Lock "428bf363-4ef9-437c-ad18-0be7c560e08d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:09:55 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-835205ea-cfdc-4b86-9557-2265ad0d8752 req-5250e7f9-1dc1-4235-b47a-9025fc835d63 service nova] Lock "428bf363-4ef9-437c-ad18-0be7c560e08d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:09:55 user nova-compute[73484]: DEBUG nova.compute.manager [req-835205ea-cfdc-4b86-9557-2265ad0d8752 req-5250e7f9-1dc1-4235-b47a-9025fc835d63 service nova] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] No waiting events found dispatching network-vif-plugged-9be38d4d-8bea-41c2-a726-311fa7b05784 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:09:55 user nova-compute[73484]: WARNING nova.compute.manager [req-835205ea-cfdc-4b86-9557-2265ad0d8752 req-5250e7f9-1dc1-4235-b47a-9025fc835d63 service nova] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Received unexpected event network-vif-plugged-9be38d4d-8bea-41c2-a726-311fa7b05784 for instance with vm_state building and task_state spawning.
Aug 14 14:09:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:09:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:09:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:09:56 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:09:56 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 14:09:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-03cf790d-ef81-4a59-8dd3-af036da8b741" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:09:56 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-03cf790d-ef81-4a59-8dd3-af036da8b741" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:09:56 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 14:09:57 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Updating instance_info_cache with network_info: [{"id": "de3e32f0-9cda-404c-887c-e80e4c261827", "address": "fa:16:3e:a1:3d:37", "network": {"id": "c009336f-39d9-4498-b6d5-fad59509221a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-503385962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921f66eafb204995915231c86e234e62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3e32f0-9c", "ovs_interfaceid": "de3e32f0-9cda-404c-887c-e80e4c261827", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:09:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-03cf790d-ef81-4a59-8dd3-af036da8b741" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:09:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 14:09:57 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:09:57 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692022197.6142418, 428bf363-4ef9-437c-ad18-0be7c560e08d => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:09:57 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] VM Resumed (Lifecycle Event)
Aug 14 14:09:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 14:09:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 14:09:57 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Instance spawned successfully.
Aug 14 14:09:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 14:09:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:09:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:09:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:09:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:09:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:09:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:09:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:09:57 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:09:57 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:09:57 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692022197.6170444, 428bf363-4ef9-437c-ad18-0be7c560e08d => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:09:57 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] VM Started (Lifecycle Event)
Aug 14 14:09:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:09:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:09:57 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:09:57 user nova-compute[73484]: INFO nova.compute.manager [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Took 4.81 seconds to spawn the instance on the hypervisor.
Aug 14 14:09:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:09:57 user nova-compute[73484]: INFO nova.compute.manager [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Took 13.81 seconds to build instance.
Aug 14 14:09:57 user nova-compute[73484]: DEBUG nova.compute.manager [req-b2a7d1a2-1cb3-4024-b321-617af08d973f req-76118356-88c5-4751-944c-3b36203f7ae0 service nova] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Received event network-vif-plugged-9be38d4d-8bea-41c2-a726-311fa7b05784 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:09:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b2a7d1a2-1cb3-4024-b321-617af08d973f req-76118356-88c5-4751-944c-3b36203f7ae0 service nova] Acquiring lock "428bf363-4ef9-437c-ad18-0be7c560e08d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:09:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b2a7d1a2-1cb3-4024-b321-617af08d973f req-76118356-88c5-4751-944c-3b36203f7ae0 service nova] Lock "428bf363-4ef9-437c-ad18-0be7c560e08d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:09:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-b2a7d1a2-1cb3-4024-b321-617af08d973f req-76118356-88c5-4751-944c-3b36203f7ae0 service nova] Lock "428bf363-4ef9-437c-ad18-0be7c560e08d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:09:57 user nova-compute[73484]: DEBUG nova.compute.manager [req-b2a7d1a2-1cb3-4024-b321-617af08d973f req-76118356-88c5-4751-944c-3b36203f7ae0 service nova] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] No waiting events found dispatching network-vif-plugged-9be38d4d-8bea-41c2-a726-311fa7b05784 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:09:57 user nova-compute[73484]: WARNING nova.compute.manager [req-b2a7d1a2-1cb3-4024-b321-617af08d973f req-76118356-88c5-4751-944c-3b36203f7ae0 service nova] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Received unexpected event network-vif-plugged-9be38d4d-8bea-41c2-a726-311fa7b05784 for instance with vm_state active and task_state None.
Aug 14 14:09:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c6c2dbfa-0416-4d4c-a7c5-cb55f9f01b7f tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "428bf363-4ef9-437c-ad18-0be7c560e08d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.925s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:09:59 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:02 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:10:04 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:04 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:10:04 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 14:10:05 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:10:06 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:10:09 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:09 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:10:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:10:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:10:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:10:09 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 14:10:09 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:10:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:10:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:10:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:10:10 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 14:10:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cf790d-ef81-4a59-8dd3-af036da8b741/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:10:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cf790d-ef81-4a59-8dd3-af036da8b741/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:10:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cf790d-ef81-4a59-8dd3-af036da8b741/disk --force-share --output=json {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:10:10 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03cf790d-ef81-4a59-8dd3-af036da8b741/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:10:11 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:10:11 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:10:11 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=8380MB free_disk=25.230396270751953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 14:10:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:10:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:10:11 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 8bce4703-8877-40ea-8615-323c70a5b47d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:10:11 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 03cf790d-ef81-4a59-8dd3-af036da8b741 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:10:11 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 428bf363-4ef9-437c-ad18-0be7c560e08d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:10:11 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 14:10:11 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 14:10:11 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:10:11 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:10:11 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 14:10:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:10:12 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:10:12 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:10:14 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:10:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:19 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:24 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:10:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:10:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:10:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:10:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d7c323e7-5df8-4034-8887-668e37abe000 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "8bce4703-8877-40ea-8615-323c70a5b47d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:10:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d7c323e7-5df8-4034-8887-668e37abe000 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "8bce4703-8877-40ea-8615-323c70a5b47d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:10:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d7c323e7-5df8-4034-8887-668e37abe000 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "8bce4703-8877-40ea-8615-323c70a5b47d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:10:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d7c323e7-5df8-4034-8887-668e37abe000 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "8bce4703-8877-40ea-8615-323c70a5b47d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:10:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d7c323e7-5df8-4034-8887-668e37abe000 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "8bce4703-8877-40ea-8615-323c70a5b47d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:10:39 user nova-compute[73484]: INFO nova.compute.manager [None req-d7c323e7-5df8-4034-8887-668e37abe000 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Terminating instance
Aug 14 14:10:39 user nova-compute[73484]: DEBUG nova.compute.manager [None req-d7c323e7-5df8-4034-8887-668e37abe000 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 14:10:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-da947de1-5dfc-4444-81da-c40431c5bbb7 req-530bc4d1-a841-4862-82df-ddf3a58fc34d service nova] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Received event network-vif-unplugged-8829dabb-317a-48a1-b26f-145fd4a441bc {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:10:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-da947de1-5dfc-4444-81da-c40431c5bbb7 req-530bc4d1-a841-4862-82df-ddf3a58fc34d service nova] Acquiring lock "8bce4703-8877-40ea-8615-323c70a5b47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:10:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-da947de1-5dfc-4444-81da-c40431c5bbb7 req-530bc4d1-a841-4862-82df-ddf3a58fc34d service nova] Lock "8bce4703-8877-40ea-8615-323c70a5b47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:10:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-da947de1-5dfc-4444-81da-c40431c5bbb7 req-530bc4d1-a841-4862-82df-ddf3a58fc34d service nova] Lock "8bce4703-8877-40ea-8615-323c70a5b47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:10:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-da947de1-5dfc-4444-81da-c40431c5bbb7 req-530bc4d1-a841-4862-82df-ddf3a58fc34d service nova] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] No waiting events found dispatching network-vif-unplugged-8829dabb-317a-48a1-b26f-145fd4a441bc {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:10:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-da947de1-5dfc-4444-81da-c40431c5bbb7 req-530bc4d1-a841-4862-82df-ddf3a58fc34d service nova] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Received event network-vif-unplugged-8829dabb-317a-48a1-b26f-145fd4a441bc for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 14:10:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:39 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Instance destroyed successfully.
Aug 14 14:10:39 user nova-compute[73484]: DEBUG nova.objects.instance [None req-d7c323e7-5df8-4034-8887-668e37abe000 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lazy-loading 'resources' on Instance uuid 8bce4703-8877-40ea-8615-323c70a5b47d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:10:39 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-d7c323e7-5df8-4034-8887-668e37abe000 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:03:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2119523497',display_name='tempest-SnapshotDataIntegrityTests-server-2119523497',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2119523497',id=45,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZ4QdAOOweDDTW/BK5hy3/iPFTeQSYkg1GsGm6eMu4D/y/FSJySa798ATMfDog5OnNNFHlfPBWYpsnFbl4MScVRUmtKz3eh3O5TVJWy6BncrjRxjgBe7YTwy68SUeMUtQ==',key_name='tempest-keypair-1658362240',keypairs=<?>,launch_index=0,launched_at=2023-08-14T14:03:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0208e39a3304b7383d1c01e070a4c01',ramdisk_id='',reservation_id='r-e7whamu7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-917109927',owner_user_name='tempest-SnapshotDataIntegrityTests-917109927-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T14:03:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a8689f4ffa4140f1a94a61206ae011a3',uuid=8bce4703-8877-40ea-8615-323c70a5b47d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8829dabb-317a-48a1-b26f-145fd4a441bc", "address": "fa:16:3e:6b:5d:48", "network": {"id": "e5777564-99ba-44b7-b752-efaf236d840c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-601395130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0208e39a3304b7383d1c01e070a4c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8829dabb-31", "ovs_interfaceid": "8829dabb-317a-48a1-b26f-145fd4a441bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 14:10:39 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-d7c323e7-5df8-4034-8887-668e37abe000 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Converting VIF {"id": "8829dabb-317a-48a1-b26f-145fd4a441bc", "address": "fa:16:3e:6b:5d:48", "network": {"id": "e5777564-99ba-44b7-b752-efaf236d840c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-601395130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0208e39a3304b7383d1c01e070a4c01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8829dabb-31", "ovs_interfaceid": "8829dabb-317a-48a1-b26f-145fd4a441bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:10:39 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-d7c323e7-5df8-4034-8887-668e37abe000 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:5d:48,bridge_name='br-int',has_traffic_filtering=True,id=8829dabb-317a-48a1-b26f-145fd4a441bc,network=Network(e5777564-99ba-44b7-b752-efaf236d840c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8829dabb-31') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:10:39 user nova-compute[73484]: DEBUG os_vif [None req-d7c323e7-5df8-4034-8887-668e37abe000 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:5d:48,bridge_name='br-int',has_traffic_filtering=True,id=8829dabb-317a-48a1-b26f-145fd4a441bc,network=Network(e5777564-99ba-44b7-b752-efaf236d840c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8829dabb-31') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 14:10:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8829dabb-31, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:10:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:10:39 user nova-compute[73484]: INFO os_vif [None req-d7c323e7-5df8-4034-8887-668e37abe000 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:5d:48,bridge_name='br-int',has_traffic_filtering=True,id=8829dabb-317a-48a1-b26f-145fd4a441bc,network=Network(e5777564-99ba-44b7-b752-efaf236d840c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8829dabb-31')
Aug 14 14:10:39 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-d7c323e7-5df8-4034-8887-668e37abe000 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Deleting instance files /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d_del
Aug 14 14:10:39 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-d7c323e7-5df8-4034-8887-668e37abe000 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Deletion of /opt/stack/data/nova/instances/8bce4703-8877-40ea-8615-323c70a5b47d_del complete
Aug 14 14:10:40 user nova-compute[73484]: INFO nova.compute.manager [None req-d7c323e7-5df8-4034-8887-668e37abe000 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 14 14:10:40 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-d7c323e7-5df8-4034-8887-668e37abe000 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 14:10:40 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 14:10:40 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 14:10:41 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:10:41 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Took 0.99 seconds to deallocate network for instance.
Aug 14 14:10:41 user nova-compute[73484]: DEBUG nova.compute.manager [req-50068052-58f7-45eb-9e5c-bc3d38dc3886 req-4a4422af-5948-48ec-969f-b3dea342f0fe service nova] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Received event network-vif-deleted-8829dabb-317a-48a1-b26f-145fd4a441bc {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:10:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d7c323e7-5df8-4034-8887-668e37abe000 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:10:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d7c323e7-5df8-4034-8887-668e37abe000 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:10:41 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-d7c323e7-5df8-4034-8887-668e37abe000 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:10:41 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-d7c323e7-5df8-4034-8887-668e37abe000 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:10:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d7c323e7-5df8-4034-8887-668e37abe000 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.234s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:10:41 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-d7c323e7-5df8-4034-8887-668e37abe000 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Deleted allocations for instance 8bce4703-8877-40ea-8615-323c70a5b47d
Aug 14 14:10:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-d7c323e7-5df8-4034-8887-668e37abe000 tempest-SnapshotDataIntegrityTests-917109927 tempest-SnapshotDataIntegrityTests-917109927-project-member] Lock "8bce4703-8877-40ea-8615-323c70a5b47d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.310s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:10:41 user nova-compute[73484]: DEBUG nova.compute.manager [req-aca63ff6-295c-4fb3-be65-b750f8ec1b6c req-a1f66023-8dfc-4be3-b5cc-aff6b4bb03bb service nova] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Received event network-vif-plugged-8829dabb-317a-48a1-b26f-145fd4a441bc {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:10:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-aca63ff6-295c-4fb3-be65-b750f8ec1b6c req-a1f66023-8dfc-4be3-b5cc-aff6b4bb03bb service nova] Acquiring lock "8bce4703-8877-40ea-8615-323c70a5b47d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:10:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-aca63ff6-295c-4fb3-be65-b750f8ec1b6c req-a1f66023-8dfc-4be3-b5cc-aff6b4bb03bb service nova] Lock "8bce4703-8877-40ea-8615-323c70a5b47d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:10:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-aca63ff6-295c-4fb3-be65-b750f8ec1b6c req-a1f66023-8dfc-4be3-b5cc-aff6b4bb03bb service nova] Lock "8bce4703-8877-40ea-8615-323c70a5b47d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:10:41 user nova-compute[73484]: DEBUG nova.compute.manager [req-aca63ff6-295c-4fb3-be65-b750f8ec1b6c req-a1f66023-8dfc-4be3-b5cc-aff6b4bb03bb service nova] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] No waiting events found dispatching network-vif-plugged-8829dabb-317a-48a1-b26f-145fd4a441bc {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:10:41 user nova-compute[73484]: WARNING nova.compute.manager [req-aca63ff6-295c-4fb3-be65-b750f8ec1b6c req-a1f66023-8dfc-4be3-b5cc-aff6b4bb03bb service nova] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Received unexpected event network-vif-plugged-8829dabb-317a-48a1-b26f-145fd4a441bc for instance with vm_state deleted and task_state None.
Aug 14 14:10:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9dac6cec-24b9-47b7-b545-ac343cd26616 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Acquiring lock "03cf790d-ef81-4a59-8dd3-af036da8b741" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:10:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9dac6cec-24b9-47b7-b545-ac343cd26616 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lock "03cf790d-ef81-4a59-8dd3-af036da8b741" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:10:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9dac6cec-24b9-47b7-b545-ac343cd26616 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Acquiring lock "03cf790d-ef81-4a59-8dd3-af036da8b741-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:10:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9dac6cec-24b9-47b7-b545-ac343cd26616 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lock "03cf790d-ef81-4a59-8dd3-af036da8b741-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:10:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9dac6cec-24b9-47b7-b545-ac343cd26616 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lock "03cf790d-ef81-4a59-8dd3-af036da8b741-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:10:43 user nova-compute[73484]: INFO nova.compute.manager [None req-9dac6cec-24b9-47b7-b545-ac343cd26616 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Terminating instance
Aug 14 14:10:43 user nova-compute[73484]: DEBUG nova.compute.manager [None req-9dac6cec-24b9-47b7-b545-ac343cd26616 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 14:10:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:43 user nova-compute[73484]: DEBUG nova.compute.manager [req-ef1178fa-b96b-4506-804d-d7034ad07d0b req-6b248984-21f3-4489-884b-fe4814eca91d service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Received event network-vif-unplugged-de3e32f0-9cda-404c-887c-e80e4c261827 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:10:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ef1178fa-b96b-4506-804d-d7034ad07d0b req-6b248984-21f3-4489-884b-fe4814eca91d service nova] Acquiring lock "03cf790d-ef81-4a59-8dd3-af036da8b741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:10:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ef1178fa-b96b-4506-804d-d7034ad07d0b req-6b248984-21f3-4489-884b-fe4814eca91d service nova] Lock "03cf790d-ef81-4a59-8dd3-af036da8b741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:10:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ef1178fa-b96b-4506-804d-d7034ad07d0b req-6b248984-21f3-4489-884b-fe4814eca91d service nova] Lock "03cf790d-ef81-4a59-8dd3-af036da8b741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:10:43 user nova-compute[73484]: DEBUG nova.compute.manager [req-ef1178fa-b96b-4506-804d-d7034ad07d0b req-6b248984-21f3-4489-884b-fe4814eca91d service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] No waiting events found dispatching network-vif-unplugged-de3e32f0-9cda-404c-887c-e80e4c261827 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:10:43 user nova-compute[73484]: DEBUG nova.compute.manager [req-ef1178fa-b96b-4506-804d-d7034ad07d0b req-6b248984-21f3-4489-884b-fe4814eca91d service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Received event network-vif-unplugged-de3e32f0-9cda-404c-887c-e80e4c261827 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 14:10:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:43 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Instance destroyed successfully.
Aug 14 14:10:43 user nova-compute[73484]: DEBUG nova.objects.instance [None req-9dac6cec-24b9-47b7-b545-ac343cd26616 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lazy-loading 'resources' on Instance uuid 03cf790d-ef81-4a59-8dd3-af036da8b741 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:10:43 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-9dac6cec-24b9-47b7-b545-ac343cd26616 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:07:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1760024785',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1760024785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1760024',id=47,image_ref='35547d66-318f-468f-9286-e10554f69bf8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMK6FTUVlpEstZsKBfvNiVROkVdgZCZ44mhVUHerOnfqQoFqK4nVmYwYa8qC2eUyBq6mql7HaVni/xX6m5vwaNaqz8KPjZDhPA9qlVvMzKGhJeE39ULS4IyC3cIvcDCrmA==',key_name='tempest-keypair-1183284852',keypairs=<?>,launch_index=0,launched_at=2023-08-14T14:07:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='921f66eafb204995915231c86e234e62',ramdisk_id='',reservation_id='r-sz44k3nm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='35547d66-318f-468f-9286-e10554f69bf8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-401699136',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T14:07:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52a1092e60ba417dbfcf19eabf6da784',uuid=03cf790d-ef81-4a59-8dd3-af036da8b741,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de3e32f0-9cda-404c-887c-e80e4c261827", "address": "fa:16:3e:a1:3d:37", "network": {"id": "c009336f-39d9-4498-b6d5-fad59509221a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-503385962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921f66eafb204995915231c86e234e62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3e32f0-9c", "ovs_interfaceid": "de3e32f0-9cda-404c-887c-e80e4c261827", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 14:10:43 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-9dac6cec-24b9-47b7-b545-ac343cd26616 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Converting VIF {"id": "de3e32f0-9cda-404c-887c-e80e4c261827", "address": "fa:16:3e:a1:3d:37", "network": {"id": "c009336f-39d9-4498-b6d5-fad59509221a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-503385962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921f66eafb204995915231c86e234e62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3e32f0-9c", "ovs_interfaceid": "de3e32f0-9cda-404c-887c-e80e4c261827", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:10:43 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-9dac6cec-24b9-47b7-b545-ac343cd26616 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:3d:37,bridge_name='br-int',has_traffic_filtering=True,id=de3e32f0-9cda-404c-887c-e80e4c261827,network=Network(c009336f-39d9-4498-b6d5-fad59509221a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3e32f0-9c') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:10:43 user nova-compute[73484]: DEBUG os_vif [None req-9dac6cec-24b9-47b7-b545-ac343cd26616 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:3d:37,bridge_name='br-int',has_traffic_filtering=True,id=de3e32f0-9cda-404c-887c-e80e4c261827,network=Network(c009336f-39d9-4498-b6d5-fad59509221a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3e32f0-9c') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 14:10:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde3e32f0-9c, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:10:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:43 user nova-compute[73484]: INFO os_vif [None req-9dac6cec-24b9-47b7-b545-ac343cd26616 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:3d:37,bridge_name='br-int',has_traffic_filtering=True,id=de3e32f0-9cda-404c-887c-e80e4c261827,network=Network(c009336f-39d9-4498-b6d5-fad59509221a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3e32f0-9c')
Aug 14 14:10:43 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-9dac6cec-24b9-47b7-b545-ac343cd26616 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Deleting instance files /opt/stack/data/nova/instances/03cf790d-ef81-4a59-8dd3-af036da8b741_del
Aug 14 14:10:43 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-9dac6cec-24b9-47b7-b545-ac343cd26616 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Deletion of /opt/stack/data/nova/instances/03cf790d-ef81-4a59-8dd3-af036da8b741_del complete
Aug 14 14:10:44 user nova-compute[73484]: INFO nova.compute.manager [None req-9dac6cec-24b9-47b7-b545-ac343cd26616 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 14 14:10:44 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-9dac6cec-24b9-47b7-b545-ac343cd26616 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 14:10:44 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 14:10:44 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 14:10:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:44 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:45 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:10:45 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Took 1.43 seconds to deallocate network for instance.
Aug 14 14:10:45 user nova-compute[73484]: DEBUG nova.compute.manager [req-e18cd6c2-9675-4e07-8470-e68480b3a0f7 req-80e0ee12-b682-4534-bcb3-e791ba631aff service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Received event network-vif-plugged-de3e32f0-9cda-404c-887c-e80e4c261827 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:10:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e18cd6c2-9675-4e07-8470-e68480b3a0f7 req-80e0ee12-b682-4534-bcb3-e791ba631aff service nova] Acquiring lock "03cf790d-ef81-4a59-8dd3-af036da8b741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:10:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e18cd6c2-9675-4e07-8470-e68480b3a0f7 req-80e0ee12-b682-4534-bcb3-e791ba631aff service nova] Lock "03cf790d-ef81-4a59-8dd3-af036da8b741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:10:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e18cd6c2-9675-4e07-8470-e68480b3a0f7 req-80e0ee12-b682-4534-bcb3-e791ba631aff service nova] Lock "03cf790d-ef81-4a59-8dd3-af036da8b741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:10:45 user nova-compute[73484]: DEBUG nova.compute.manager [req-e18cd6c2-9675-4e07-8470-e68480b3a0f7 req-80e0ee12-b682-4534-bcb3-e791ba631aff service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] No waiting events found dispatching network-vif-plugged-de3e32f0-9cda-404c-887c-e80e4c261827 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:10:45 user nova-compute[73484]: WARNING nova.compute.manager [req-e18cd6c2-9675-4e07-8470-e68480b3a0f7 req-80e0ee12-b682-4534-bcb3-e791ba631aff service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Received unexpected event network-vif-plugged-de3e32f0-9cda-404c-887c-e80e4c261827 for instance with vm_state active and task_state deleting.
Aug 14 14:10:45 user nova-compute[73484]: DEBUG nova.compute.manager [req-e18cd6c2-9675-4e07-8470-e68480b3a0f7 req-80e0ee12-b682-4534-bcb3-e791ba631aff service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Received event network-vif-plugged-de3e32f0-9cda-404c-887c-e80e4c261827 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:10:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e18cd6c2-9675-4e07-8470-e68480b3a0f7 req-80e0ee12-b682-4534-bcb3-e791ba631aff service nova] Acquiring lock "03cf790d-ef81-4a59-8dd3-af036da8b741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:10:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e18cd6c2-9675-4e07-8470-e68480b3a0f7 req-80e0ee12-b682-4534-bcb3-e791ba631aff service nova] Lock "03cf790d-ef81-4a59-8dd3-af036da8b741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:10:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e18cd6c2-9675-4e07-8470-e68480b3a0f7 req-80e0ee12-b682-4534-bcb3-e791ba631aff service nova] Lock "03cf790d-ef81-4a59-8dd3-af036da8b741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:10:45 user nova-compute[73484]: DEBUG nova.compute.manager [req-e18cd6c2-9675-4e07-8470-e68480b3a0f7 req-80e0ee12-b682-4534-bcb3-e791ba631aff service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] No waiting events found dispatching network-vif-plugged-de3e32f0-9cda-404c-887c-e80e4c261827 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:10:45 user nova-compute[73484]: WARNING nova.compute.manager [req-e18cd6c2-9675-4e07-8470-e68480b3a0f7 req-80e0ee12-b682-4534-bcb3-e791ba631aff service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Received unexpected event network-vif-plugged-de3e32f0-9cda-404c-887c-e80e4c261827 for instance with vm_state active and task_state deleting.
Aug 14 14:10:45 user nova-compute[73484]: DEBUG nova.compute.manager [req-e18cd6c2-9675-4e07-8470-e68480b3a0f7 req-80e0ee12-b682-4534-bcb3-e791ba631aff service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Received event network-vif-plugged-de3e32f0-9cda-404c-887c-e80e4c261827 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:10:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e18cd6c2-9675-4e07-8470-e68480b3a0f7 req-80e0ee12-b682-4534-bcb3-e791ba631aff service nova] Acquiring lock "03cf790d-ef81-4a59-8dd3-af036da8b741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:10:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e18cd6c2-9675-4e07-8470-e68480b3a0f7 req-80e0ee12-b682-4534-bcb3-e791ba631aff service nova] Lock "03cf790d-ef81-4a59-8dd3-af036da8b741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:10:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e18cd6c2-9675-4e07-8470-e68480b3a0f7 req-80e0ee12-b682-4534-bcb3-e791ba631aff service nova] Lock "03cf790d-ef81-4a59-8dd3-af036da8b741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:10:45 user nova-compute[73484]: DEBUG nova.compute.manager [req-e18cd6c2-9675-4e07-8470-e68480b3a0f7 req-80e0ee12-b682-4534-bcb3-e791ba631aff service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] No waiting events found dispatching network-vif-plugged-de3e32f0-9cda-404c-887c-e80e4c261827 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:10:45 user nova-compute[73484]: WARNING nova.compute.manager [req-e18cd6c2-9675-4e07-8470-e68480b3a0f7 req-80e0ee12-b682-4534-bcb3-e791ba631aff service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Received unexpected event network-vif-plugged-de3e32f0-9cda-404c-887c-e80e4c261827 for instance with vm_state active and task_state deleting.
Aug 14 14:10:45 user nova-compute[73484]: DEBUG nova.compute.manager [req-e18cd6c2-9675-4e07-8470-e68480b3a0f7 req-80e0ee12-b682-4534-bcb3-e791ba631aff service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Received event network-vif-unplugged-de3e32f0-9cda-404c-887c-e80e4c261827 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:10:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e18cd6c2-9675-4e07-8470-e68480b3a0f7 req-80e0ee12-b682-4534-bcb3-e791ba631aff service nova] Acquiring lock "03cf790d-ef81-4a59-8dd3-af036da8b741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:10:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e18cd6c2-9675-4e07-8470-e68480b3a0f7 req-80e0ee12-b682-4534-bcb3-e791ba631aff service nova] Lock "03cf790d-ef81-4a59-8dd3-af036da8b741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:10:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e18cd6c2-9675-4e07-8470-e68480b3a0f7 req-80e0ee12-b682-4534-bcb3-e791ba631aff service nova] Lock "03cf790d-ef81-4a59-8dd3-af036da8b741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:10:45 user nova-compute[73484]: DEBUG nova.compute.manager [req-e18cd6c2-9675-4e07-8470-e68480b3a0f7 req-80e0ee12-b682-4534-bcb3-e791ba631aff service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] No waiting events found dispatching network-vif-unplugged-de3e32f0-9cda-404c-887c-e80e4c261827 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:10:45 user nova-compute[73484]: DEBUG nova.compute.manager [req-e18cd6c2-9675-4e07-8470-e68480b3a0f7 req-80e0ee12-b682-4534-bcb3-e791ba631aff service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Received event network-vif-unplugged-de3e32f0-9cda-404c-887c-e80e4c261827 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 14:10:45 user nova-compute[73484]: DEBUG nova.compute.manager [req-e18cd6c2-9675-4e07-8470-e68480b3a0f7 req-80e0ee12-b682-4534-bcb3-e791ba631aff service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Received event network-vif-plugged-de3e32f0-9cda-404c-887c-e80e4c261827 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:10:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e18cd6c2-9675-4e07-8470-e68480b3a0f7 req-80e0ee12-b682-4534-bcb3-e791ba631aff service nova] Acquiring lock "03cf790d-ef81-4a59-8dd3-af036da8b741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:10:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e18cd6c2-9675-4e07-8470-e68480b3a0f7 req-80e0ee12-b682-4534-bcb3-e791ba631aff service nova] Lock "03cf790d-ef81-4a59-8dd3-af036da8b741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:10:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e18cd6c2-9675-4e07-8470-e68480b3a0f7 req-80e0ee12-b682-4534-bcb3-e791ba631aff service nova] Lock "03cf790d-ef81-4a59-8dd3-af036da8b741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:10:45 user nova-compute[73484]: DEBUG nova.compute.manager [req-e18cd6c2-9675-4e07-8470-e68480b3a0f7 req-80e0ee12-b682-4534-bcb3-e791ba631aff service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] No waiting events found dispatching network-vif-plugged-de3e32f0-9cda-404c-887c-e80e4c261827 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:10:45 user nova-compute[73484]: WARNING nova.compute.manager [req-e18cd6c2-9675-4e07-8470-e68480b3a0f7 req-80e0ee12-b682-4534-bcb3-e791ba631aff service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Received unexpected event network-vif-plugged-de3e32f0-9cda-404c-887c-e80e4c261827 for instance with vm_state active and task_state deleting.
Aug 14 14:10:45 user nova-compute[73484]: DEBUG nova.compute.manager [req-e18cd6c2-9675-4e07-8470-e68480b3a0f7 req-80e0ee12-b682-4534-bcb3-e791ba631aff service nova] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Received event network-vif-deleted-de3e32f0-9cda-404c-887c-e80e4c261827 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:10:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9dac6cec-24b9-47b7-b545-ac343cd26616 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:10:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9dac6cec-24b9-47b7-b545-ac343cd26616 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:10:45 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-9dac6cec-24b9-47b7-b545-ac343cd26616 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:10:45 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-9dac6cec-24b9-47b7-b545-ac343cd26616 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:10:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9dac6cec-24b9-47b7-b545-ac343cd26616 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.138s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:10:45 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-9dac6cec-24b9-47b7-b545-ac343cd26616 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Deleted allocations for instance 03cf790d-ef81-4a59-8dd3-af036da8b741
Aug 14 14:10:45 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-9dac6cec-24b9-47b7-b545-ac343cd26616 tempest-TestServerVolumeAttachScenarioOldVersion-401699136 tempest-TestServerVolumeAttachScenarioOldVersion-401699136-project-member] Lock "03cf790d-ef81-4a59-8dd3-af036da8b741" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.756s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:10:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:54 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692022239.9440722, 8bce4703-8877-40ea-8615-323c70a5b47d => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:10:54 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] VM Stopped (Lifecycle Event)
Aug 14 14:10:54 user nova-compute[73484]: DEBUG nova.compute.manager [None req-304464b6-1030-448a-9dc4-7fa96dac4cf0 None None] [instance: 8bce4703-8877-40ea-8615-323c70a5b47d] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:10:57 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:10:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 14:10:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Rebuilding the list of instances to heal {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 14:10:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-428bf363-4ef9-437c-ad18-0be7c560e08d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:10:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-428bf363-4ef9-437c-ad18-0be7c560e08d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:10:57 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 14:10:57 user nova-compute[73484]: DEBUG nova.objects.instance [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lazy-loading 'info_cache' on Instance uuid 428bf363-4ef9-437c-ad18-0be7c560e08d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:10:58 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Updating instance_info_cache with network_info: [{"id": "9be38d4d-8bea-41c2-a726-311fa7b05784", "address": "fa:16:3e:3e:41:90", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9be38d4d-8b", "ovs_interfaceid": "9be38d4d-8bea-41c2-a726-311fa7b05784", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:10:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-428bf363-4ef9-437c-ad18-0be7c560e08d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:10:58 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 14:10:58 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692022243.7937694, 03cf790d-ef81-4a59-8dd3-af036da8b741 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:10:58 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] VM Stopped (Lifecycle Event)
Aug 14 14:10:58 user nova-compute[73484]: DEBUG nova.compute.manager [None req-16d0374e-e269-46e9-8760-ecf9d183bb77 None None] [instance: 03cf790d-ef81-4a59-8dd3-af036da8b741] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:10:58 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:10:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:10:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:10:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:10:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:10:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:10:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:11:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:11:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:11:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:11:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:11:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:11:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:11:04 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:11:04 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:11:04 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 14:11:06 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:11:07 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:11:08 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:11:09 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:11:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:11:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:11:09 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:11:09 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 14:11:09 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 14:11:10 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:11:10 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:11:10 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=8665MB free_disk=25.2850341796875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 14:11:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:11:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:11:10 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 428bf363-4ef9-437c-ad18-0be7c560e08d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:11:10 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 14:11:10 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 14:11:10 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:11:10 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:11:10 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 14:11:10 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:11:13 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:11:13 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:11:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:11:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:11:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:11:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:11:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:11:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:11:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:11:20 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:11:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:11:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:11:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:11:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:11:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:11:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:11:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:11:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:11:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:11:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:11:35 user nova-compute[73484]: DEBUG nova.compute.manager [req-9c384247-eeb6-473c-a623-a259fab97b66 req-5f73e94c-8071-4532-a8ee-5188a7b7c40d service nova] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Received event network-changed-9be38d4d-8bea-41c2-a726-311fa7b05784 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:11:35 user nova-compute[73484]: DEBUG nova.compute.manager [req-9c384247-eeb6-473c-a623-a259fab97b66 req-5f73e94c-8071-4532-a8ee-5188a7b7c40d service nova] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Refreshing instance network info cache due to event network-changed-9be38d4d-8bea-41c2-a726-311fa7b05784. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:11:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-9c384247-eeb6-473c-a623-a259fab97b66 req-5f73e94c-8071-4532-a8ee-5188a7b7c40d service nova] Acquiring lock "refresh_cache-428bf363-4ef9-437c-ad18-0be7c560e08d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:11:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-9c384247-eeb6-473c-a623-a259fab97b66 req-5f73e94c-8071-4532-a8ee-5188a7b7c40d service nova] Acquired lock "refresh_cache-428bf363-4ef9-437c-ad18-0be7c560e08d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:11:35 user nova-compute[73484]: DEBUG nova.network.neutron [req-9c384247-eeb6-473c-a623-a259fab97b66 req-5f73e94c-8071-4532-a8ee-5188a7b7c40d service nova] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Refreshing network info cache for port 9be38d4d-8bea-41c2-a726-311fa7b05784 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:11:36 user nova-compute[73484]: DEBUG nova.network.neutron [req-9c384247-eeb6-473c-a623-a259fab97b66 req-5f73e94c-8071-4532-a8ee-5188a7b7c40d service nova] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Updated VIF entry in instance network info cache for port 9be38d4d-8bea-41c2-a726-311fa7b05784. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:11:36 user nova-compute[73484]: DEBUG nova.network.neutron [req-9c384247-eeb6-473c-a623-a259fab97b66 req-5f73e94c-8071-4532-a8ee-5188a7b7c40d service nova] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Updating instance_info_cache with network_info: [{"id": "9be38d4d-8bea-41c2-a726-311fa7b05784", "address": "fa:16:3e:3e:41:90", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9be38d4d-8b", "ovs_interfaceid": "9be38d4d-8bea-41c2-a726-311fa7b05784", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:11:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-9c384247-eeb6-473c-a623-a259fab97b66 req-5f73e94c-8071-4532-a8ee-5188a7b7c40d service nova] Releasing lock "refresh_cache-428bf363-4ef9-437c-ad18-0be7c560e08d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:11:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:11:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:11:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:11:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:11:42 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:11:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:11:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:11:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "a057a243-1b1e-4a28-bd37-03856298a77f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:11:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "a057a243-1b1e-4a28-bd37-03856298a77f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:11:48 user nova-compute[73484]: DEBUG nova.compute.manager [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 14:11:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:11:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:11:48 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 14:11:48 user nova-compute[73484]: INFO nova.compute.claims [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Claim successful on node user
Aug 14 14:11:48 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:11:48 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:11:48 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.236s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:11:48 user nova-compute[73484]: DEBUG nova.compute.manager [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 14:11:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:11:48 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 14:11:48 user nova-compute[73484]: DEBUG nova.compute.manager [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 14:11:48 user nova-compute[73484]: DEBUG nova.network.neutron [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 14:11:48 user nova-compute[73484]: DEBUG nova.compute.manager [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 14:11:48 user nova-compute[73484]: INFO nova.virt.block_device [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Booting with volume snapshot 37d8626f-2feb-4af2-b127-47a42d2f3951 at /dev/vda
Aug 14 14:11:49 user nova-compute[73484]: DEBUG nova.policy [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06a79841cf6743a7bd565a6084383f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f985c3a8447e4870782d5e8709609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 14:11:49 user nova-compute[73484]: DEBUG nova.network.neutron [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Successfully created port: 973164ed-3436-4924-999d-f9635ad0f1e1 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 14:11:51 user nova-compute[73484]: DEBUG nova.network.neutron [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Successfully updated port: 973164ed-3436-4924-999d-f9635ad0f1e1 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 14:11:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "refresh_cache-a057a243-1b1e-4a28-bd37-03856298a77f" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:11:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquired lock "refresh_cache-a057a243-1b1e-4a28-bd37-03856298a77f" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:11:51 user nova-compute[73484]: DEBUG nova.network.neutron [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 14:11:51 user nova-compute[73484]: DEBUG nova.compute.manager [req-61ddf448-326c-48a7-b3c5-15616df4da56 req-80a05e8b-6f49-4308-b30b-06d5d4d7d98d service nova] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Received event network-changed-973164ed-3436-4924-999d-f9635ad0f1e1 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:11:51 user nova-compute[73484]: DEBUG nova.compute.manager [req-61ddf448-326c-48a7-b3c5-15616df4da56 req-80a05e8b-6f49-4308-b30b-06d5d4d7d98d service nova] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Refreshing instance network info cache due to event network-changed-973164ed-3436-4924-999d-f9635ad0f1e1. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:11:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-61ddf448-326c-48a7-b3c5-15616df4da56 req-80a05e8b-6f49-4308-b30b-06d5d4d7d98d service nova] Acquiring lock "refresh_cache-a057a243-1b1e-4a28-bd37-03856298a77f" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:11:51 user nova-compute[73484]: DEBUG nova.network.neutron [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 14:11:51 user nova-compute[73484]: DEBUG nova.network.neutron [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Updating instance_info_cache with network_info: [{"id": "973164ed-3436-4924-999d-f9635ad0f1e1", "address": "fa:16:3e:2c:ba:71", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973164ed-34", "ovs_interfaceid": "973164ed-3436-4924-999d-f9635ad0f1e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:11:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Releasing lock "refresh_cache-a057a243-1b1e-4a28-bd37-03856298a77f" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:11:51 user nova-compute[73484]: DEBUG nova.compute.manager [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Instance network_info: |[{"id": "973164ed-3436-4924-999d-f9635ad0f1e1", "address": "fa:16:3e:2c:ba:71", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973164ed-34", "ovs_interfaceid": "973164ed-3436-4924-999d-f9635ad0f1e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 14:11:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-61ddf448-326c-48a7-b3c5-15616df4da56 req-80a05e8b-6f49-4308-b30b-06d5d4d7d98d service nova] Acquired lock "refresh_cache-a057a243-1b1e-4a28-bd37-03856298a77f" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:11:51 user nova-compute[73484]: DEBUG nova.network.neutron [req-61ddf448-326c-48a7-b3c5-15616df4da56 req-80a05e8b-6f49-4308-b30b-06d5d4d7d98d service nova] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Refreshing network info cache for port 973164ed-3436-4924-999d-f9635ad0f1e1 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:11:51 user nova-compute[73484]: DEBUG nova.network.neutron [req-61ddf448-326c-48a7-b3c5-15616df4da56 req-80a05e8b-6f49-4308-b30b-06d5d4d7d98d service nova] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Updated VIF entry in instance network info cache for port 973164ed-3436-4924-999d-f9635ad0f1e1. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:11:51 user nova-compute[73484]: DEBUG nova.network.neutron [req-61ddf448-326c-48a7-b3c5-15616df4da56 req-80a05e8b-6f49-4308-b30b-06d5d4d7d98d service nova] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Updating instance_info_cache with network_info: [{"id": "973164ed-3436-4924-999d-f9635ad0f1e1", "address": "fa:16:3e:2c:ba:71", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973164ed-34", "ovs_interfaceid": "973164ed-3436-4924-999d-f9635ad0f1e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:11:51 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-61ddf448-326c-48a7-b3c5-15616df4da56 req-80a05e8b-6f49-4308-b30b-06d5d4d7d98d service nova] Releasing lock "refresh_cache-a057a243-1b1e-4a28-bd37-03856298a77f" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:11:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:11:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:11:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:11:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:11:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:11:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:11:54 user nova-compute[73484]: DEBUG os_brick.utils [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:11:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:11:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:11:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6627fa-aa5c-4d79-8d04-eed83984540d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:11:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:11:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:11:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8f172f-652d-4ab2-a90b-3fb5a42aa304]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:11:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:11:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:11:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d068cb5f-de0a-4b88-858e-f380f73cd7ab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:11:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fc7e32-28ef-46cd-afe5-7682529b9241]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:11:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:11:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:11:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 14:11:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:11:54 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:11:54 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 14:11:54 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c791f7-0747-4b28-97d5-98f268bec117]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:11:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 14:11:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 14:11:54 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 14:11:54 user nova-compute[73484]: DEBUG os_brick.utils [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:11:54 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Updating existing volume attachment record: 5132bea9-1e17-4d79-b4ee-e87d7445a432 {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 14:11:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:11:58 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:11:58 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 14:11:58 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Rebuilding the list of instances to heal {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 14:11:58 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Skipping network cache update for instance because it is Building. {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 14 14:11:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:11:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-428bf363-4ef9-437c-ad18-0be7c560e08d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:11:58 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-428bf363-4ef9-437c-ad18-0be7c560e08d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:11:58 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 14:11:58 user nova-compute[73484]: DEBUG nova.objects.instance [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lazy-loading 'info_cache' on Instance uuid 428bf363-4ef9-437c-ad18-0be7c560e08d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:11:59 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Updating instance_info_cache with network_info: [{"id": "9be38d4d-8bea-41c2-a726-311fa7b05784", "address": "fa:16:3e:3e:41:90", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9be38d4d-8b", "ovs_interfaceid": "9be38d4d-8bea-41c2-a726-311fa7b05784", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:11:59 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-428bf363-4ef9-437c-ad18-0be7c560e08d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:11:59 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 14:11:59 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG nova.compute.manager [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 14:12:03 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Creating image(s)
Aug 14 14:12:03 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Did not create local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Ensure instance console log exists: /opt/stack/data/nova/instances/a057a243-1b1e-4a28-bd37-03856298a77f/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Start _get_guest_xml network_info=[{"id": "973164ed-3436-4924-999d-f9635ad0f1e1", "address": "fa:16:3e:2c:ba:71", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973164ed-34", "ovs_interfaceid": "973164ed-3436-4924-999d-f9635ad0f1e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-14T14:11:38Z,direct_url=<?>,disk_format='qcow2',id=ce9c95cb-daff-4065-85c2-6e10444323a1,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-411355095',owner='1d5f985c3a8447e4870782d5e8709609',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-14T14:11:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '5132bea9-1e17-4d79-b4ee-e87d7445a432', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dIPLNtjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a057a243-1b1e-4a28-bd37-03856298a77f', 'attached_at': '', 'detached_at': '', 'volume_id': 'aad76acb-9bab-4ff6-a8dc-072f42edd5d2', 'serial': 'aad76acb-9bab-4ff6-a8dc-072f42edd5d2'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 14:12:03 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:12:03 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:12:03 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-14T14:11:38Z,direct_url=<?>,disk_format='qcow2',id=ce9c95cb-daff-4065-85c2-6e10444323a1,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-411355095',owner='1d5f985c3a8447e4870782d5e8709609',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-14T14:11:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dIPLNtjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:12:03 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:12:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:12:03 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:12:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:12:03 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b3f70e-c583-48ca-aba0-7f5853edcd1f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 14:12:03 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e597f3a5-616d-4272-9833-4bd1209c15a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2] added
Aug 14 14:12:03 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82c3ac8-b7cc-4fc3-aa1e-5b8d90baa7bd]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc24767-8e68-4d77-bd48-d14642a8936e]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dIPLNtjK {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dIPLNtjK" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a47a11d-f89e-412e-a31a-466ece21474c]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dIPLNtjK'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a16126-0760-4e27-8350-dafe26444e67]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77d9b9a-49c2-4c13-aefc-ea2e218ccb42]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 (non-flash)
Aug 14 14:12:03 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 (non-flash)
Aug 14 14:12:03 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2 -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[070cfaac-8ae1-44f7-ac89-b094d2f14f40]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2, portal: 172.16.0.220,3260]
Aug 14 14:12:03 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2, portal: 172.16.0.220,3260] successful.
Aug 14 14:12:03 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec965bb9-b287-4db7-9d77-9ee7b0aa4037]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fa053c-236b-430f-8264-67c18aa1bb14]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 (non-flash)
Aug 14 14:12:03 user nova-compute[73484]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2 (non-flash)
Aug 14 14:12:03 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 (non-flash)
Aug 14 14:12:03 user nova-compute[73484]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2 (non-flash)
Aug 14 14:12:03 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[369e59fa-3e4d-4668-ba36-7618aa9e35eb]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 14:12:03 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dIPLNtjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 14:12:04 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:12:04 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:12:04 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23438323835396538', 'path': '/dev/sdc'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:12:04 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438323835396538', 'path': '/dev/sdc'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 14:12:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:11:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1436656009',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1436656009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1436656009',id=49,image_ref='ce9c95cb-daff-4065-85c2-6e10444323a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfINTswfjOApDevHxhAGlS6Z5PoCoCb2E4DMLVzTCfbPfY9aTQC8A/yZTs6LX3NC4/GCd7MNP5G0MIstlY6zaj++BYtEaJGNoMTqZrjSm4deBwWe60sdFLAg1EBeR7KEw==',key_name='tempest-keypair-1650583429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d5f985c3a8447e4870782d5e8709609',ramdisk_id='',reservation_id='r-gydi8fq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1241691583',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1241691583-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1241691583',owner_user_name='tempest-TestVolumeBootPattern-1241691583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:11:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06a79841cf6743a7bd565a6084383f6c',uuid=a057a243-1b1e-4a28-bd37-03856298a77f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "973164ed-3436-4924-999d-f9635ad0f1e1", "address": "fa:16:3e:2c:ba:71", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973164ed-34", "ovs_interfaceid": "973164ed-3436-4924-999d-f9635ad0f1e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 14:12:05 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converting VIF {"id": "973164ed-3436-4924-999d-f9635ad0f1e1", "address": "fa:16:3e:2c:ba:71", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973164ed-34", "ovs_interfaceid": "973164ed-3436-4924-999d-f9635ad0f1e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:12:05 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:ba:71,bridge_name='br-int',has_traffic_filtering=True,id=973164ed-3436-4924-999d-f9635ad0f1e1,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap973164ed-34') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:12:05 user nova-compute[73484]: DEBUG nova.objects.instance [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lazy-loading 'pci_devices' on Instance uuid a057a243-1b1e-4a28-bd37-03856298a77f {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:12:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] End _get_guest_xml xml=<domain type="kvm">
Aug 14 14:12:05 user nova-compute[73484]:   <uuid>a057a243-1b1e-4a28-bd37-03856298a77f</uuid>
Aug 14 14:12:05 user nova-compute[73484]:   <name>instance-00000031</name>
Aug 14 14:12:05 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 14:12:05 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 14:12:05 user nova-compute[73484]:   <metadata>
Aug 14 14:12:05 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 14:12:05 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 14:12:05 user nova-compute[73484]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1436656009</nova:name>
Aug 14 14:12:05 user nova-compute[73484]:       <nova:creationTime>2023-08-14 14:12:03</nova:creationTime>
Aug 14 14:12:05 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 14:12:05 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 14:12:05 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 14:12:05 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 14:12:05 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 14:12:05 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 14:12:05 user nova-compute[73484]:       </nova:flavor>
Aug 14 14:12:05 user nova-compute[73484]:       <nova:owner>
Aug 14 14:12:05 user nova-compute[73484]:         <nova:user uuid="06a79841cf6743a7bd565a6084383f6c">tempest-TestVolumeBootPattern-1241691583-project-member</nova:user>
Aug 14 14:12:05 user nova-compute[73484]:         <nova:project uuid="1d5f985c3a8447e4870782d5e8709609">tempest-TestVolumeBootPattern-1241691583</nova:project>
Aug 14 14:12:05 user nova-compute[73484]:       </nova:owner>
Aug 14 14:12:05 user nova-compute[73484]:       <nova:root type="image" uuid="ce9c95cb-daff-4065-85c2-6e10444323a1"/>
Aug 14 14:12:05 user nova-compute[73484]:       <nova:ports>
Aug 14 14:12:05 user nova-compute[73484]:         <nova:port uuid="973164ed-3436-4924-999d-f9635ad0f1e1">
Aug 14 14:12:05 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 14:12:05 user nova-compute[73484]:         </nova:port>
Aug 14 14:12:05 user nova-compute[73484]:       </nova:ports>
Aug 14 14:12:05 user nova-compute[73484]:     </nova:instance>
Aug 14 14:12:05 user nova-compute[73484]:   </metadata>
Aug 14 14:12:05 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 14:12:05 user nova-compute[73484]:     <system>
Aug 14 14:12:05 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 14:12:05 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 14:12:05 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 14:12:05 user nova-compute[73484]:       <entry name="serial">a057a243-1b1e-4a28-bd37-03856298a77f</entry>
Aug 14 14:12:05 user nova-compute[73484]:       <entry name="uuid">a057a243-1b1e-4a28-bd37-03856298a77f</entry>
Aug 14 14:12:05 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 14:12:05 user nova-compute[73484]:     </system>
Aug 14 14:12:05 user nova-compute[73484]:   </sysinfo>
Aug 14 14:12:05 user nova-compute[73484]:   <os>
Aug 14 14:12:05 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 14:12:05 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 14:12:05 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 14:12:05 user nova-compute[73484]:   </os>
Aug 14 14:12:05 user nova-compute[73484]:   <features>
Aug 14 14:12:05 user nova-compute[73484]:     <acpi/>
Aug 14 14:12:05 user nova-compute[73484]:     <apic/>
Aug 14 14:12:05 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 14:12:05 user nova-compute[73484]:   </features>
Aug 14 14:12:05 user nova-compute[73484]:   <clock offset="utc">
Aug 14 14:12:05 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 14:12:05 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 14:12:05 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 14:12:05 user nova-compute[73484]:   </clock>
Aug 14 14:12:05 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 14:12:05 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 14:12:05 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 14:12:05 user nova-compute[73484]:   </cpu>
Aug 14 14:12:05 user nova-compute[73484]:   <devices>
Aug 14 14:12:05 user nova-compute[73484]:     <disk type="block" device="disk">
Aug 14 14:12:05 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:12:05 user nova-compute[73484]:       <source dev="/dev/sdc"/>
Aug 14 14:12:05 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 14:12:05 user nova-compute[73484]:       <serial>aad76acb-9bab-4ff6-a8dc-072f42edd5d2</serial>
Aug 14 14:12:05 user nova-compute[73484]:     </disk>
Aug 14 14:12:05 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 14:12:05 user nova-compute[73484]:       <mac address="fa:16:3e:2c:ba:71"/>
Aug 14 14:12:05 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 14:12:05 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 14:12:05 user nova-compute[73484]:       <target dev="tap973164ed-34"/>
Aug 14 14:12:05 user nova-compute[73484]:     </interface>
Aug 14 14:12:05 user nova-compute[73484]:     <serial type="pty">
Aug 14 14:12:05 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/a057a243-1b1e-4a28-bd37-03856298a77f/console.log" append="off"/>
Aug 14 14:12:05 user nova-compute[73484]:     </serial>
Aug 14 14:12:05 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 14:12:05 user nova-compute[73484]:     <video>
Aug 14 14:12:05 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 14:12:05 user nova-compute[73484]:     </video>
Aug 14 14:12:05 user nova-compute[73484]:     <rng model="virtio">
Aug 14 14:12:05 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 14:12:05 user nova-compute[73484]:     </rng>
Aug 14 14:12:05 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 14:12:05 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 14:12:05 user nova-compute[73484]:       <stats period="10"/>
Aug 14 14:12:05 user nova-compute[73484]:     </memballoon>
Aug 14 14:12:05 user nova-compute[73484]:   </devices>
Aug 14 14:12:05 user nova-compute[73484]: </domain>
Aug 14 14:12:05 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 14:12:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:11:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1436656009',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1436656009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1436656009',id=49,image_ref='ce9c95cb-daff-4065-85c2-6e10444323a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfINTswfjOApDevHxhAGlS6Z5PoCoCb2E4DMLVzTCfbPfY9aTQC8A/yZTs6LX3NC4/GCd7MNP5G0MIstlY6zaj++BYtEaJGNoMTqZrjSm4deBwWe60sdFLAg1EBeR7KEw==',key_name='tempest-keypair-1650583429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d5f985c3a8447e4870782d5e8709609',ramdisk_id='',reservation_id='r-gydi8fq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1241691583',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1241691583-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1241691583',owner_user_name='tempest-TestVolumeBootPattern-1241691583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:11:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06a79841cf6743a7bd565a6084383f6c',uuid=a057a243-1b1e-4a28-bd37-03856298a77f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "973164ed-3436-4924-999d-f9635ad0f1e1", "address": "fa:16:3e:2c:ba:71", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973164ed-34", "ovs_interfaceid": "973164ed-3436-4924-999d-f9635ad0f1e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 14:12:05 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converting VIF {"id": "973164ed-3436-4924-999d-f9635ad0f1e1", "address": "fa:16:3e:2c:ba:71", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973164ed-34", "ovs_interfaceid": "973164ed-3436-4924-999d-f9635ad0f1e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:12:05 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:ba:71,bridge_name='br-int',has_traffic_filtering=True,id=973164ed-3436-4924-999d-f9635ad0f1e1,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap973164ed-34') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:12:05 user nova-compute[73484]: DEBUG os_vif [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:ba:71,bridge_name='br-int',has_traffic_filtering=True,id=973164ed-3436-4924-999d-f9635ad0f1e1,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap973164ed-34') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 14:12:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:12:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:12:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 14:12:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:12:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap973164ed-34, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:12:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap973164ed-34, col_values=(('external_ids', {'iface-id': '973164ed-3436-4924-999d-f9635ad0f1e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:ba:71', 'vm-uuid': 'a057a243-1b1e-4a28-bd37-03856298a77f'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:12:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:12:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:12:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:12:05 user nova-compute[73484]: INFO os_vif [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:ba:71,bridge_name='br-int',has_traffic_filtering=True,id=973164ed-3436-4924-999d-f9635ad0f1e1,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap973164ed-34')
Aug 14 14:12:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:12:05 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] No VIF found with MAC fa:16:3e:2c:ba:71, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:12:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:12:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:12:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:12:06 user nova-compute[73484]: DEBUG nova.compute.manager [req-f0e68528-032b-4127-9d61-d414d3b47b24 req-56d06ca9-fed4-43b4-9dca-d9affb621de5 service nova] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Received event network-vif-plugged-973164ed-3436-4924-999d-f9635ad0f1e1 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:12:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f0e68528-032b-4127-9d61-d414d3b47b24 req-56d06ca9-fed4-43b4-9dca-d9affb621de5 service nova] Acquiring lock "a057a243-1b1e-4a28-bd37-03856298a77f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:12:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f0e68528-032b-4127-9d61-d414d3b47b24 req-56d06ca9-fed4-43b4-9dca-d9affb621de5 service nova] Lock "a057a243-1b1e-4a28-bd37-03856298a77f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:12:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-f0e68528-032b-4127-9d61-d414d3b47b24 req-56d06ca9-fed4-43b4-9dca-d9affb621de5 service nova] Lock "a057a243-1b1e-4a28-bd37-03856298a77f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:12:06 user nova-compute[73484]: DEBUG nova.compute.manager [req-f0e68528-032b-4127-9d61-d414d3b47b24 req-56d06ca9-fed4-43b4-9dca-d9affb621de5 service nova] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] No waiting events found dispatching network-vif-plugged-973164ed-3436-4924-999d-f9635ad0f1e1 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:12:06 user nova-compute[73484]: WARNING nova.compute.manager [req-f0e68528-032b-4127-9d61-d414d3b47b24 req-56d06ca9-fed4-43b4-9dca-d9affb621de5 service nova] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Received unexpected event network-vif-plugged-973164ed-3436-4924-999d-f9635ad0f1e1 for instance with vm_state building and task_state spawning.
Aug 14 14:12:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:12:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:12:06 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:12:06 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 14:12:07 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:12:08 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692022328.4555037, a057a243-1b1e-4a28-bd37-03856298a77f => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:12:08 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] VM Resumed (Lifecycle Event)
Aug 14 14:12:08 user nova-compute[73484]: DEBUG nova.compute.manager [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 14:12:08 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 14:12:08 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Instance spawned successfully.
Aug 14 14:12:08 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 14:12:08 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:12:08 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:12:08 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:12:08 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:12:08 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:12:08 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692022328.4568315, a057a243-1b1e-4a28-bd37-03856298a77f => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:12:08 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] VM Started (Lifecycle Event)
Aug 14 14:12:08 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:12:08 user nova-compute[73484]: INFO nova.compute.manager [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Took 4.97 seconds to spawn the instance on the hypervisor.
Aug 14 14:12:08 user nova-compute[73484]: DEBUG nova.compute.manager [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:12:08 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:12:08 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:12:08 user nova-compute[73484]: DEBUG nova.compute.manager [req-af0faf09-e6ff-4288-a98d-390eb8a77389 req-666558eb-ac31-4d1c-975d-6fd91fc74caf service nova] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Received event network-vif-plugged-973164ed-3436-4924-999d-f9635ad0f1e1 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:12:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-af0faf09-e6ff-4288-a98d-390eb8a77389 req-666558eb-ac31-4d1c-975d-6fd91fc74caf service nova] Acquiring lock "a057a243-1b1e-4a28-bd37-03856298a77f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:12:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-af0faf09-e6ff-4288-a98d-390eb8a77389 req-666558eb-ac31-4d1c-975d-6fd91fc74caf service nova] Lock "a057a243-1b1e-4a28-bd37-03856298a77f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:12:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-af0faf09-e6ff-4288-a98d-390eb8a77389 req-666558eb-ac31-4d1c-975d-6fd91fc74caf service nova] Lock "a057a243-1b1e-4a28-bd37-03856298a77f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:12:08 user nova-compute[73484]: DEBUG nova.compute.manager [req-af0faf09-e6ff-4288-a98d-390eb8a77389 req-666558eb-ac31-4d1c-975d-6fd91fc74caf service nova] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] No waiting events found dispatching network-vif-plugged-973164ed-3436-4924-999d-f9635ad0f1e1 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:12:08 user nova-compute[73484]: WARNING nova.compute.manager [req-af0faf09-e6ff-4288-a98d-390eb8a77389 req-666558eb-ac31-4d1c-975d-6fd91fc74caf service nova] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Received unexpected event network-vif-plugged-973164ed-3436-4924-999d-f9635ad0f1e1 for instance with vm_state building and task_state spawning.
Aug 14 14:12:08 user nova-compute[73484]: INFO nova.compute.manager [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Took 20.11 seconds to build instance.
Aug 14 14:12:08 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c878102f-c7f7-4024-b98d-87b92538b0b6 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "a057a243-1b1e-4a28-bd37-03856298a77f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.221s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:12:08 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:12:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:12:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:12:11 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:12:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:12:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:12:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:12:11 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 14:12:11 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 14:12:11 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 14:12:12 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:12:12 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:12:12 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=8700MB free_disk=25.281051635742188GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 14:12:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:12:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:12:12 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 428bf363-4ef9-437c-ad18-0be7c560e08d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:12:12 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance a057a243-1b1e-4a28-bd37-03856298a77f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:12:12 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 14:12:12 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 14:12:12 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:12:12 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:12:12 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 14:12:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.249s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:12:13 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:12:13 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:12:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:12:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:12:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:12:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:12:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:12:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:12:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:12:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:12:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:12:28 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:12:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:12:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:12:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:12:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:12:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:12:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:12:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.imagecache [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Verify base images {{(pid=73484) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 14 14:12:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.imagecache [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Image id ce9c95cb-daff-4065-85c2-6e10444323a1 yields fingerprint 62ecf88ab56c81933d2200a2c6dbd659c5f3be84 {{(pid=73484) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 14 14:12:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.imagecache [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73484) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 14 14:12:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.imagecache [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] 428bf363-4ef9-437c-ad18-0be7c560e08d is a valid instance name {{(pid=73484) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 14 14:12:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.imagecache [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] a057a243-1b1e-4a28-bd37-03856298a77f is a valid instance name {{(pid=73484) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 14 14:12:28 user nova-compute[73484]: WARNING nova.virt.libvirt.imagecache [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Unknown base file: /opt/stack/data/nova/instances/_base/71a296ca4ee1b8d26f23cc885592131c9e00518c
Aug 14 14:12:28 user nova-compute[73484]: WARNING nova.virt.libvirt.imagecache [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Unknown base file: /opt/stack/data/nova/instances/_base/17afa22e85a871169821695134408dbb30165d14
Aug 14 14:12:28 user nova-compute[73484]: WARNING nova.virt.libvirt.imagecache [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Unknown base file: /opt/stack/data/nova/instances/_base/80717719fed52231ab60729444f155cf8365e29b
Aug 14 14:12:28 user nova-compute[73484]: WARNING nova.virt.libvirt.imagecache [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Unknown base file: /opt/stack/data/nova/instances/_base/de717a39b1b8d642604f3face08054f09da0c13d
Aug 14 14:12:28 user nova-compute[73484]: WARNING nova.virt.libvirt.imagecache [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Unknown base file: /opt/stack/data/nova/instances/_base/de4eb93428f085f86e3da10aa57a5d4c0a8561e3
Aug 14 14:12:28 user nova-compute[73484]: WARNING nova.virt.libvirt.imagecache [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03
Aug 14 14:12:28 user nova-compute[73484]: WARNING nova.virt.libvirt.imagecache [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Unknown base file: /opt/stack/data/nova/instances/_base/79388acd31d915b4e649b7ca311af9a3498c102e
Aug 14 14:12:28 user nova-compute[73484]: WARNING nova.virt.libvirt.imagecache [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e94523494535035252278e76cc30c6c229813178
Aug 14 14:12:28 user nova-compute[73484]: WARNING nova.virt.libvirt.imagecache [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f3fb9741552644df917dbf6ea1872c0b98835be1
Aug 14 14:12:28 user nova-compute[73484]: WARNING nova.virt.libvirt.imagecache [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Unknown base file: /opt/stack/data/nova/instances/_base/42dc9dc150abdf2e807305fbee99ae173b4ed395
Aug 14 14:12:28 user nova-compute[73484]: INFO nova.virt.libvirt.imagecache [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Removable base files: /opt/stack/data/nova/instances/_base/71a296ca4ee1b8d26f23cc885592131c9e00518c /opt/stack/data/nova/instances/_base/17afa22e85a871169821695134408dbb30165d14 /opt/stack/data/nova/instances/_base/80717719fed52231ab60729444f155cf8365e29b /opt/stack/data/nova/instances/_base/de717a39b1b8d642604f3face08054f09da0c13d /opt/stack/data/nova/instances/_base/de4eb93428f085f86e3da10aa57a5d4c0a8561e3 /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03 /opt/stack/data/nova/instances/_base/79388acd31d915b4e649b7ca311af9a3498c102e /opt/stack/data/nova/instances/_base/e94523494535035252278e76cc30c6c229813178 /opt/stack/data/nova/instances/_base/f3fb9741552644df917dbf6ea1872c0b98835be1 /opt/stack/data/nova/instances/_base/42dc9dc150abdf2e807305fbee99ae173b4ed395
Aug 14 14:12:28 user nova-compute[73484]: INFO nova.virt.libvirt.imagecache [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/71a296ca4ee1b8d26f23cc885592131c9e00518c
Aug 14 14:12:28 user nova-compute[73484]: INFO nova.virt.libvirt.imagecache [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/17afa22e85a871169821695134408dbb30165d14
Aug 14 14:12:28 user nova-compute[73484]: INFO nova.virt.libvirt.imagecache [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/80717719fed52231ab60729444f155cf8365e29b
Aug 14 14:12:28 user nova-compute[73484]: INFO nova.virt.libvirt.imagecache [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/de717a39b1b8d642604f3face08054f09da0c13d
Aug 14 14:12:28 user nova-compute[73484]: INFO nova.virt.libvirt.imagecache [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/de4eb93428f085f86e3da10aa57a5d4c0a8561e3
Aug 14 14:12:28 user nova-compute[73484]: INFO nova.virt.libvirt.imagecache [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3507b9f30b1fcbea95c0686b60a5573487b12a03
Aug 14 14:12:28 user nova-compute[73484]: INFO nova.virt.libvirt.imagecache [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/79388acd31d915b4e649b7ca311af9a3498c102e
Aug 14 14:12:28 user nova-compute[73484]: INFO nova.virt.libvirt.imagecache [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e94523494535035252278e76cc30c6c229813178
Aug 14 14:12:28 user nova-compute[73484]: INFO nova.virt.libvirt.imagecache [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f3fb9741552644df917dbf6ea1872c0b98835be1
Aug 14 14:12:28 user nova-compute[73484]: INFO nova.virt.libvirt.imagecache [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/42dc9dc150abdf2e807305fbee99ae173b4ed395
Aug 14 14:12:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.imagecache [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Verification complete {{(pid=73484) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 14 14:12:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.imagecache [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Verify swap images {{(pid=73484) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 14 14:12:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.imagecache [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Verify ephemeral images {{(pid=73484) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 14 14:12:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:12:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:12:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:12:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:12:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:12:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:12:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:12:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:12:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:12:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:12:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:12:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:12:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:12:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:12:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:12:59 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:12:59 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 14:12:59 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Rebuilding the list of instances to heal {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 14:13:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-428bf363-4ef9-437c-ad18-0be7c560e08d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:13:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-428bf363-4ef9-437c-ad18-0be7c560e08d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:13:00 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 14:13:00 user nova-compute[73484]: DEBUG nova.objects.instance [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lazy-loading 'info_cache' on Instance uuid 428bf363-4ef9-437c-ad18-0be7c560e08d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:13:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:13:00 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Updating instance_info_cache with network_info: [{"id": "9be38d4d-8bea-41c2-a726-311fa7b05784", "address": "fa:16:3e:3e:41:90", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9be38d4d-8b", "ovs_interfaceid": "9be38d4d-8bea-41c2-a726-311fa7b05784", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:13:00 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-428bf363-4ef9-437c-ad18-0be7c560e08d" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:13:00 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 14:13:01 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:13:04 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:13:04 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73484) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 14:13:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:13:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:13:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:13:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:13:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:13:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:13:05 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:13:07 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:13:07 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 14:13:08 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:13:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:13:10 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:13:11 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:13:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:13:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:13:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:13:11 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 14:13:11 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 14:13:11 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 14:13:12 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:13:12 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:13:12 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=8665MB free_disk=25.279170989990234GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 14:13:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:13:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:13:12 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 428bf363-4ef9-437c-ad18-0be7c560e08d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:13:12 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance a057a243-1b1e-4a28-bd37-03856298a77f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:13:12 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 14:13:12 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 14:13:12 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Refreshing inventories for resource provider 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 14:13:12 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Updating ProviderTree inventory for provider 165d4635-93b4-49a6-879a-21c1324822ab from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 14:13:12 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Updating inventory in ProviderTree for provider 165d4635-93b4-49a6-879a-21c1324822ab with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 14:13:12 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Refreshing aggregate associations for resource provider 165d4635-93b4-49a6-879a-21c1324822ab, aggregates: None {{(pid=73484) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 14:13:12 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Refreshing trait associations for resource provider 165d4635-93b4-49a6-879a-21c1324822ab, traits: COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS {{(pid=73484) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 14:13:12 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:13:12 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:13:12 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 14:13:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.538s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:13:14 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:13:14 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:13:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:13:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:13:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:13:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:13:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:13:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:13:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:13:16 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:13:18 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:13:18 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Cleaning up deleted instances {{(pid=73484) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 14:13:18 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] There are 0 instances to clean {{(pid=73484) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 14:13:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:13:24 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:13:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:13:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:13:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:13:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:13:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:13:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:13:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:13:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:13:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:13:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:13:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:13:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:13:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:13:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:13:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:13:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-db5e8517-b3ea-4a5d-b832-220a0c493c2f req-2bccf4b5-f2ce-47cd-bec7-ffa48c318005 service nova] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Received event network-changed-973164ed-3436-4924-999d-f9635ad0f1e1 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:13:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-db5e8517-b3ea-4a5d-b832-220a0c493c2f req-2bccf4b5-f2ce-47cd-bec7-ffa48c318005 service nova] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Refreshing instance network info cache due to event network-changed-973164ed-3436-4924-999d-f9635ad0f1e1. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:13:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-db5e8517-b3ea-4a5d-b832-220a0c493c2f req-2bccf4b5-f2ce-47cd-bec7-ffa48c318005 service nova] Acquiring lock "refresh_cache-a057a243-1b1e-4a28-bd37-03856298a77f" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:13:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-db5e8517-b3ea-4a5d-b832-220a0c493c2f req-2bccf4b5-f2ce-47cd-bec7-ffa48c318005 service nova] Acquired lock "refresh_cache-a057a243-1b1e-4a28-bd37-03856298a77f" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:13:40 user nova-compute[73484]: DEBUG nova.network.neutron [req-db5e8517-b3ea-4a5d-b832-220a0c493c2f req-2bccf4b5-f2ce-47cd-bec7-ffa48c318005 service nova] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Refreshing network info cache for port 973164ed-3436-4924-999d-f9635ad0f1e1 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:13:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "a057a243-1b1e-4a28-bd37-03856298a77f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:13:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "a057a243-1b1e-4a28-bd37-03856298a77f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:13:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "a057a243-1b1e-4a28-bd37-03856298a77f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:13:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "a057a243-1b1e-4a28-bd37-03856298a77f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:13:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "a057a243-1b1e-4a28-bd37-03856298a77f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:13:40 user nova-compute[73484]: INFO nova.compute.manager [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Terminating instance
Aug 14 14:13:40 user nova-compute[73484]: DEBUG nova.compute.manager [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 14:13:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:13:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:13:40 user nova-compute[73484]: DEBUG nova.network.neutron [req-db5e8517-b3ea-4a5d-b832-220a0c493c2f req-2bccf4b5-f2ce-47cd-bec7-ffa48c318005 service nova] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Updated VIF entry in instance network info cache for port 973164ed-3436-4924-999d-f9635ad0f1e1. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:13:40 user nova-compute[73484]: DEBUG nova.network.neutron [req-db5e8517-b3ea-4a5d-b832-220a0c493c2f req-2bccf4b5-f2ce-47cd-bec7-ffa48c318005 service nova] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Updating instance_info_cache with network_info: [{"id": "973164ed-3436-4924-999d-f9635ad0f1e1", "address": "fa:16:3e:2c:ba:71", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973164ed-34", "ovs_interfaceid": "973164ed-3436-4924-999d-f9635ad0f1e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:13:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-db5e8517-b3ea-4a5d-b832-220a0c493c2f req-2bccf4b5-f2ce-47cd-bec7-ffa48c318005 service nova] Releasing lock "refresh_cache-a057a243-1b1e-4a28-bd37-03856298a77f" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:13:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:13:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:13:41 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Instance destroyed successfully.
Aug 14 14:13:41 user nova-compute[73484]: DEBUG nova.objects.instance [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lazy-loading 'resources' on Instance uuid a057a243-1b1e-4a28-bd37-03856298a77f {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:11:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1436656009',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1436656009',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1436656009',id=49,image_ref='ce9c95cb-daff-4065-85c2-6e10444323a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfINTswfjOApDevHxhAGlS6Z5PoCoCb2E4DMLVzTCfbPfY9aTQC8A/yZTs6LX3NC4/GCd7MNP5G0MIstlY6zaj++BYtEaJGNoMTqZrjSm4deBwWe60sdFLAg1EBeR7KEw==',key_name='tempest-keypair-1650583429',keypairs=<?>,launch_index=0,launched_at=2023-08-14T14:12:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d5f985c3a8447e4870782d5e8709609',ramdisk_id='',reservation_id='r-gydi8fq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1241691583',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1241691583-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1241691583',owner_user_name='tempest-TestVolumeBootPattern-1241691583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T14:12:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06a79841cf6743a7bd565a6084383f6c',uuid=a057a243-1b1e-4a28-bd37-03856298a77f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "973164ed-3436-4924-999d-f9635ad0f1e1", "address": "fa:16:3e:2c:ba:71", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973164ed-34", "ovs_interfaceid": "973164ed-3436-4924-999d-f9635ad0f1e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converting VIF {"id": "973164ed-3436-4924-999d-f9635ad0f1e1", "address": "fa:16:3e:2c:ba:71", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973164ed-34", "ovs_interfaceid": "973164ed-3436-4924-999d-f9635ad0f1e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:ba:71,bridge_name='br-int',has_traffic_filtering=True,id=973164ed-3436-4924-999d-f9635ad0f1e1,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap973164ed-34') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG os_vif [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:ba:71,bridge_name='br-int',has_traffic_filtering=True,id=973164ed-3436-4924-999d-f9635ad0f1e1,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap973164ed-34') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap973164ed-34, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:13:41 user nova-compute[73484]: INFO os_vif [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:ba:71,bridge_name='br-int',has_traffic_filtering=True,id=973164ed-3436-4924-999d-f9635ad0f1e1,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap973164ed-34')
Aug 14 14:13:41 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dIPLNtjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:13:41 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:13:41 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02ab421-fbfc-4021-95c5-7f63e993a16a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17b9f88-3758-4ad3-bf42-c0ab7bfe9b2c]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 (non-flash)
Aug 14 14:13:41 user nova-compute[73484]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2 (non-flash)
Aug 14 14:13:41 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 (non-flash)
Aug 14 14:13:41 user nova-compute[73484]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2 (non-flash)
Aug 14 14:13:41 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4583cb2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2'): ({'sdc'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Removing single pathed devices sdc {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5fe47e-7287-4cb4-97c4-aedfbf4c9d85]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c523b82-4f91-4fd6-914c-331ba393ad00]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Flushing IO for device /dev/sdc {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7690d4e0-1403-4ad6-a2ec-80955f0d15fc]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83db549-df7a-4678-9dea-706dd1f60af2]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23438323835396538', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_faddc95c', '/dev/disk/by-id/scsi-1SCST_BIOfaddc95c-482859e8b6edf156') {{(pid=84315) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[857b274c-d614-4fe0-a704-490f465ade57]: (4, None) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[af76743d-3210-4873-b0fa-c731e99b6fe8]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2 -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf29dc7-fb0a-4270-b061-c6d20a4a018c]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2, portal: 172.16.0.220,3260]
Aug 14 14:13:41 user nova-compute[73484]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2, portal: 172.16.0.220,3260] successful.
Aug 14 14:13:41 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2 -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aad76acb-9bab-4ff6-a8dc-072f42edd5d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d351e5fe-6b17-42d6-b1a1-cef2615f5580]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] <== disconnect_volume: return (270ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 14:13:41 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Deleting instance files /opt/stack/data/nova/instances/a057a243-1b1e-4a28-bd37-03856298a77f_del
Aug 14 14:13:41 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Deletion of /opt/stack/data/nova/instances/a057a243-1b1e-4a28-bd37-03856298a77f_del complete
Aug 14 14:13:41 user nova-compute[73484]: INFO nova.compute.manager [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 14 14:13:41 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 14:13:41 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 14:13:42 user nova-compute[73484]: DEBUG nova.compute.manager [req-e2963551-3ab3-4257-bd19-b8331b3c7d91 req-f75ab22a-06bd-4a54-a42b-24f4cf20b916 service nova] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Received event network-vif-unplugged-973164ed-3436-4924-999d-f9635ad0f1e1 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:13:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e2963551-3ab3-4257-bd19-b8331b3c7d91 req-f75ab22a-06bd-4a54-a42b-24f4cf20b916 service nova] Acquiring lock "a057a243-1b1e-4a28-bd37-03856298a77f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:13:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e2963551-3ab3-4257-bd19-b8331b3c7d91 req-f75ab22a-06bd-4a54-a42b-24f4cf20b916 service nova] Lock "a057a243-1b1e-4a28-bd37-03856298a77f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:13:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e2963551-3ab3-4257-bd19-b8331b3c7d91 req-f75ab22a-06bd-4a54-a42b-24f4cf20b916 service nova] Lock "a057a243-1b1e-4a28-bd37-03856298a77f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:13:42 user nova-compute[73484]: DEBUG nova.compute.manager [req-e2963551-3ab3-4257-bd19-b8331b3c7d91 req-f75ab22a-06bd-4a54-a42b-24f4cf20b916 service nova] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] No waiting events found dispatching network-vif-unplugged-973164ed-3436-4924-999d-f9635ad0f1e1 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:13:42 user nova-compute[73484]: DEBUG nova.compute.manager [req-e2963551-3ab3-4257-bd19-b8331b3c7d91 req-f75ab22a-06bd-4a54-a42b-24f4cf20b916 service nova] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Received event network-vif-unplugged-973164ed-3436-4924-999d-f9635ad0f1e1 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 14:13:42 user nova-compute[73484]: DEBUG nova.compute.manager [req-e2963551-3ab3-4257-bd19-b8331b3c7d91 req-f75ab22a-06bd-4a54-a42b-24f4cf20b916 service nova] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Received event network-vif-plugged-973164ed-3436-4924-999d-f9635ad0f1e1 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:13:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e2963551-3ab3-4257-bd19-b8331b3c7d91 req-f75ab22a-06bd-4a54-a42b-24f4cf20b916 service nova] Acquiring lock "a057a243-1b1e-4a28-bd37-03856298a77f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:13:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e2963551-3ab3-4257-bd19-b8331b3c7d91 req-f75ab22a-06bd-4a54-a42b-24f4cf20b916 service nova] Lock "a057a243-1b1e-4a28-bd37-03856298a77f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:13:42 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-e2963551-3ab3-4257-bd19-b8331b3c7d91 req-f75ab22a-06bd-4a54-a42b-24f4cf20b916 service nova] Lock "a057a243-1b1e-4a28-bd37-03856298a77f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:13:42 user nova-compute[73484]: DEBUG nova.compute.manager [req-e2963551-3ab3-4257-bd19-b8331b3c7d91 req-f75ab22a-06bd-4a54-a42b-24f4cf20b916 service nova] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] No waiting events found dispatching network-vif-plugged-973164ed-3436-4924-999d-f9635ad0f1e1 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:13:42 user nova-compute[73484]: WARNING nova.compute.manager [req-e2963551-3ab3-4257-bd19-b8331b3c7d91 req-f75ab22a-06bd-4a54-a42b-24f4cf20b916 service nova] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Received unexpected event network-vif-plugged-973164ed-3436-4924-999d-f9635ad0f1e1 for instance with vm_state active and task_state deleting.
Aug 14 14:13:42 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:13:42 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Took 0.90 seconds to deallocate network for instance.
Aug 14 14:13:43 user nova-compute[73484]: INFO nova.compute.manager [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Took 0.73 seconds to detach 1 volumes for instance.
Aug 14 14:13:43 user nova-compute[73484]: DEBUG nova.compute.manager [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Deleting volume: aad76acb-9bab-4ff6-a8dc-072f42edd5d2 {{(pid=73484) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 14:13:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:13:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:13:43 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:13:43 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:13:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.138s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:13:43 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Deleted allocations for instance a057a243-1b1e-4a28-bd37-03856298a77f
Aug 14 14:13:43 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-aaaa459b-9329-47cb-bd72-83c74d23398d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "a057a243-1b1e-4a28-bd37-03856298a77f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.175s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:13:44 user nova-compute[73484]: DEBUG nova.compute.manager [req-de536ad2-bfea-4729-a73d-2b3a06765d20 req-bddda71b-c4d8-4114-a7fa-3743b227bc16 service nova] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Received event network-vif-deleted-973164ed-3436-4924-999d-f9635ad0f1e1 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:13:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:13:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:13:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:13:56 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692022421.3439677, a057a243-1b1e-4a28-bd37-03856298a77f => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:13:56 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] VM Stopped (Lifecycle Event)
Aug 14 14:13:56 user nova-compute[73484]: DEBUG nova.compute.manager [None req-2123a8f4-4a20-48a0-b1c6-301341adb9b9 None None] [instance: a057a243-1b1e-4a28-bd37-03856298a77f] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:13:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:13:57 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:13:57 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Triggering sync for uuid 428bf363-4ef9-437c-ad18-0be7c560e08d {{(pid=73484) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 14:13:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "428bf363-4ef9-437c-ad18-0be7c560e08d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:13:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "428bf363-4ef9-437c-ad18-0be7c560e08d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:13:57 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "428bf363-4ef9-437c-ad18-0be7c560e08d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:13:59 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:13:59 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 14:13:59 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Didn't find any instances for network info cache update. {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 14:14:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:14:01 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:14:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:14:06 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:14:07 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:14:07 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 14:14:10 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:14:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:14:11 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:14:11 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:14:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:14:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:14:11 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:14:11 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 14:14:11 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 14:14:12 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:14:12 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:14:12 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=8788MB free_disk=25.278160095214844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 14:14:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:14:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:14:12 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 428bf363-4ef9-437c-ad18-0be7c560e08d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:14:12 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 14:14:12 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 14:14:12 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:14:12 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:14:12 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 14:14:12 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:14:14 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:14:15 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:14:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:14:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:14:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:14:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:14:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "428bf363-4ef9-437c-ad18-0be7c560e08d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:14:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "428bf363-4ef9-437c-ad18-0be7c560e08d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:14:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "428bf363-4ef9-437c-ad18-0be7c560e08d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:14:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "428bf363-4ef9-437c-ad18-0be7c560e08d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:14:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "428bf363-4ef9-437c-ad18-0be7c560e08d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:14:35 user nova-compute[73484]: INFO nova.compute.manager [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Terminating instance
Aug 14 14:14:35 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 14:14:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:14:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:14:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:14:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:14:35 user nova-compute[73484]: DEBUG nova.compute.manager [req-c31b76e5-2e0d-44dc-99f2-7d8522a544b5 req-ee021d9e-7a06-4d35-af67-3c9667f86a7e service nova] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Received event network-vif-unplugged-9be38d4d-8bea-41c2-a726-311fa7b05784 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:14:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c31b76e5-2e0d-44dc-99f2-7d8522a544b5 req-ee021d9e-7a06-4d35-af67-3c9667f86a7e service nova] Acquiring lock "428bf363-4ef9-437c-ad18-0be7c560e08d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:14:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c31b76e5-2e0d-44dc-99f2-7d8522a544b5 req-ee021d9e-7a06-4d35-af67-3c9667f86a7e service nova] Lock "428bf363-4ef9-437c-ad18-0be7c560e08d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:14:35 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c31b76e5-2e0d-44dc-99f2-7d8522a544b5 req-ee021d9e-7a06-4d35-af67-3c9667f86a7e service nova] Lock "428bf363-4ef9-437c-ad18-0be7c560e08d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:14:35 user nova-compute[73484]: DEBUG nova.compute.manager [req-c31b76e5-2e0d-44dc-99f2-7d8522a544b5 req-ee021d9e-7a06-4d35-af67-3c9667f86a7e service nova] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] No waiting events found dispatching network-vif-unplugged-9be38d4d-8bea-41c2-a726-311fa7b05784 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:14:35 user nova-compute[73484]: DEBUG nova.compute.manager [req-c31b76e5-2e0d-44dc-99f2-7d8522a544b5 req-ee021d9e-7a06-4d35-af67-3c9667f86a7e service nova] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Received event network-vif-unplugged-9be38d4d-8bea-41c2-a726-311fa7b05784 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 14:14:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:14:36 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Instance destroyed successfully.
Aug 14 14:14:36 user nova-compute[73484]: DEBUG nova.objects.instance [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lazy-loading 'resources' on Instance uuid 428bf363-4ef9-437c-ad18-0be7c560e08d {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1957592995',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1957592995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1957592995',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmJqvS/iJnZEfEiFdalZKM9NnIAnSumwe5+OGy4HlmOr4vPJQ35Ip5EoUbdNrgvI4K8xTNYs+JkTXOKgP8nuPOK6E1UwC+iKNSxbMykNjWXYJ9uRSBK9FfIebetG761aw==',key_name='tempest-keypair-812835151',keypairs=<?>,launch_index=0,launched_at=2023-08-14T14:09:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d5f985c3a8447e4870782d5e8709609',ramdisk_id='',reservation_id='r-njrxht4w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1241691583',owner_user_name='tempest-TestVolumeBootPattern-1241691583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T14:09:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06a79841cf6743a7bd565a6084383f6c',uuid=428bf363-4ef9-437c-ad18-0be7c560e08d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9be38d4d-8bea-41c2-a726-311fa7b05784", "address": "fa:16:3e:3e:41:90", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9be38d4d-8b", "ovs_interfaceid": "9be38d4d-8bea-41c2-a726-311fa7b05784", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converting VIF {"id": "9be38d4d-8bea-41c2-a726-311fa7b05784", "address": "fa:16:3e:3e:41:90", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9be38d4d-8b", "ovs_interfaceid": "9be38d4d-8bea-41c2-a726-311fa7b05784", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:41:90,bridge_name='br-int',has_traffic_filtering=True,id=9be38d4d-8bea-41c2-a726-311fa7b05784,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9be38d4d-8b') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG os_vif [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:41:90,bridge_name='br-int',has_traffic_filtering=True,id=9be38d4d-8bea-41c2-a726-311fa7b05784,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9be38d4d-8b') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9be38d4d-8b, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:14:36 user nova-compute[73484]: INFO os_vif [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:41:90,bridge_name='br-int',has_traffic_filtering=True,id=9be38d4d-8bea-41c2-a726-311fa7b05784,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9be38d4d-8b')
Aug 14 14:14:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GQBkAWIS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:14:36 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:14:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84cf9b5-2dd3-4411-be16-78dc4085e72b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b222c1-6676-4780-99c7-edce2e7aa3e0]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 (non-flash)
Aug 14 14:14:36 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 (non-flash)
Aug 14 14:14:36 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4587dfd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46'): ({'sdb'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Removing single pathed devices sdb {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88b6d44-89f5-4514-8679-ee615521c2bd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7f02e8-725b-4092-bab4-b95023495945]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Flushing IO for device /dev/sdb {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[673c5931-6308-4f69-905e-be5fac5405a7]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[237dfc7f-841d-4d12-977a-0f4ababdae52]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] SCSI volumes sdb have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26539373132633833', '/dev/disk/by-id/scsi-1SCST_BIO2582e88a-e9712c83c364121c', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2582e88a') {{(pid=84315) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a39cdb2-5bca-4608-9652-77c5d2bebc56]: (4, None) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[43adc6c0-475e-4a2c-b1a1-41aa07e66a6a]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57d867c-bbb4-4a32-ad95-d0a0cac5c255]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46, portal: 172.16.0.220,3260]
Aug 14 14:14:36 user nova-compute[73484]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46, portal: 172.16.0.220,3260] successful.
Aug 14 14:14:36 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f78209-d56b-4229-a103-b8d0471feb46 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe72340-0386-4084-bba7-bd8b1ccdcce7]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] <== disconnect_volume: return (297ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 14:14:36 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Deleting instance files /opt/stack/data/nova/instances/428bf363-4ef9-437c-ad18-0be7c560e08d_del
Aug 14 14:14:36 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Deletion of /opt/stack/data/nova/instances/428bf363-4ef9-437c-ad18-0be7c560e08d_del complete
Aug 14 14:14:36 user nova-compute[73484]: INFO nova.compute.manager [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 14 14:14:36 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 14:14:36 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 14:14:37 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:14:37 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Took 0.99 seconds to deallocate network for instance.
Aug 14 14:14:37 user nova-compute[73484]: DEBUG nova.compute.manager [req-16a19453-8e55-4267-a6e2-e9b371104204 req-3c737713-1fac-444c-97dc-4ab46eddf303 service nova] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Received event network-vif-deleted-9be38d4d-8bea-41c2-a726-311fa7b05784 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:14:37 user nova-compute[73484]: DEBUG nova.compute.manager [req-698921e2-071b-4618-a686-6779e92a1d7b req-4499c425-2322-472c-babf-7a67b74a851b service nova] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Received event network-vif-plugged-9be38d4d-8bea-41c2-a726-311fa7b05784 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:14:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-698921e2-071b-4618-a686-6779e92a1d7b req-4499c425-2322-472c-babf-7a67b74a851b service nova] Acquiring lock "428bf363-4ef9-437c-ad18-0be7c560e08d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:14:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-698921e2-071b-4618-a686-6779e92a1d7b req-4499c425-2322-472c-babf-7a67b74a851b service nova] Lock "428bf363-4ef9-437c-ad18-0be7c560e08d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:14:37 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-698921e2-071b-4618-a686-6779e92a1d7b req-4499c425-2322-472c-babf-7a67b74a851b service nova] Lock "428bf363-4ef9-437c-ad18-0be7c560e08d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:14:37 user nova-compute[73484]: DEBUG nova.compute.manager [req-698921e2-071b-4618-a686-6779e92a1d7b req-4499c425-2322-472c-babf-7a67b74a851b service nova] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] No waiting events found dispatching network-vif-plugged-9be38d4d-8bea-41c2-a726-311fa7b05784 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:14:37 user nova-compute[73484]: WARNING nova.compute.manager [req-698921e2-071b-4618-a686-6779e92a1d7b req-4499c425-2322-472c-babf-7a67b74a851b service nova] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Received unexpected event network-vif-plugged-9be38d4d-8bea-41c2-a726-311fa7b05784 for instance with vm_state active and task_state deleting.
Aug 14 14:14:38 user nova-compute[73484]: INFO nova.compute.manager [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Took 0.75 seconds to detach 1 volumes for instance.
Aug 14 14:14:38 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Deleting volume: a5f78209-d56b-4229-a103-b8d0471feb46 {{(pid=73484) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 14:14:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:14:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:14:38 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:14:38 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:14:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.108s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:14:38 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Deleted allocations for instance 428bf363-4ef9-437c-ad18-0be7c560e08d
Aug 14 14:14:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6bf2f9de-4cbc-496d-bbd4-fd4ae85ca102 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "428bf363-4ef9-437c-ad18-0be7c560e08d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.214s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:14:41 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:14:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:14:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:14:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:14:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:14:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:14:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:14:51 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692022476.143463, 428bf363-4ef9-437c-ad18-0be7c560e08d => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:14:51 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] VM Stopped (Lifecycle Event)
Aug 14 14:14:51 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a4c0b019-1d4e-4a63-ba80-5048c065429e None None] [instance: 428bf363-4ef9-437c-ad18-0be7c560e08d] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:14:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:14:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:15:00 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:15:00 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 14:15:00 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Rebuilding the list of instances to heal {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 14:15:00 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Didn't find any instances for network info cache update. {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 14:15:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:15:01 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:15:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:15:06 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:15:08 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:15:08 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 14:15:10 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:15:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:15:12 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:15:13 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:15:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:15:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:15:13 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:15:13 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 14:15:14 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:15:14 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:15:14 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=8931MB free_disk=25.26953887939453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 14:15:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:15:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:15:14 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 14:15:14 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 14:15:14 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:15:14 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:15:14 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 14:15:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.130s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:15:15 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:15:15 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:15:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:15:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:15:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:15:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:15:28 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:15:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:15:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "23beba63-1959-4414-a2c4-30ca3cba71c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "23beba63-1959-4414-a2c4-30ca3cba71c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG nova.compute.manager [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 14:15:38 user nova-compute[73484]: INFO nova.compute.claims [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Claim successful on node user
Aug 14 14:15:38 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.194s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG nova.compute.manager [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG nova.compute.manager [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG nova.network.neutron [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 14:15:38 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 14:15:38 user nova-compute[73484]: DEBUG nova.compute.manager [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 14:15:38 user nova-compute[73484]: INFO nova.virt.block_device [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Booting with volume d162c163-fcf9-4d3f-b793-ebd8d3be9121 at /dev/vda
Aug 14 14:15:38 user nova-compute[73484]: DEBUG nova.policy [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06a79841cf6743a7bd565a6084383f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f985c3a8447e4870782d5e8709609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG os_brick.utils [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf366d0-3fdc-412f-8121-7d54d3729b17]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[203a4527-a87d-41e6-a686-26dd8e721570]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5e2e17-3024-4f78-915c-afd4e601cddc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c656f04-4b94-4986-9d07-48ffe78abf25]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:15:38 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 14:15:38 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3d35aa-d3e0-46d7-a630-7a96fc2c428d]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG os_brick.utils [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:15:38 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Updating existing volume attachment record: d3b0e4bf-db65-4b7c-a64e-30bfff49d438 {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 14:15:39 user nova-compute[73484]: DEBUG nova.network.neutron [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Successfully created port: 4036fa71-5f78-4ea2-ac8a-d97747f0b206 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 14:15:40 user nova-compute[73484]: DEBUG nova.network.neutron [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Successfully updated port: 4036fa71-5f78-4ea2-ac8a-d97747f0b206 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 14:15:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "refresh_cache-23beba63-1959-4414-a2c4-30ca3cba71c7" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:15:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquired lock "refresh_cache-23beba63-1959-4414-a2c4-30ca3cba71c7" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:15:40 user nova-compute[73484]: DEBUG nova.network.neutron [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 14:15:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-c941f5e5-755c-4e1c-bdbc-9e337bb2d219 req-f08dbd4f-9b68-4aa8-881d-ff1f91f28bde service nova] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Received event network-changed-4036fa71-5f78-4ea2-ac8a-d97747f0b206 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:15:40 user nova-compute[73484]: DEBUG nova.compute.manager [req-c941f5e5-755c-4e1c-bdbc-9e337bb2d219 req-f08dbd4f-9b68-4aa8-881d-ff1f91f28bde service nova] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Refreshing instance network info cache due to event network-changed-4036fa71-5f78-4ea2-ac8a-d97747f0b206. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:15:40 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c941f5e5-755c-4e1c-bdbc-9e337bb2d219 req-f08dbd4f-9b68-4aa8-881d-ff1f91f28bde service nova] Acquiring lock "refresh_cache-23beba63-1959-4414-a2c4-30ca3cba71c7" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:15:40 user nova-compute[73484]: DEBUG nova.network.neutron [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 14:15:41 user nova-compute[73484]: DEBUG nova.network.neutron [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Updating instance_info_cache with network_info: [{"id": "4036fa71-5f78-4ea2-ac8a-d97747f0b206", "address": "fa:16:3e:7f:5a:7f", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4036fa71-5f", "ovs_interfaceid": "4036fa71-5f78-4ea2-ac8a-d97747f0b206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:15:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Releasing lock "refresh_cache-23beba63-1959-4414-a2c4-30ca3cba71c7" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:15:41 user nova-compute[73484]: DEBUG nova.compute.manager [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Instance network_info: |[{"id": "4036fa71-5f78-4ea2-ac8a-d97747f0b206", "address": "fa:16:3e:7f:5a:7f", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4036fa71-5f", "ovs_interfaceid": "4036fa71-5f78-4ea2-ac8a-d97747f0b206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 14:15:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c941f5e5-755c-4e1c-bdbc-9e337bb2d219 req-f08dbd4f-9b68-4aa8-881d-ff1f91f28bde service nova] Acquired lock "refresh_cache-23beba63-1959-4414-a2c4-30ca3cba71c7" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:15:41 user nova-compute[73484]: DEBUG nova.network.neutron [req-c941f5e5-755c-4e1c-bdbc-9e337bb2d219 req-f08dbd4f-9b68-4aa8-881d-ff1f91f28bde service nova] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Refreshing network info cache for port 4036fa71-5f78-4ea2-ac8a-d97747f0b206 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:15:41 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:15:41 user nova-compute[73484]: DEBUG nova.network.neutron [req-c941f5e5-755c-4e1c-bdbc-9e337bb2d219 req-f08dbd4f-9b68-4aa8-881d-ff1f91f28bde service nova] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Updated VIF entry in instance network info cache for port 4036fa71-5f78-4ea2-ac8a-d97747f0b206. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:15:41 user nova-compute[73484]: DEBUG nova.network.neutron [req-c941f5e5-755c-4e1c-bdbc-9e337bb2d219 req-f08dbd4f-9b68-4aa8-881d-ff1f91f28bde service nova] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Updating instance_info_cache with network_info: [{"id": "4036fa71-5f78-4ea2-ac8a-d97747f0b206", "address": "fa:16:3e:7f:5a:7f", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4036fa71-5f", "ovs_interfaceid": "4036fa71-5f78-4ea2-ac8a-d97747f0b206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:15:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-c941f5e5-755c-4e1c-bdbc-9e337bb2d219 req-f08dbd4f-9b68-4aa8-881d-ff1f91f28bde service nova] Releasing lock "refresh_cache-23beba63-1959-4414-a2c4-30ca3cba71c7" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:15:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG nova.compute.manager [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 14:15:47 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Creating image(s)
Aug 14 14:15:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Did not create local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Ensure instance console log exists: /opt/stack/data/nova/instances/23beba63-1959-4414-a2c4-30ca3cba71c7/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Start _get_guest_xml network_info=[{"id": "4036fa71-5f78-4ea2-ac8a-d97747f0b206", "address": "fa:16:3e:7f:5a:7f", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4036fa71-5f", "ovs_interfaceid": "4036fa71-5f78-4ea2-ac8a-d97747f0b206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd3b0e4bf-db65-4b7c-a64e-30bfff49d438', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IposQtFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '23beba63-1959-4414-a2c4-30ca3cba71c7', 'attached_at': '', 'detached_at': '', 'volume_id': 'd162c163-fcf9-4d3f-b793-ebd8d3be9121', 'serial': 'd162c163-fcf9-4d3f-b793-ebd8d3be9121'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 14:15:47 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:15:47 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:15:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IposQtFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:15:47 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:15:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:15:47 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:15:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:15:47 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e299ee1f-2d6e-4dff-a4b8-3f9fb3230de1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 14:15:47 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e93685-afb7-4c57-83bb-178d08e7b957]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121] added
Aug 14 14:15:47 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d09c6d-c999-4ef3-a4ea-6a3220f87ea2]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[421fc3dc-859b-45c1-9559-984920008516]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IposQtFg {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IposQtFg" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d6d564-0584-49a2-a1bf-b01c88490f8d]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IposQtFg'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea951ab8-4dff-45c5-bf79-abf15f2dfb2c]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b869d58-f6a8-4e3c-8691-dc5da3f153a7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 14:15:47 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 14:15:47 user nova-compute[73484]:  {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:15:47 user nova-compute[73484]: WARNING os_brick.initiator.connectors.iscsi [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 14:15:47 user nova-compute[73484]: 
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d193ae-5c69-4382-a261-d372b6a5813f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121, portal: 172.16.0.220,3260]
Aug 14 14:15:47 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121, portal: 172.16.0.220,3260] successful.
Aug 14 14:15:47 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d45dcd-852f-4ab5-a70b-16a00012eef5]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3f0e58-37fd-45ef-bad5-689b6f81c366]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 (non-flash)
Aug 14 14:15:47 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 (non-flash)
Aug 14 14:15:47 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[744d3560-fc97-4afc-9a56-30425e0a294a]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:15:47 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 14:15:48 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 14:15:48 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IposQtFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 14:15:48 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:15:48 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '23730386631643437', 'path': '/dev/sdb'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:15:48 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730386631643437', 'path': '/dev/sdb'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 14:15:48 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-60227981',display_name='tempest-TestVolumeBootPattern-server-60227981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-60227981',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0YtWHij329FNoIKSuvewNW0lchEW8QXW6SCNcWsE4ArVpjE7z7ynO0kMwxMk/WbCTDPiOAzr+p3ygxr0+DrAhogvNqNMYfgUtv1ikx8+Bfw67BfL3coNOLw+AOFNL5ew==',key_name='tempest-TestVolumeBootPattern-1333911820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d5f985c3a8447e4870782d5e8709609',ramdisk_id='',reservation_id='r-c0nf387m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1241691583',owner_user_name='tempest-TestVolumeBootPattern-1241691583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:15:39Z,user_data=None,user_id='06a79841cf6743a7bd565a6084383f6c',uuid=23beba63-1959-4414-a2c4-30ca3cba71c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4036fa71-5f78-4ea2-ac8a-d97747f0b206", "address": "fa:16:3e:7f:5a:7f", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4036fa71-5f", "ovs_interfaceid": "4036fa71-5f78-4ea2-ac8a-d97747f0b206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 14:15:48 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converting VIF {"id": "4036fa71-5f78-4ea2-ac8a-d97747f0b206", "address": "fa:16:3e:7f:5a:7f", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4036fa71-5f", "ovs_interfaceid": "4036fa71-5f78-4ea2-ac8a-d97747f0b206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:15:48 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:5a:7f,bridge_name='br-int',has_traffic_filtering=True,id=4036fa71-5f78-4ea2-ac8a-d97747f0b206,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4036fa71-5f') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:15:48 user nova-compute[73484]: DEBUG nova.objects.instance [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lazy-loading 'pci_devices' on Instance uuid 23beba63-1959-4414-a2c4-30ca3cba71c7 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:15:48 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] End _get_guest_xml xml=<domain type="kvm">
Aug 14 14:15:48 user nova-compute[73484]:   <uuid>23beba63-1959-4414-a2c4-30ca3cba71c7</uuid>
Aug 14 14:15:48 user nova-compute[73484]:   <name>instance-00000032</name>
Aug 14 14:15:48 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 14:15:48 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 14:15:48 user nova-compute[73484]:   <metadata>
Aug 14 14:15:48 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 14:15:48 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 14:15:48 user nova-compute[73484]:       <nova:name>tempest-TestVolumeBootPattern-server-60227981</nova:name>
Aug 14 14:15:48 user nova-compute[73484]:       <nova:creationTime>2023-08-14 14:15:47</nova:creationTime>
Aug 14 14:15:48 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 14:15:48 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 14:15:48 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 14:15:48 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 14:15:48 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 14:15:48 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 14:15:48 user nova-compute[73484]:       </nova:flavor>
Aug 14 14:15:48 user nova-compute[73484]:       <nova:owner>
Aug 14 14:15:48 user nova-compute[73484]:         <nova:user uuid="06a79841cf6743a7bd565a6084383f6c">tempest-TestVolumeBootPattern-1241691583-project-member</nova:user>
Aug 14 14:15:48 user nova-compute[73484]:         <nova:project uuid="1d5f985c3a8447e4870782d5e8709609">tempest-TestVolumeBootPattern-1241691583</nova:project>
Aug 14 14:15:48 user nova-compute[73484]:       </nova:owner>
Aug 14 14:15:48 user nova-compute[73484]:       <nova:ports>
Aug 14 14:15:48 user nova-compute[73484]:         <nova:port uuid="4036fa71-5f78-4ea2-ac8a-d97747f0b206">
Aug 14 14:15:48 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 14:15:48 user nova-compute[73484]:         </nova:port>
Aug 14 14:15:48 user nova-compute[73484]:       </nova:ports>
Aug 14 14:15:48 user nova-compute[73484]:     </nova:instance>
Aug 14 14:15:48 user nova-compute[73484]:   </metadata>
Aug 14 14:15:48 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 14:15:48 user nova-compute[73484]:     <system>
Aug 14 14:15:48 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 14:15:48 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 14:15:48 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 14:15:48 user nova-compute[73484]:       <entry name="serial">23beba63-1959-4414-a2c4-30ca3cba71c7</entry>
Aug 14 14:15:48 user nova-compute[73484]:       <entry name="uuid">23beba63-1959-4414-a2c4-30ca3cba71c7</entry>
Aug 14 14:15:48 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 14:15:48 user nova-compute[73484]:     </system>
Aug 14 14:15:48 user nova-compute[73484]:   </sysinfo>
Aug 14 14:15:48 user nova-compute[73484]:   <os>
Aug 14 14:15:48 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 14:15:48 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 14:15:48 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 14:15:48 user nova-compute[73484]:   </os>
Aug 14 14:15:48 user nova-compute[73484]:   <features>
Aug 14 14:15:48 user nova-compute[73484]:     <acpi/>
Aug 14 14:15:48 user nova-compute[73484]:     <apic/>
Aug 14 14:15:48 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 14:15:48 user nova-compute[73484]:   </features>
Aug 14 14:15:48 user nova-compute[73484]:   <clock offset="utc">
Aug 14 14:15:48 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 14:15:48 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 14:15:48 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 14:15:48 user nova-compute[73484]:   </clock>
Aug 14 14:15:48 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 14:15:48 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 14:15:48 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 14:15:48 user nova-compute[73484]:   </cpu>
Aug 14 14:15:48 user nova-compute[73484]:   <devices>
Aug 14 14:15:48 user nova-compute[73484]:     <disk type="block" device="disk">
Aug 14 14:15:48 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:15:48 user nova-compute[73484]:       <source dev="/dev/sdb"/>
Aug 14 14:15:48 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 14:15:48 user nova-compute[73484]:       <serial>d162c163-fcf9-4d3f-b793-ebd8d3be9121</serial>
Aug 14 14:15:48 user nova-compute[73484]:     </disk>
Aug 14 14:15:48 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 14:15:48 user nova-compute[73484]:       <mac address="fa:16:3e:7f:5a:7f"/>
Aug 14 14:15:48 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 14:15:48 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 14:15:48 user nova-compute[73484]:       <target dev="tap4036fa71-5f"/>
Aug 14 14:15:48 user nova-compute[73484]:     </interface>
Aug 14 14:15:48 user nova-compute[73484]:     <serial type="pty">
Aug 14 14:15:48 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/23beba63-1959-4414-a2c4-30ca3cba71c7/console.log" append="off"/>
Aug 14 14:15:48 user nova-compute[73484]:     </serial>
Aug 14 14:15:48 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 14:15:48 user nova-compute[73484]:     <video>
Aug 14 14:15:48 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 14:15:48 user nova-compute[73484]:     </video>
Aug 14 14:15:48 user nova-compute[73484]:     <rng model="virtio">
Aug 14 14:15:48 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 14:15:48 user nova-compute[73484]:     </rng>
Aug 14 14:15:48 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 14:15:48 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 14:15:48 user nova-compute[73484]:       <stats period="10"/>
Aug 14 14:15:48 user nova-compute[73484]:     </memballoon>
Aug 14 14:15:48 user nova-compute[73484]:   </devices>
Aug 14 14:15:48 user nova-compute[73484]: </domain>
Aug 14 14:15:48 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 14:15:48 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-60227981',display_name='tempest-TestVolumeBootPattern-server-60227981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-60227981',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0YtWHij329FNoIKSuvewNW0lchEW8QXW6SCNcWsE4ArVpjE7z7ynO0kMwxMk/WbCTDPiOAzr+p3ygxr0+DrAhogvNqNMYfgUtv1ikx8+Bfw67BfL3coNOLw+AOFNL5ew==',key_name='tempest-TestVolumeBootPattern-1333911820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d5f985c3a8447e4870782d5e8709609',ramdisk_id='',reservation_id='r-c0nf387m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1241691583',owner_user_name='tempest-TestVolumeBootPattern-1241691583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:15:39Z,user_data=None,user_id='06a79841cf6743a7bd565a6084383f6c',uuid=23beba63-1959-4414-a2c4-30ca3cba71c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4036fa71-5f78-4ea2-ac8a-d97747f0b206", "address": "fa:16:3e:7f:5a:7f", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4036fa71-5f", "ovs_interfaceid": "4036fa71-5f78-4ea2-ac8a-d97747f0b206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 14:15:48 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converting VIF {"id": "4036fa71-5f78-4ea2-ac8a-d97747f0b206", "address": "fa:16:3e:7f:5a:7f", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4036fa71-5f", "ovs_interfaceid": "4036fa71-5f78-4ea2-ac8a-d97747f0b206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:15:48 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:5a:7f,bridge_name='br-int',has_traffic_filtering=True,id=4036fa71-5f78-4ea2-ac8a-d97747f0b206,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4036fa71-5f') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:15:48 user nova-compute[73484]: DEBUG os_vif [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:5a:7f,bridge_name='br-int',has_traffic_filtering=True,id=4036fa71-5f78-4ea2-ac8a-d97747f0b206,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4036fa71-5f') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 14:15:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:15:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:15:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 14:15:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:15:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4036fa71-5f, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:15:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4036fa71-5f, col_values=(('external_ids', {'iface-id': '4036fa71-5f78-4ea2-ac8a-d97747f0b206', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:5a:7f', 'vm-uuid': '23beba63-1959-4414-a2c4-30ca3cba71c7'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:15:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:15:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:15:48 user nova-compute[73484]: INFO os_vif [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:5a:7f,bridge_name='br-int',has_traffic_filtering=True,id=4036fa71-5f78-4ea2-ac8a-d97747f0b206,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4036fa71-5f')
Aug 14 14:15:48 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:15:48 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] No VIF found with MAC fa:16:3e:7f:5a:7f, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:15:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:15:49 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:15:50 user nova-compute[73484]: DEBUG nova.compute.manager [req-d46e1e8b-6749-4351-b63e-be0ffc9115d4 req-b1e9994b-f97b-4a9a-b382-dc7b5eedef92 service nova] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Received event network-vif-plugged-4036fa71-5f78-4ea2-ac8a-d97747f0b206 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:15:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d46e1e8b-6749-4351-b63e-be0ffc9115d4 req-b1e9994b-f97b-4a9a-b382-dc7b5eedef92 service nova] Acquiring lock "23beba63-1959-4414-a2c4-30ca3cba71c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:15:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d46e1e8b-6749-4351-b63e-be0ffc9115d4 req-b1e9994b-f97b-4a9a-b382-dc7b5eedef92 service nova] Lock "23beba63-1959-4414-a2c4-30ca3cba71c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:15:50 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-d46e1e8b-6749-4351-b63e-be0ffc9115d4 req-b1e9994b-f97b-4a9a-b382-dc7b5eedef92 service nova] Lock "23beba63-1959-4414-a2c4-30ca3cba71c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:15:50 user nova-compute[73484]: DEBUG nova.compute.manager [req-d46e1e8b-6749-4351-b63e-be0ffc9115d4 req-b1e9994b-f97b-4a9a-b382-dc7b5eedef92 service nova] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] No waiting events found dispatching network-vif-plugged-4036fa71-5f78-4ea2-ac8a-d97747f0b206 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:15:50 user nova-compute[73484]: WARNING nova.compute.manager [req-d46e1e8b-6749-4351-b63e-be0ffc9115d4 req-b1e9994b-f97b-4a9a-b382-dc7b5eedef92 service nova] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Received unexpected event network-vif-plugged-4036fa71-5f78-4ea2-ac8a-d97747f0b206 for instance with vm_state building and task_state spawning.
Aug 14 14:15:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:15:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:15:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:15:52 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692022552.0650942, 23beba63-1959-4414-a2c4-30ca3cba71c7 => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:15:52 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] VM Resumed (Lifecycle Event)
Aug 14 14:15:52 user nova-compute[73484]: DEBUG nova.compute.manager [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 14:15:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 14:15:52 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Instance spawned successfully.
Aug 14 14:15:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 14:15:52 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:15:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:15:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:15:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:15:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:15:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:15:52 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:15:52 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:15:52 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:15:52 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692022552.0685837, 23beba63-1959-4414-a2c4-30ca3cba71c7 => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:15:52 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] VM Started (Lifecycle Event)
Aug 14 14:15:52 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:15:52 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:15:52 user nova-compute[73484]: INFO nova.compute.manager [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Took 4.94 seconds to spawn the instance on the hypervisor.
Aug 14 14:15:52 user nova-compute[73484]: DEBUG nova.compute.manager [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:15:52 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:15:52 user nova-compute[73484]: DEBUG nova.compute.manager [req-47488a4f-3698-4883-bf37-9e6e9d7f729b req-d64da7f9-c527-4b4d-88c4-33a259209a92 service nova] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Received event network-vif-plugged-4036fa71-5f78-4ea2-ac8a-d97747f0b206 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:15:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-47488a4f-3698-4883-bf37-9e6e9d7f729b req-d64da7f9-c527-4b4d-88c4-33a259209a92 service nova] Acquiring lock "23beba63-1959-4414-a2c4-30ca3cba71c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:15:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-47488a4f-3698-4883-bf37-9e6e9d7f729b req-d64da7f9-c527-4b4d-88c4-33a259209a92 service nova] Lock "23beba63-1959-4414-a2c4-30ca3cba71c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:15:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-47488a4f-3698-4883-bf37-9e6e9d7f729b req-d64da7f9-c527-4b4d-88c4-33a259209a92 service nova] Lock "23beba63-1959-4414-a2c4-30ca3cba71c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:15:52 user nova-compute[73484]: DEBUG nova.compute.manager [req-47488a4f-3698-4883-bf37-9e6e9d7f729b req-d64da7f9-c527-4b4d-88c4-33a259209a92 service nova] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] No waiting events found dispatching network-vif-plugged-4036fa71-5f78-4ea2-ac8a-d97747f0b206 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:15:52 user nova-compute[73484]: WARNING nova.compute.manager [req-47488a4f-3698-4883-bf37-9e6e9d7f729b req-d64da7f9-c527-4b4d-88c4-33a259209a92 service nova] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Received unexpected event network-vif-plugged-4036fa71-5f78-4ea2-ac8a-d97747f0b206 for instance with vm_state building and task_state spawning.
Aug 14 14:15:52 user nova-compute[73484]: INFO nova.compute.manager [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Took 13.98 seconds to build instance.
Aug 14 14:15:52 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-2d52cdc9-45cb-45db-912e-9518f302cbf4 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "23beba63-1959-4414-a2c4-30ca3cba71c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.069s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:15:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:15:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:15:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:16:01 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:16:01 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 14:16:01 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Rebuilding the list of instances to heal {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 14:16:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-23beba63-1959-4414-a2c4-30ca3cba71c7" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:16:01 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-23beba63-1959-4414-a2c4-30ca3cba71c7" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:16:01 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 14:16:01 user nova-compute[73484]: DEBUG nova.objects.instance [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lazy-loading 'info_cache' on Instance uuid 23beba63-1959-4414-a2c4-30ca3cba71c7 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:16:02 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Updating instance_info_cache with network_info: [{"id": "4036fa71-5f78-4ea2-ac8a-d97747f0b206", "address": "fa:16:3e:7f:5a:7f", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4036fa71-5f", "ovs_interfaceid": "4036fa71-5f78-4ea2-ac8a-d97747f0b206", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:16:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-23beba63-1959-4414-a2c4-30ca3cba71c7" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:16:02 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 14:16:02 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:16:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:16:06 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:16:08 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:16:09 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:16:09 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 14:16:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:16:12 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:16:12 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:16:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:16:14 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:16:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:16:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:16:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:16:14 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 14:16:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 14:16:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:16:15 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:16:15 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:16:15 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=8738MB free_disk=25.26736068725586GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 14:16:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:16:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:16:15 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 23beba63-1959-4414-a2c4-30ca3cba71c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:16:15 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 14:16:15 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 14:16:15 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:16:15 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:16:15 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 14:16:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:16:17 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:16:17 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:16:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:16:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:16:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:16:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:16:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:16:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:16:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:16:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:16:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:16:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:16:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:16:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:16:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:16:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:16:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:16:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:16:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:16:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:16:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:16:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:16:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:17:02 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:17:02 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 14:17:02 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Rebuilding the list of instances to heal {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 14:17:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-23beba63-1959-4414-a2c4-30ca3cba71c7" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:17:02 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-23beba63-1959-4414-a2c4-30ca3cba71c7" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:17:02 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 14:17:02 user nova-compute[73484]: DEBUG nova.objects.instance [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lazy-loading 'info_cache' on Instance uuid 23beba63-1959-4414-a2c4-30ca3cba71c7 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:17:03 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Updating instance_info_cache with network_info: [{"id": "4036fa71-5f78-4ea2-ac8a-d97747f0b206", "address": "fa:16:3e:7f:5a:7f", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4036fa71-5f", "ovs_interfaceid": "4036fa71-5f78-4ea2-ac8a-d97747f0b206", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:17:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-23beba63-1959-4414-a2c4-30ca3cba71c7" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:17:03 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 14:17:03 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:17:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:17:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:17:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:17:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:17:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:17:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:17:06 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:17:08 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:17:09 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:17:09 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 14:17:12 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:17:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:17:14 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:17:14 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:17:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:17:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:17:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:17:14 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 14:17:14 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 14:17:15 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:17:15 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:17:15 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=8780MB free_disk=25.2667236328125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 14:17:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:17:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:17:15 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 23beba63-1959-4414-a2c4-30ca3cba71c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:17:15 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 14:17:15 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 14:17:15 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:17:15 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:17:15 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 14:17:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:17:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:17:19 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:17:19 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:17:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:17:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:17:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:17:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:17:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:17:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:17:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:17:29 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:17:30 user nova-compute[73484]: DEBUG nova.compute.manager [req-63aa4dd7-da57-4235-81f1-fdc95f25c257 req-2923b1f7-9bbc-49d4-9775-a1d6cf16afe4 service nova] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Received event network-changed-4036fa71-5f78-4ea2-ac8a-d97747f0b206 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:17:30 user nova-compute[73484]: DEBUG nova.compute.manager [req-63aa4dd7-da57-4235-81f1-fdc95f25c257 req-2923b1f7-9bbc-49d4-9775-a1d6cf16afe4 service nova] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Refreshing instance network info cache due to event network-changed-4036fa71-5f78-4ea2-ac8a-d97747f0b206. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:17:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-63aa4dd7-da57-4235-81f1-fdc95f25c257 req-2923b1f7-9bbc-49d4-9775-a1d6cf16afe4 service nova] Acquiring lock "refresh_cache-23beba63-1959-4414-a2c4-30ca3cba71c7" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:17:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-63aa4dd7-da57-4235-81f1-fdc95f25c257 req-2923b1f7-9bbc-49d4-9775-a1d6cf16afe4 service nova] Acquired lock "refresh_cache-23beba63-1959-4414-a2c4-30ca3cba71c7" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:17:30 user nova-compute[73484]: DEBUG nova.network.neutron [req-63aa4dd7-da57-4235-81f1-fdc95f25c257 req-2923b1f7-9bbc-49d4-9775-a1d6cf16afe4 service nova] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Refreshing network info cache for port 4036fa71-5f78-4ea2-ac8a-d97747f0b206 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:17:30 user nova-compute[73484]: DEBUG nova.network.neutron [req-63aa4dd7-da57-4235-81f1-fdc95f25c257 req-2923b1f7-9bbc-49d4-9775-a1d6cf16afe4 service nova] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Updated VIF entry in instance network info cache for port 4036fa71-5f78-4ea2-ac8a-d97747f0b206. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:17:30 user nova-compute[73484]: DEBUG nova.network.neutron [req-63aa4dd7-da57-4235-81f1-fdc95f25c257 req-2923b1f7-9bbc-49d4-9775-a1d6cf16afe4 service nova] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Updating instance_info_cache with network_info: [{"id": "4036fa71-5f78-4ea2-ac8a-d97747f0b206", "address": "fa:16:3e:7f:5a:7f", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4036fa71-5f", "ovs_interfaceid": "4036fa71-5f78-4ea2-ac8a-d97747f0b206", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:17:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-63aa4dd7-da57-4235-81f1-fdc95f25c257 req-2923b1f7-9bbc-49d4-9775-a1d6cf16afe4 service nova] Releasing lock "refresh_cache-23beba63-1959-4414-a2c4-30ca3cba71c7" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:17:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "23beba63-1959-4414-a2c4-30ca3cba71c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:17:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "23beba63-1959-4414-a2c4-30ca3cba71c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:17:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "23beba63-1959-4414-a2c4-30ca3cba71c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:17:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "23beba63-1959-4414-a2c4-30ca3cba71c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:17:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "23beba63-1959-4414-a2c4-30ca3cba71c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:17:31 user nova-compute[73484]: INFO nova.compute.manager [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Terminating instance
Aug 14 14:17:31 user nova-compute[73484]: DEBUG nova.compute.manager [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:17:31 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Instance destroyed successfully.
Aug 14 14:17:31 user nova-compute[73484]: DEBUG nova.objects.instance [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lazy-loading 'resources' on Instance uuid 23beba63-1959-4414-a2c4-30ca3cba71c7 {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-60227981',display_name='tempest-TestVolumeBootPattern-server-60227981',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-60227981',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0YtWHij329FNoIKSuvewNW0lchEW8QXW6SCNcWsE4ArVpjE7z7ynO0kMwxMk/WbCTDPiOAzr+p3ygxr0+DrAhogvNqNMYfgUtv1ikx8+Bfw67BfL3coNOLw+AOFNL5ew==',key_name='tempest-TestVolumeBootPattern-1333911820',keypairs=<?>,launch_index=0,launched_at=2023-08-14T14:15:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d5f985c3a8447e4870782d5e8709609',ramdisk_id='',reservation_id='r-c0nf387m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1241691583',owner_user_name='tempest-TestVolumeBootPattern-1241691583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T14:15:52Z,user_data=None,user_id='06a79841cf6743a7bd565a6084383f6c',uuid=23beba63-1959-4414-a2c4-30ca3cba71c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4036fa71-5f78-4ea2-ac8a-d97747f0b206", "address": "fa:16:3e:7f:5a:7f", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4036fa71-5f", "ovs_interfaceid": "4036fa71-5f78-4ea2-ac8a-d97747f0b206", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converting VIF {"id": "4036fa71-5f78-4ea2-ac8a-d97747f0b206", "address": "fa:16:3e:7f:5a:7f", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4036fa71-5f", "ovs_interfaceid": "4036fa71-5f78-4ea2-ac8a-d97747f0b206", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:5a:7f,bridge_name='br-int',has_traffic_filtering=True,id=4036fa71-5f78-4ea2-ac8a-d97747f0b206,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4036fa71-5f') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG os_vif [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:5a:7f,bridge_name='br-int',has_traffic_filtering=True,id=4036fa71-5f78-4ea2-ac8a-d97747f0b206,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4036fa71-5f') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4036fa71-5f, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:17:31 user nova-compute[73484]: INFO os_vif [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:5a:7f,bridge_name='br-int',has_traffic_filtering=True,id=4036fa71-5f78-4ea2-ac8a-d97747f0b206,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4036fa71-5f')
Aug 14 14:17:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IposQtFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:17:31 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:17:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[228b7dbd-2fb9-47eb-84cd-bd2e9be210f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba47a8fa-d9f4-4ec2-be83-587f208f8794]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 (non-flash)
Aug 14 14:17:31 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 (non-flash)
Aug 14 14:17:31 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4583c3250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121'): ({'sdb'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Removing single pathed devices sdb {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fb5338-7cf7-4f49-8f50-5ffec1122869]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a29ab17-1d36-4ed2-903b-5ec9fb7e6a24]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Flushing IO for device /dev/sdb {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc508536-f04c-4ed5-9ebc-89ef656f63e0]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e889440-de4a-427d-a0ef-1ed346953108]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] SCSI volumes sdb have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 14:17:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:17:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:17:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[19270d5b-7956-4a26-b266-d8841630eefe]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:17:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:17:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:17:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:17:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[364e1127-c07d-4e20-b6e9-e1112f0d253d]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:17:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121, portal: 172.16.0.220,3260]
Aug 14 14:17:32 user nova-compute[73484]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121, portal: 172.16.0.220,3260] successful.
Aug 14 14:17:32 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:17:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:17:32 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:17:32 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bd6bed-8de2-4d64-8db8-2534e91bd88a]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:17:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:17:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:17:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] <== disconnect_volume: return (293ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:17:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 14:17:32 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Deleting instance files /opt/stack/data/nova/instances/23beba63-1959-4414-a2c4-30ca3cba71c7_del
Aug 14 14:17:32 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Deletion of /opt/stack/data/nova/instances/23beba63-1959-4414-a2c4-30ca3cba71c7_del complete
Aug 14 14:17:32 user nova-compute[73484]: INFO nova.compute.manager [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 14 14:17:32 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 14:17:32 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 14:17:32 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 14:17:32 user nova-compute[73484]: DEBUG nova.compute.manager [req-2a7f10d0-6936-4760-90da-2f13f61d3e67 req-1874a96e-9d9f-42a2-942b-ce10d093f1ca service nova] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Received event network-vif-unplugged-4036fa71-5f78-4ea2-ac8a-d97747f0b206 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:17:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2a7f10d0-6936-4760-90da-2f13f61d3e67 req-1874a96e-9d9f-42a2-942b-ce10d093f1ca service nova] Acquiring lock "23beba63-1959-4414-a2c4-30ca3cba71c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:17:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2a7f10d0-6936-4760-90da-2f13f61d3e67 req-1874a96e-9d9f-42a2-942b-ce10d093f1ca service nova] Lock "23beba63-1959-4414-a2c4-30ca3cba71c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:17:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2a7f10d0-6936-4760-90da-2f13f61d3e67 req-1874a96e-9d9f-42a2-942b-ce10d093f1ca service nova] Lock "23beba63-1959-4414-a2c4-30ca3cba71c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:17:32 user nova-compute[73484]: DEBUG nova.compute.manager [req-2a7f10d0-6936-4760-90da-2f13f61d3e67 req-1874a96e-9d9f-42a2-942b-ce10d093f1ca service nova] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] No waiting events found dispatching network-vif-unplugged-4036fa71-5f78-4ea2-ac8a-d97747f0b206 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:17:32 user nova-compute[73484]: DEBUG nova.compute.manager [req-2a7f10d0-6936-4760-90da-2f13f61d3e67 req-1874a96e-9d9f-42a2-942b-ce10d093f1ca service nova] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Received event network-vif-unplugged-4036fa71-5f78-4ea2-ac8a-d97747f0b206 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 14:17:32 user nova-compute[73484]: DEBUG nova.compute.manager [req-2a7f10d0-6936-4760-90da-2f13f61d3e67 req-1874a96e-9d9f-42a2-942b-ce10d093f1ca service nova] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Received event network-vif-plugged-4036fa71-5f78-4ea2-ac8a-d97747f0b206 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:17:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2a7f10d0-6936-4760-90da-2f13f61d3e67 req-1874a96e-9d9f-42a2-942b-ce10d093f1ca service nova] Acquiring lock "23beba63-1959-4414-a2c4-30ca3cba71c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:17:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2a7f10d0-6936-4760-90da-2f13f61d3e67 req-1874a96e-9d9f-42a2-942b-ce10d093f1ca service nova] Lock "23beba63-1959-4414-a2c4-30ca3cba71c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:17:32 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2a7f10d0-6936-4760-90da-2f13f61d3e67 req-1874a96e-9d9f-42a2-942b-ce10d093f1ca service nova] Lock "23beba63-1959-4414-a2c4-30ca3cba71c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:17:32 user nova-compute[73484]: DEBUG nova.compute.manager [req-2a7f10d0-6936-4760-90da-2f13f61d3e67 req-1874a96e-9d9f-42a2-942b-ce10d093f1ca service nova] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] No waiting events found dispatching network-vif-plugged-4036fa71-5f78-4ea2-ac8a-d97747f0b206 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:17:32 user nova-compute[73484]: WARNING nova.compute.manager [req-2a7f10d0-6936-4760-90da-2f13f61d3e67 req-1874a96e-9d9f-42a2-942b-ce10d093f1ca service nova] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Received unexpected event network-vif-plugged-4036fa71-5f78-4ea2-ac8a-d97747f0b206 for instance with vm_state active and task_state deleting.
Aug 14 14:17:32 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:17:32 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Took 0.83 seconds to deallocate network for instance.
Aug 14 14:17:33 user nova-compute[73484]: DEBUG nova.compute.manager [req-9393088f-4a7f-4a91-98b2-e22f603b0809 req-c956fc71-830b-445a-875a-17e6c6be978a service nova] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Received event network-vif-deleted-4036fa71-5f78-4ea2-ac8a-d97747f0b206 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:17:33 user nova-compute[73484]: INFO nova.compute.manager [req-9393088f-4a7f-4a91-98b2-e22f603b0809 req-c956fc71-830b-445a-875a-17e6c6be978a service nova] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Neutron deleted interface 4036fa71-5f78-4ea2-ac8a-d97747f0b206; detaching it from the instance and deleting it from the info cache
Aug 14 14:17:33 user nova-compute[73484]: DEBUG nova.network.neutron [req-9393088f-4a7f-4a91-98b2-e22f603b0809 req-c956fc71-830b-445a-875a-17e6c6be978a service nova] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:17:33 user nova-compute[73484]: DEBUG nova.compute.manager [req-9393088f-4a7f-4a91-98b2-e22f603b0809 req-c956fc71-830b-445a-875a-17e6c6be978a service nova] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Detach interface failed, port_id=4036fa71-5f78-4ea2-ac8a-d97747f0b206, reason: Instance 23beba63-1959-4414-a2c4-30ca3cba71c7 could not be found. {{(pid=73484) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 14:17:33 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:17:33 user nova-compute[73484]: INFO nova.compute.manager [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Took 0.89 seconds to detach 1 volumes for instance.
Aug 14 14:17:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:17:33 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:17:33 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:17:34 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:17:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.110s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:17:34 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Deleted allocations for instance 23beba63-1959-4414-a2c4-30ca3cba71c7
Aug 14 14:17:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-7034aeda-64f3-44cc-8a14-899ce48a6a0d tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "23beba63-1959-4414-a2c4-30ca3cba71c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.168s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:17:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:17:36 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:17:41 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:17:46 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692022651.7533371, 23beba63-1959-4414-a2c4-30ca3cba71c7 => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:17:46 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] VM Stopped (Lifecycle Event)
Aug 14 14:17:46 user nova-compute[73484]: DEBUG nova.compute.manager [None req-01d6467b-2762-4786-ac53-51c1c8117d76 None None] [instance: 23beba63-1959-4414-a2c4-30ca3cba71c7] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:17:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:17:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:17:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:17:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:17:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:17:46 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:17:51 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:17:56 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:18:01 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:18:02 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:18:02 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 14:18:02 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Rebuilding the list of instances to heal {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 14:18:02 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Didn't find any instances for network info cache update. {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 14:18:04 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:18:06 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:18:07 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:18:10 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:18:10 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 14:18:11 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:18:13 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:18:13 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:18:13 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73484) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 14:18:15 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:18:15 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:18:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:18:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:18:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:18:15 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 14:18:16 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:18:16 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:18:16 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=8930MB free_disk=25.26590347290039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 14:18:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:18:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:18:16 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 14:18:16 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 14:18:16 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Refreshing inventories for resource provider 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 14:18:16 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Updating ProviderTree inventory for provider 165d4635-93b4-49a6-879a-21c1324822ab from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 14:18:16 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Updating inventory in ProviderTree for provider 165d4635-93b4-49a6-879a-21c1324822ab with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 14:18:16 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Refreshing aggregate associations for resource provider 165d4635-93b4-49a6-879a-21c1324822ab, aggregates: None {{(pid=73484) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 14:18:16 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Refreshing trait associations for resource provider 165d4635-93b4-49a6-879a-21c1324822ab, traits: COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS {{(pid=73484) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 14:18:16 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:18:16 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:18:16 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 14:18:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.319s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:18:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:18:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:18:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:18:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:18:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:18:16 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:18:18 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:18:18 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Cleaning up deleted instances {{(pid=73484) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 14:18:18 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] There are 0 instances to clean {{(pid=73484) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 14:18:18 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:18:19 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:18:19 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:18:21 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:18:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "145baef9-6d0e-4243-b1cc-67e426e7888c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:18:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "145baef9-6d0e-4243-b1cc-67e426e7888c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:18:22 user nova-compute[73484]: DEBUG nova.compute.manager [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 14:18:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:18:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:18:22 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 14:18:22 user nova-compute[73484]: INFO nova.compute.claims [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Claim successful on node user
Aug 14 14:18:22 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:18:22 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:18:23 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.193s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:18:23 user nova-compute[73484]: DEBUG nova.compute.manager [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 14:18:23 user nova-compute[73484]: DEBUG nova.compute.manager [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 14:18:23 user nova-compute[73484]: DEBUG nova.network.neutron [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 14:18:23 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 14:18:23 user nova-compute[73484]: DEBUG nova.compute.manager [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 14:18:23 user nova-compute[73484]: INFO nova.virt.block_device [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Booting with volume d162c163-fcf9-4d3f-b793-ebd8d3be9121 at /dev/vda
Aug 14 14:18:23 user nova-compute[73484]: DEBUG os_brick.utils [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:18:23 user nova-compute[73484]: DEBUG nova.policy [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06a79841cf6743a7bd565a6084383f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f985c3a8447e4870782d5e8709609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 14:18:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:18:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:18:23 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[08dad309-cc5a-46ad-9dab-3206b3528f64]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:18:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:18:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:18:23 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[26967d36-8b01-4aa8-af32-a7145d563294]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:18:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:18:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:18:23 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7895b5-857c-4a89-b6a6-cb5b82c843ab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:18:23 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dff5f6a-edb3-460c-923d-5a22cec0e363]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:18:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:18:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:18:23 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 14:18:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:18:23 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:18:23 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 14:18:23 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee131e40-41e6-483e-bb92-64ea92bc3c6e]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:18:23 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 14:18:23 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 14:18:23 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 14:18:23 user nova-compute[73484]: DEBUG os_brick.utils [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:18:23 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Updating existing volume attachment record: 330b437c-a0da-4eff-9ce9-612af80c474a {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 14:18:24 user nova-compute[73484]: DEBUG nova.network.neutron [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Successfully created port: df2c480e-463a-4a4e-a6a6-295ff11493e4 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 14:18:24 user nova-compute[73484]: DEBUG nova.network.neutron [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Successfully updated port: df2c480e-463a-4a4e-a6a6-295ff11493e4 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 14:18:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "refresh_cache-145baef9-6d0e-4243-b1cc-67e426e7888c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:18:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquired lock "refresh_cache-145baef9-6d0e-4243-b1cc-67e426e7888c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:18:24 user nova-compute[73484]: DEBUG nova.network.neutron [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 14:18:24 user nova-compute[73484]: DEBUG nova.compute.manager [req-3708186d-77ee-437e-907f-45a6092d574a req-71b663ee-48eb-45ca-885f-0946c54d3c49 service nova] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Received event network-changed-df2c480e-463a-4a4e-a6a6-295ff11493e4 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:18:24 user nova-compute[73484]: DEBUG nova.compute.manager [req-3708186d-77ee-437e-907f-45a6092d574a req-71b663ee-48eb-45ca-885f-0946c54d3c49 service nova] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Refreshing instance network info cache due to event network-changed-df2c480e-463a-4a4e-a6a6-295ff11493e4. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:18:24 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3708186d-77ee-437e-907f-45a6092d574a req-71b663ee-48eb-45ca-885f-0946c54d3c49 service nova] Acquiring lock "refresh_cache-145baef9-6d0e-4243-b1cc-67e426e7888c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:18:24 user nova-compute[73484]: DEBUG nova.network.neutron [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 14:18:25 user nova-compute[73484]: DEBUG nova.network.neutron [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Updating instance_info_cache with network_info: [{"id": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "address": "fa:16:3e:c9:9a:16", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf2c480e-46", "ovs_interfaceid": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:18:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Releasing lock "refresh_cache-145baef9-6d0e-4243-b1cc-67e426e7888c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:18:25 user nova-compute[73484]: DEBUG nova.compute.manager [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Instance network_info: |[{"id": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "address": "fa:16:3e:c9:9a:16", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf2c480e-46", "ovs_interfaceid": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 14:18:25 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3708186d-77ee-437e-907f-45a6092d574a req-71b663ee-48eb-45ca-885f-0946c54d3c49 service nova] Acquired lock "refresh_cache-145baef9-6d0e-4243-b1cc-67e426e7888c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:18:25 user nova-compute[73484]: DEBUG nova.network.neutron [req-3708186d-77ee-437e-907f-45a6092d574a req-71b663ee-48eb-45ca-885f-0946c54d3c49 service nova] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Refreshing network info cache for port df2c480e-463a-4a4e-a6a6-295ff11493e4 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:18:26 user nova-compute[73484]: DEBUG nova.network.neutron [req-3708186d-77ee-437e-907f-45a6092d574a req-71b663ee-48eb-45ca-885f-0946c54d3c49 service nova] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Updated VIF entry in instance network info cache for port df2c480e-463a-4a4e-a6a6-295ff11493e4. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:18:26 user nova-compute[73484]: DEBUG nova.network.neutron [req-3708186d-77ee-437e-907f-45a6092d574a req-71b663ee-48eb-45ca-885f-0946c54d3c49 service nova] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Updating instance_info_cache with network_info: [{"id": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "address": "fa:16:3e:c9:9a:16", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf2c480e-46", "ovs_interfaceid": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:18:26 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-3708186d-77ee-437e-907f-45a6092d574a req-71b663ee-48eb-45ca-885f-0946c54d3c49 service nova] Releasing lock "refresh_cache-145baef9-6d0e-4243-b1cc-67e426e7888c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:18:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG nova.compute.manager [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 14:18:31 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Creating image(s)
Aug 14 14:18:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Did not create local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Ensure instance console log exists: /opt/stack/data/nova/instances/145baef9-6d0e-4243-b1cc-67e426e7888c/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Start _get_guest_xml network_info=[{"id": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "address": "fa:16:3e:c9:9a:16", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf2c480e-46", "ovs_interfaceid": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '330b437c-a0da-4eff-9ce9-612af80c474a', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IposQtFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '145baef9-6d0e-4243-b1cc-67e426e7888c', 'attached_at': '', 'detached_at': '', 'volume_id': 'd162c163-fcf9-4d3f-b793-ebd8d3be9121', 'serial': 'd162c163-fcf9-4d3f-b793-ebd8d3be9121'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 14:18:31 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:18:31 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:18:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IposQtFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:18:31 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:18:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:18:31 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:18:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:18:31 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07c2a2d-0a20-4c22-991b-4c142cb04599]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 14:18:31 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[3476dda6-a974-41fb-a3ba-3fb23c8e18ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121] added
Aug 14 14:18:31 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[935f7ee9-033c-48df-9b05-758957586b17]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ef8fac-e1cf-4f45-a095-f804fb6aa2ad]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IposQtFg {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IposQtFg" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c311103d-64ab-44cf-92d2-583d858dbf85]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IposQtFg'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e447d8d-556c-472f-b45f-a7844e381f28]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be24330-b328-400f-aa95-90735e003ca0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 14:18:31 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 14:18:31 user nova-compute[73484]:  {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:18:31 user nova-compute[73484]: WARNING os_brick.initiator.connectors.iscsi [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 14:18:31 user nova-compute[73484]: 
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc66b7a2-6a15-44ee-bdc8-2f3d054de7c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121, portal: 172.16.0.220,3260]
Aug 14 14:18:31 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121, portal: 172.16.0.220,3260] successful.
Aug 14 14:18:31 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08c8dbe-2d94-4cc2-9b7f-ce1c689eba63]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d27e46-cfd4-4f32-87ae-4ea425fa5e54]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 (non-flash)
Aug 14 14:18:31 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 (non-flash)
Aug 14 14:18:31 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[242cc26d-da78-454e-bfce-0a3be8284abe]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: None {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 14:18:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:18:32 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 14:18:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IposQtFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 14:18:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:18:32 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23730386631643437', 'path': '/dev/sdb'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:18:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730386631643437', 'path': '/dev/sdb'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 14:18:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:18:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-743847908',display_name='tempest-TestVolumeBootPattern-server-743847908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-743847908',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0YtWHij329FNoIKSuvewNW0lchEW8QXW6SCNcWsE4ArVpjE7z7ynO0kMwxMk/WbCTDPiOAzr+p3ygxr0+DrAhogvNqNMYfgUtv1ikx8+Bfw67BfL3coNOLw+AOFNL5ew==',key_name='tempest-TestVolumeBootPattern-1333911820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d5f985c3a8447e4870782d5e8709609',ramdisk_id='',reservation_id='r-nf2bcbul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1241691583',owner_user_name='tempest-TestVolumeBootPattern-1241691583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:18:23Z,user_data=None,user_id='06a79841cf6743a7bd565a6084383f6c',uuid=145baef9-6d0e-4243-b1cc-67e426e7888c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "address": "fa:16:3e:c9:9a:16", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf2c480e-46", "ovs_interfaceid": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 14:18:32 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converting VIF {"id": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "address": "fa:16:3e:c9:9a:16", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf2c480e-46", "ovs_interfaceid": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:18:32 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9a:16,bridge_name='br-int',has_traffic_filtering=True,id=df2c480e-463a-4a4e-a6a6-295ff11493e4,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf2c480e-46') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:18:32 user nova-compute[73484]: DEBUG nova.objects.instance [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lazy-loading 'pci_devices' on Instance uuid 145baef9-6d0e-4243-b1cc-67e426e7888c {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:18:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] End _get_guest_xml xml=<domain type="kvm">
Aug 14 14:18:32 user nova-compute[73484]:   <uuid>145baef9-6d0e-4243-b1cc-67e426e7888c</uuid>
Aug 14 14:18:32 user nova-compute[73484]:   <name>instance-00000033</name>
Aug 14 14:18:32 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 14:18:32 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 14:18:32 user nova-compute[73484]:   <metadata>
Aug 14 14:18:32 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 14:18:32 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 14:18:32 user nova-compute[73484]:       <nova:name>tempest-TestVolumeBootPattern-server-743847908</nova:name>
Aug 14 14:18:32 user nova-compute[73484]:       <nova:creationTime>2023-08-14 14:18:31</nova:creationTime>
Aug 14 14:18:32 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 14:18:32 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 14:18:32 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 14:18:32 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 14:18:32 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 14:18:32 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 14:18:32 user nova-compute[73484]:       </nova:flavor>
Aug 14 14:18:32 user nova-compute[73484]:       <nova:owner>
Aug 14 14:18:32 user nova-compute[73484]:         <nova:user uuid="06a79841cf6743a7bd565a6084383f6c">tempest-TestVolumeBootPattern-1241691583-project-member</nova:user>
Aug 14 14:18:32 user nova-compute[73484]:         <nova:project uuid="1d5f985c3a8447e4870782d5e8709609">tempest-TestVolumeBootPattern-1241691583</nova:project>
Aug 14 14:18:32 user nova-compute[73484]:       </nova:owner>
Aug 14 14:18:32 user nova-compute[73484]:       <nova:ports>
Aug 14 14:18:32 user nova-compute[73484]:         <nova:port uuid="df2c480e-463a-4a4e-a6a6-295ff11493e4">
Aug 14 14:18:32 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 14:18:32 user nova-compute[73484]:         </nova:port>
Aug 14 14:18:32 user nova-compute[73484]:       </nova:ports>
Aug 14 14:18:32 user nova-compute[73484]:     </nova:instance>
Aug 14 14:18:32 user nova-compute[73484]:   </metadata>
Aug 14 14:18:32 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 14:18:32 user nova-compute[73484]:     <system>
Aug 14 14:18:32 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 14:18:32 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 14:18:32 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 14:18:32 user nova-compute[73484]:       <entry name="serial">145baef9-6d0e-4243-b1cc-67e426e7888c</entry>
Aug 14 14:18:32 user nova-compute[73484]:       <entry name="uuid">145baef9-6d0e-4243-b1cc-67e426e7888c</entry>
Aug 14 14:18:32 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 14:18:32 user nova-compute[73484]:     </system>
Aug 14 14:18:32 user nova-compute[73484]:   </sysinfo>
Aug 14 14:18:32 user nova-compute[73484]:   <os>
Aug 14 14:18:32 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 14:18:32 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 14:18:32 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 14:18:32 user nova-compute[73484]:   </os>
Aug 14 14:18:32 user nova-compute[73484]:   <features>
Aug 14 14:18:32 user nova-compute[73484]:     <acpi/>
Aug 14 14:18:32 user nova-compute[73484]:     <apic/>
Aug 14 14:18:32 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 14:18:32 user nova-compute[73484]:   </features>
Aug 14 14:18:32 user nova-compute[73484]:   <clock offset="utc">
Aug 14 14:18:32 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 14:18:32 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 14:18:32 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 14:18:32 user nova-compute[73484]:   </clock>
Aug 14 14:18:32 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 14:18:32 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 14:18:32 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 14:18:32 user nova-compute[73484]:   </cpu>
Aug 14 14:18:32 user nova-compute[73484]:   <devices>
Aug 14 14:18:32 user nova-compute[73484]:     <disk type="block" device="disk">
Aug 14 14:18:32 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:18:32 user nova-compute[73484]:       <source dev="/dev/sdb"/>
Aug 14 14:18:32 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 14:18:32 user nova-compute[73484]:       <serial>d162c163-fcf9-4d3f-b793-ebd8d3be9121</serial>
Aug 14 14:18:32 user nova-compute[73484]:     </disk>
Aug 14 14:18:32 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 14:18:32 user nova-compute[73484]:       <mac address="fa:16:3e:c9:9a:16"/>
Aug 14 14:18:32 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 14:18:32 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 14:18:32 user nova-compute[73484]:       <target dev="tapdf2c480e-46"/>
Aug 14 14:18:32 user nova-compute[73484]:     </interface>
Aug 14 14:18:32 user nova-compute[73484]:     <serial type="pty">
Aug 14 14:18:32 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/145baef9-6d0e-4243-b1cc-67e426e7888c/console.log" append="off"/>
Aug 14 14:18:32 user nova-compute[73484]:     </serial>
Aug 14 14:18:32 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 14:18:32 user nova-compute[73484]:     <video>
Aug 14 14:18:32 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 14:18:32 user nova-compute[73484]:     </video>
Aug 14 14:18:32 user nova-compute[73484]:     <rng model="virtio">
Aug 14 14:18:32 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 14:18:32 user nova-compute[73484]:     </rng>
Aug 14 14:18:32 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 14:18:32 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 14:18:32 user nova-compute[73484]:       <stats period="10"/>
Aug 14 14:18:32 user nova-compute[73484]:     </memballoon>
Aug 14 14:18:32 user nova-compute[73484]:   </devices>
Aug 14 14:18:32 user nova-compute[73484]: </domain>
Aug 14 14:18:32 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 14:18:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:18:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-743847908',display_name='tempest-TestVolumeBootPattern-server-743847908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-743847908',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0YtWHij329FNoIKSuvewNW0lchEW8QXW6SCNcWsE4ArVpjE7z7ynO0kMwxMk/WbCTDPiOAzr+p3ygxr0+DrAhogvNqNMYfgUtv1ikx8+Bfw67BfL3coNOLw+AOFNL5ew==',key_name='tempest-TestVolumeBootPattern-1333911820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d5f985c3a8447e4870782d5e8709609',ramdisk_id='',reservation_id='r-nf2bcbul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1241691583',owner_user_name='tempest-TestVolumeBootPattern-1241691583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:18:23Z,user_data=None,user_id='06a79841cf6743a7bd565a6084383f6c',uuid=145baef9-6d0e-4243-b1cc-67e426e7888c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "address": "fa:16:3e:c9:9a:16", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf2c480e-46", "ovs_interfaceid": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 14:18:32 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converting VIF {"id": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "address": "fa:16:3e:c9:9a:16", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf2c480e-46", "ovs_interfaceid": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:18:32 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9a:16,bridge_name='br-int',has_traffic_filtering=True,id=df2c480e-463a-4a4e-a6a6-295ff11493e4,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf2c480e-46') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:18:32 user nova-compute[73484]: DEBUG os_vif [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9a:16,bridge_name='br-int',has_traffic_filtering=True,id=df2c480e-463a-4a4e-a6a6-295ff11493e4,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf2c480e-46') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 14:18:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:18:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:18:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 14:18:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:18:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf2c480e-46, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:18:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdf2c480e-46, col_values=(('external_ids', {'iface-id': 'df2c480e-463a-4a4e-a6a6-295ff11493e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:9a:16', 'vm-uuid': '145baef9-6d0e-4243-b1cc-67e426e7888c'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:18:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:18:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:18:32 user nova-compute[73484]: INFO os_vif [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:9a:16,bridge_name='br-int',has_traffic_filtering=True,id=df2c480e-463a-4a4e-a6a6-295ff11493e4,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf2c480e-46')
Aug 14 14:18:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:18:32 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] No VIF found with MAC fa:16:3e:c9:9a:16, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:18:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:18:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:18:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:18:34 user nova-compute[73484]: DEBUG nova.compute.manager [req-2e3f401b-0428-4482-b882-e7e5791490fc req-09ef9829-53ba-4e3e-be35-241bf23cb101 service nova] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Received event network-vif-plugged-df2c480e-463a-4a4e-a6a6-295ff11493e4 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:18:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2e3f401b-0428-4482-b882-e7e5791490fc req-09ef9829-53ba-4e3e-be35-241bf23cb101 service nova] Acquiring lock "145baef9-6d0e-4243-b1cc-67e426e7888c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:18:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2e3f401b-0428-4482-b882-e7e5791490fc req-09ef9829-53ba-4e3e-be35-241bf23cb101 service nova] Lock "145baef9-6d0e-4243-b1cc-67e426e7888c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:18:34 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-2e3f401b-0428-4482-b882-e7e5791490fc req-09ef9829-53ba-4e3e-be35-241bf23cb101 service nova] Lock "145baef9-6d0e-4243-b1cc-67e426e7888c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:18:34 user nova-compute[73484]: DEBUG nova.compute.manager [req-2e3f401b-0428-4482-b882-e7e5791490fc req-09ef9829-53ba-4e3e-be35-241bf23cb101 service nova] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] No waiting events found dispatching network-vif-plugged-df2c480e-463a-4a4e-a6a6-295ff11493e4 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:18:34 user nova-compute[73484]: WARNING nova.compute.manager [req-2e3f401b-0428-4482-b882-e7e5791490fc req-09ef9829-53ba-4e3e-be35-241bf23cb101 service nova] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Received unexpected event network-vif-plugged-df2c480e-463a-4a4e-a6a6-295ff11493e4 for instance with vm_state building and task_state spawning.
Aug 14 14:18:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:18:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:18:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:18:34 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:18:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:18:36 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692022716.1469274, 145baef9-6d0e-4243-b1cc-67e426e7888c => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:18:36 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] VM Resumed (Lifecycle Event)
Aug 14 14:18:36 user nova-compute[73484]: DEBUG nova.compute.manager [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 14:18:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 14:18:36 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Instance spawned successfully.
Aug 14 14:18:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 14:18:36 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:18:36 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:18:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:18:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:18:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:18:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:18:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:18:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:18:36 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:18:36 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692022716.1480818, 145baef9-6d0e-4243-b1cc-67e426e7888c => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:18:36 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] VM Started (Lifecycle Event)
Aug 14 14:18:36 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:18:36 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:18:36 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:18:36 user nova-compute[73484]: INFO nova.compute.manager [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Took 4.85 seconds to spawn the instance on the hypervisor.
Aug 14 14:18:36 user nova-compute[73484]: DEBUG nova.compute.manager [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:18:36 user nova-compute[73484]: INFO nova.compute.manager [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Took 13.55 seconds to build instance.
Aug 14 14:18:36 user nova-compute[73484]: DEBUG nova.compute.manager [req-695243ca-af4f-4e17-828b-0d59fdd34e15 req-13913b61-920e-4ca9-b55b-0a69591686c4 service nova] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Received event network-vif-plugged-df2c480e-463a-4a4e-a6a6-295ff11493e4 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:18:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-695243ca-af4f-4e17-828b-0d59fdd34e15 req-13913b61-920e-4ca9-b55b-0a69591686c4 service nova] Acquiring lock "145baef9-6d0e-4243-b1cc-67e426e7888c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:18:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-695243ca-af4f-4e17-828b-0d59fdd34e15 req-13913b61-920e-4ca9-b55b-0a69591686c4 service nova] Lock "145baef9-6d0e-4243-b1cc-67e426e7888c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:18:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-695243ca-af4f-4e17-828b-0d59fdd34e15 req-13913b61-920e-4ca9-b55b-0a69591686c4 service nova] Lock "145baef9-6d0e-4243-b1cc-67e426e7888c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:18:36 user nova-compute[73484]: DEBUG nova.compute.manager [req-695243ca-af4f-4e17-828b-0d59fdd34e15 req-13913b61-920e-4ca9-b55b-0a69591686c4 service nova] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] No waiting events found dispatching network-vif-plugged-df2c480e-463a-4a4e-a6a6-295ff11493e4 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:18:36 user nova-compute[73484]: WARNING nova.compute.manager [req-695243ca-af4f-4e17-828b-0d59fdd34e15 req-13913b61-920e-4ca9-b55b-0a69591686c4 service nova] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Received unexpected event network-vif-plugged-df2c480e-463a-4a4e-a6a6-295ff11493e4 for instance with vm_state active and task_state None.
Aug 14 14:18:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-243e92c5-fc9c-4c24-ad4f-ddc7464c91e0 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "145baef9-6d0e-4243-b1cc-67e426e7888c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.645s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:18:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:18:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:18:42 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:18:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:18:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:18:52 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:18:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:18:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:19:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:19:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:19:03 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:19:03 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 14:19:03 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Rebuilding the list of instances to heal {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 14:19:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-145baef9-6d0e-4243-b1cc-67e426e7888c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:19:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-145baef9-6d0e-4243-b1cc-67e426e7888c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:19:03 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 14:19:03 user nova-compute[73484]: DEBUG nova.objects.instance [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lazy-loading 'info_cache' on Instance uuid 145baef9-6d0e-4243-b1cc-67e426e7888c {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:19:04 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Updating instance_info_cache with network_info: [{"id": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "address": "fa:16:3e:c9:9a:16", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf2c480e-46", "ovs_interfaceid": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:19:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-145baef9-6d0e-4243-b1cc-67e426e7888c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:19:04 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 14:19:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:19:05 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:19:07 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:19:08 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:19:10 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:19:10 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 14:19:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:19:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:19:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:19:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:19:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:19:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:19:13 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:19:15 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:19:15 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:19:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:19:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:19:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:19:15 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 14:19:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 14:19:16 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:19:16 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:19:16 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=8789MB free_disk=25.264156341552734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 14:19:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:19:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:19:16 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 145baef9-6d0e-4243-b1cc-67e426e7888c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:19:16 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 14:19:16 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 14:19:16 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:19:16 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:19:16 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 14:19:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:19:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:19:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:19:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:19:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:19:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:19:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:19:20 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:19:20 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:19:22 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:19:22 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:19:22 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:19:22 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:19:22 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:19:22 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:19:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:19:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:19:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:19:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:19:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:19:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:19:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:19:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:19:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:19:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:19:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:19:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:19:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:19:38 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:19:42 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:19:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:19:52 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:19:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:20:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:20:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:20:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:20:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:20:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:20:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:20:03 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:20:03 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 14:20:03 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Rebuilding the list of instances to heal {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 14:20:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-145baef9-6d0e-4243-b1cc-67e426e7888c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:20:03 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-145baef9-6d0e-4243-b1cc-67e426e7888c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:20:03 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 14:20:03 user nova-compute[73484]: DEBUG nova.objects.instance [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lazy-loading 'info_cache' on Instance uuid 145baef9-6d0e-4243-b1cc-67e426e7888c {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:20:04 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Updating instance_info_cache with network_info: [{"id": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "address": "fa:16:3e:c9:9a:16", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf2c480e-46", "ovs_interfaceid": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:20:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-145baef9-6d0e-4243-b1cc-67e426e7888c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:20:04 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 14:20:06 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:20:07 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:20:10 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:20:12 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:20:12 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 14:20:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:20:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:20:14 user nova-compute[73484]: DEBUG nova.compute.manager [req-cc950907-4936-4c5a-86dd-cc354a59b20c req-45f9d6ea-3132-4b1e-ba4d-4558032569e1 service nova] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Received event network-changed-df2c480e-463a-4a4e-a6a6-295ff11493e4 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:20:14 user nova-compute[73484]: DEBUG nova.compute.manager [req-cc950907-4936-4c5a-86dd-cc354a59b20c req-45f9d6ea-3132-4b1e-ba4d-4558032569e1 service nova] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Refreshing instance network info cache due to event network-changed-df2c480e-463a-4a4e-a6a6-295ff11493e4. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:20:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-cc950907-4936-4c5a-86dd-cc354a59b20c req-45f9d6ea-3132-4b1e-ba4d-4558032569e1 service nova] Acquiring lock "refresh_cache-145baef9-6d0e-4243-b1cc-67e426e7888c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:20:14 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-cc950907-4936-4c5a-86dd-cc354a59b20c req-45f9d6ea-3132-4b1e-ba4d-4558032569e1 service nova] Acquired lock "refresh_cache-145baef9-6d0e-4243-b1cc-67e426e7888c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:20:14 user nova-compute[73484]: DEBUG nova.network.neutron [req-cc950907-4936-4c5a-86dd-cc354a59b20c req-45f9d6ea-3132-4b1e-ba4d-4558032569e1 service nova] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Refreshing network info cache for port df2c480e-463a-4a4e-a6a6-295ff11493e4 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:20:14 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:20:15 user nova-compute[73484]: DEBUG nova.network.neutron [req-cc950907-4936-4c5a-86dd-cc354a59b20c req-45f9d6ea-3132-4b1e-ba4d-4558032569e1 service nova] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Updated VIF entry in instance network info cache for port df2c480e-463a-4a4e-a6a6-295ff11493e4. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:20:15 user nova-compute[73484]: DEBUG nova.network.neutron [req-cc950907-4936-4c5a-86dd-cc354a59b20c req-45f9d6ea-3132-4b1e-ba4d-4558032569e1 service nova] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Updating instance_info_cache with network_info: [{"id": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "address": "fa:16:3e:c9:9a:16", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf2c480e-46", "ovs_interfaceid": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:20:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:20:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-cc950907-4936-4c5a-86dd-cc354a59b20c req-45f9d6ea-3132-4b1e-ba4d-4558032569e1 service nova] Releasing lock "refresh_cache-145baef9-6d0e-4243-b1cc-67e426e7888c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:20:15 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:20:15 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:20:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:20:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:20:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:20:15 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 14:20:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 14:20:16 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:20:16 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:20:16 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=8800MB free_disk=25.263477325439453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 14:20:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:20:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:20:16 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 145baef9-6d0e-4243-b1cc-67e426e7888c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:20:16 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 14:20:16 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 14:20:16 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:20:16 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:20:16 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 14:20:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:20:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:20:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:20:21 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:20:21 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:20:22 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:20:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "1fdf8225-f999-4be8-b119-33f9038d295c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "1fdf8225-f999-4be8-b119-33f9038d295c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Starting instance... {{(pid=73484) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73484) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 14:20:27 user nova-compute[73484]: INFO nova.compute.claims [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Claim successful on node user
Aug 14 14:20:27 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.199s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Start building networks asynchronously for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Allocating IP information in the background. {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG nova.network.neutron [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] allocate_for_instance() {{(pid=73484) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 14:20:27 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 14:20:27 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Start building block device mappings for instance. {{(pid=73484) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 14:20:27 user nova-compute[73484]: INFO nova.virt.block_device [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Booting with volume b1bcc318-fe67-4bcb-bf0f-73b537c473a4 at /dev/vda
Aug 14 14:20:27 user nova-compute[73484]: DEBUG nova.policy [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06a79841cf6743a7bd565a6084383f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5f985c3a8447e4870782d5e8709609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73484) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG os_brick.utils [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[050d7e87-c11a-42c8-9541-0353a8e0b8f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3c24cdab8752\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabd8b0a-1583-406a-876d-e0aad3a9c251]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[797db9a6-c086-403a-8c9f-c7a07a1de66f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca683239-1b16-4814-9bb8-3fd037b6e29c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Running cmd (subprocess): nvme version {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] 'nvme version' failed. Not Retrying. {{(pid=73484) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] nvme not present on system {{(pid=73484) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:20:27 user nova-compute[73484]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 14:20:27 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfc1436-664b-479a-aa9a-c68b782db1c1]: (4, '') {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73484) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.lightos [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] LIGHTOS: no hostnqn found. {{(pid=73484) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG os_brick.utils [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3c24cdab8752', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:20:27 user nova-compute[73484]: DEBUG nova.virt.block_device [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Updating existing volume attachment record: 9990d59e-3cd1-424e-a917-7d68f0706217 {{(pid=73484) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 14:20:28 user nova-compute[73484]: DEBUG nova.network.neutron [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Successfully created port: 4c20306a-ebd2-4025-9e99-7edba4bcf4e3 {{(pid=73484) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 14:20:29 user nova-compute[73484]: DEBUG nova.network.neutron [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Successfully updated port: 4c20306a-ebd2-4025-9e99-7edba4bcf4e3 {{(pid=73484) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 14:20:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "refresh_cache-1fdf8225-f999-4be8-b119-33f9038d295c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:20:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquired lock "refresh_cache-1fdf8225-f999-4be8-b119-33f9038d295c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:20:29 user nova-compute[73484]: DEBUG nova.network.neutron [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Building network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 14:20:29 user nova-compute[73484]: DEBUG nova.compute.manager [req-0441c424-d113-47d9-acc3-69a5623a5845 req-5f58a26d-6c1b-4267-997b-130d87cb8ecc service nova] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Received event network-changed-4c20306a-ebd2-4025-9e99-7edba4bcf4e3 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:20:29 user nova-compute[73484]: DEBUG nova.compute.manager [req-0441c424-d113-47d9-acc3-69a5623a5845 req-5f58a26d-6c1b-4267-997b-130d87cb8ecc service nova] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Refreshing instance network info cache due to event network-changed-4c20306a-ebd2-4025-9e99-7edba4bcf4e3. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:20:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0441c424-d113-47d9-acc3-69a5623a5845 req-5f58a26d-6c1b-4267-997b-130d87cb8ecc service nova] Acquiring lock "refresh_cache-1fdf8225-f999-4be8-b119-33f9038d295c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:20:29 user nova-compute[73484]: DEBUG nova.network.neutron [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Instance cache missing network info. {{(pid=73484) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 14:20:29 user nova-compute[73484]: DEBUG nova.network.neutron [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Updating instance_info_cache with network_info: [{"id": "4c20306a-ebd2-4025-9e99-7edba4bcf4e3", "address": "fa:16:3e:b8:d6:6f", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c20306a-eb", "ovs_interfaceid": "4c20306a-ebd2-4025-9e99-7edba4bcf4e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:20:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Releasing lock "refresh_cache-1fdf8225-f999-4be8-b119-33f9038d295c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:20:29 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Instance network_info: |[{"id": "4c20306a-ebd2-4025-9e99-7edba4bcf4e3", "address": "fa:16:3e:b8:d6:6f", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c20306a-eb", "ovs_interfaceid": "4c20306a-ebd2-4025-9e99-7edba4bcf4e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73484) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 14:20:29 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0441c424-d113-47d9-acc3-69a5623a5845 req-5f58a26d-6c1b-4267-997b-130d87cb8ecc service nova] Acquired lock "refresh_cache-1fdf8225-f999-4be8-b119-33f9038d295c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:20:29 user nova-compute[73484]: DEBUG nova.network.neutron [req-0441c424-d113-47d9-acc3-69a5623a5845 req-5f58a26d-6c1b-4267-997b-130d87cb8ecc service nova] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Refreshing network info cache for port 4c20306a-ebd2-4025-9e99-7edba4bcf4e3 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:20:30 user nova-compute[73484]: DEBUG nova.network.neutron [req-0441c424-d113-47d9-acc3-69a5623a5845 req-5f58a26d-6c1b-4267-997b-130d87cb8ecc service nova] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Updated VIF entry in instance network info cache for port 4c20306a-ebd2-4025-9e99-7edba4bcf4e3. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:20:30 user nova-compute[73484]: DEBUG nova.network.neutron [req-0441c424-d113-47d9-acc3-69a5623a5845 req-5f58a26d-6c1b-4267-997b-130d87cb8ecc service nova] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Updating instance_info_cache with network_info: [{"id": "4c20306a-ebd2-4025-9e99-7edba4bcf4e3", "address": "fa:16:3e:b8:d6:6f", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c20306a-eb", "ovs_interfaceid": "4c20306a-ebd2-4025-9e99-7edba4bcf4e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:20:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-0441c424-d113-47d9-acc3-69a5623a5845 req-5f58a26d-6c1b-4267-997b-130d87cb8ecc service nova] Releasing lock "refresh_cache-1fdf8225-f999-4be8-b119-33f9038d295c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:20:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:20:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Start spawning the instance on the hypervisor. {{(pid=73484) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Creating instance directory {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 14:20:36 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Creating image(s)
Aug 14 14:20:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Did not create local disks {{(pid=73484) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Ensure instance console log exists: /opt/stack/data/nova/instances/1fdf8225-f999-4be8-b119-33f9038d295c/console.log {{(pid=73484) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Start _get_guest_xml network_info=[{"id": "4c20306a-ebd2-4025-9e99-7edba4bcf4e3", "address": "fa:16:3e:b8:d6:6f", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c20306a-eb", "ovs_interfaceid": "4c20306a-ebd2-4025-9e99-7edba4bcf4e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9990d59e-3cd1-424e-a917-7d68f0706217', 'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHYXIabr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1fdf8225-f999-4be8-b119-33f9038d295c', 'attached_at': '', 'detached_at': '', 'volume_id': 'b1bcc318-fe67-4bcb-bf0f-73b537c473a4', 'serial': 'b1bcc318-fe67-4bcb-bf0f-73b537c473a4'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None} {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 14:20:36 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:20:36 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:20:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] CPU controller missing on host. {{(pid=73484) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.host [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] CPU controller found on host. {{(pid=73484) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73484) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T13:32:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Flavor limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Image limits 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Flavor pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Image pref 0:0:0 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Got 1 possible topologies {{(pid=73484) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG nova.virt.hardware [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73484) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Calling os-brick to attach iSCSI Volume {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHYXIabr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:20:36 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:20:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:20:36 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:20:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:20:36 user nova-compute[73484]: INFO os_brick.initiator.connectors.iscsi [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4 -p 172.16.0.220:3260 {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d688cb77-8962-42d2-ad28-c2a4fe8894c8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 14:20:36 user nova-compute[73484]:  {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8c5bb0-801d-4cce-8a49-2b4b35de92be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4] added\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4] added
Aug 14 14:20:36 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5512d6-473f-4a19-9cfb-f019efd30c16]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ede5b1a-2d2b-42a0-b198-1c23ba9ba3c2]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vHYXIabr {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vHYXIabr" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dde1f06-b5d0-497c-8b8b-8c79afe3e2dd]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vHYXIabr'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[9230d21f-643d-4540-81ed-10d8fc84ec11]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12d54b1-13cc-48cf-99e7-23d717a57285]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 (non-flash)
Aug 14 14:20:36 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 (non-flash)
Aug 14 14:20:36 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4 -p 172.16.0.220:3260 --login {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c22e6f4-6339-4783-a874-e927e42ac11f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4, portal: 172.16.0.220,3260]
Aug 14 14:20:36 user nova-compute[73484]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4, portal: 172.16.0.220,3260] successful.
Aug 14 14:20:36 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97a842c-cae3-4abf-9177-31911b99f48c]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9f192e-539f-4784-8128-92e33213fdb8]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 (non-flash)\ntcp: [64] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 (non-flash)
Aug 14 14:20:36 user nova-compute[73484]: tcp: [64] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4 (non-flash)
Aug 14 14:20:36 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 (non-flash)
Aug 14 14:20:36 user nova-compute[73484]: tcp: [64] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4 (non-flash)
Aug 14 14:20:36 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Connected to 172.16.0.220:3260 {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] HCTL ('34', '-', '-', 0) found on session 64 with lun 0 {{(pid=73484) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73484) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc621ff-1316-4712-8381-66808f9b1c2b]: (4, ('- - 0', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:20:36 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Searching for a device in session 64 and hctl ['34', '*', '*', 0] yield: None {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 14:20:37 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Searching for a device in session 64 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73484) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 14:20:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHYXIabr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73484) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 14:20:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:20:37 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23634343935353663', 'path': '/dev/sdc'} {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:20:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634343935353663', 'path': '/dev/sdc'} {{(pid=73484) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 14:20:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:20:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1992131546',display_name='tempest-TestVolumeBootPattern-server-1992131546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1992131546',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0YtWHij329FNoIKSuvewNW0lchEW8QXW6SCNcWsE4ArVpjE7z7ynO0kMwxMk/WbCTDPiOAzr+p3ygxr0+DrAhogvNqNMYfgUtv1ikx8+Bfw67BfL3coNOLw+AOFNL5ew==',key_name='tempest-TestVolumeBootPattern-1333911820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d5f985c3a8447e4870782d5e8709609',ramdisk_id='',reservation_id='r-tic330ia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1241691583',owner_user_name='tempest-TestVolumeBootPattern-1241691583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:20:28Z,user_data=None,user_id='06a79841cf6743a7bd565a6084383f6c',uuid=1fdf8225-f999-4be8-b119-33f9038d295c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c20306a-ebd2-4025-9e99-7edba4bcf4e3", "address": "fa:16:3e:b8:d6:6f", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c20306a-eb", "ovs_interfaceid": "4c20306a-ebd2-4025-9e99-7edba4bcf4e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73484) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 14:20:37 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converting VIF {"id": "4c20306a-ebd2-4025-9e99-7edba4bcf4e3", "address": "fa:16:3e:b8:d6:6f", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c20306a-eb", "ovs_interfaceid": "4c20306a-ebd2-4025-9e99-7edba4bcf4e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:20:37 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:d6:6f,bridge_name='br-int',has_traffic_filtering=True,id=4c20306a-ebd2-4025-9e99-7edba4bcf4e3,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c20306a-eb') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:20:37 user nova-compute[73484]: DEBUG nova.objects.instance [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lazy-loading 'pci_devices' on Instance uuid 1fdf8225-f999-4be8-b119-33f9038d295c {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:20:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] End _get_guest_xml xml=<domain type="kvm">
Aug 14 14:20:37 user nova-compute[73484]:   <uuid>1fdf8225-f999-4be8-b119-33f9038d295c</uuid>
Aug 14 14:20:37 user nova-compute[73484]:   <name>instance-00000034</name>
Aug 14 14:20:37 user nova-compute[73484]:   <memory>524288</memory>
Aug 14 14:20:37 user nova-compute[73484]:   <vcpu>1</vcpu>
Aug 14 14:20:37 user nova-compute[73484]:   <metadata>
Aug 14 14:20:37 user nova-compute[73484]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 14:20:37 user nova-compute[73484]:       <nova:package version="0.0.0"/>
Aug 14 14:20:37 user nova-compute[73484]:       <nova:name>tempest-TestVolumeBootPattern-server-1992131546</nova:name>
Aug 14 14:20:37 user nova-compute[73484]:       <nova:creationTime>2023-08-14 14:20:36</nova:creationTime>
Aug 14 14:20:37 user nova-compute[73484]:       <nova:flavor name="m1.tiny">
Aug 14 14:20:37 user nova-compute[73484]:         <nova:memory>512</nova:memory>
Aug 14 14:20:37 user nova-compute[73484]:         <nova:disk>1</nova:disk>
Aug 14 14:20:37 user nova-compute[73484]:         <nova:swap>0</nova:swap>
Aug 14 14:20:37 user nova-compute[73484]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 14:20:37 user nova-compute[73484]:         <nova:vcpus>1</nova:vcpus>
Aug 14 14:20:37 user nova-compute[73484]:       </nova:flavor>
Aug 14 14:20:37 user nova-compute[73484]:       <nova:owner>
Aug 14 14:20:37 user nova-compute[73484]:         <nova:user uuid="06a79841cf6743a7bd565a6084383f6c">tempest-TestVolumeBootPattern-1241691583-project-member</nova:user>
Aug 14 14:20:37 user nova-compute[73484]:         <nova:project uuid="1d5f985c3a8447e4870782d5e8709609">tempest-TestVolumeBootPattern-1241691583</nova:project>
Aug 14 14:20:37 user nova-compute[73484]:       </nova:owner>
Aug 14 14:20:37 user nova-compute[73484]:       <nova:ports>
Aug 14 14:20:37 user nova-compute[73484]:         <nova:port uuid="4c20306a-ebd2-4025-9e99-7edba4bcf4e3">
Aug 14 14:20:37 user nova-compute[73484]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 14:20:37 user nova-compute[73484]:         </nova:port>
Aug 14 14:20:37 user nova-compute[73484]:       </nova:ports>
Aug 14 14:20:37 user nova-compute[73484]:     </nova:instance>
Aug 14 14:20:37 user nova-compute[73484]:   </metadata>
Aug 14 14:20:37 user nova-compute[73484]:   <sysinfo type="smbios">
Aug 14 14:20:37 user nova-compute[73484]:     <system>
Aug 14 14:20:37 user nova-compute[73484]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 14:20:37 user nova-compute[73484]:       <entry name="product">OpenStack Nova</entry>
Aug 14 14:20:37 user nova-compute[73484]:       <entry name="version">0.0.0</entry>
Aug 14 14:20:37 user nova-compute[73484]:       <entry name="serial">1fdf8225-f999-4be8-b119-33f9038d295c</entry>
Aug 14 14:20:37 user nova-compute[73484]:       <entry name="uuid">1fdf8225-f999-4be8-b119-33f9038d295c</entry>
Aug 14 14:20:37 user nova-compute[73484]:       <entry name="family">Virtual Machine</entry>
Aug 14 14:20:37 user nova-compute[73484]:     </system>
Aug 14 14:20:37 user nova-compute[73484]:   </sysinfo>
Aug 14 14:20:37 user nova-compute[73484]:   <os>
Aug 14 14:20:37 user nova-compute[73484]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 14:20:37 user nova-compute[73484]:     <boot dev="hd"/>
Aug 14 14:20:37 user nova-compute[73484]:     <smbios mode="sysinfo"/>
Aug 14 14:20:37 user nova-compute[73484]:   </os>
Aug 14 14:20:37 user nova-compute[73484]:   <features>
Aug 14 14:20:37 user nova-compute[73484]:     <acpi/>
Aug 14 14:20:37 user nova-compute[73484]:     <apic/>
Aug 14 14:20:37 user nova-compute[73484]:     <vmcoreinfo/>
Aug 14 14:20:37 user nova-compute[73484]:   </features>
Aug 14 14:20:37 user nova-compute[73484]:   <clock offset="utc">
Aug 14 14:20:37 user nova-compute[73484]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 14:20:37 user nova-compute[73484]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 14:20:37 user nova-compute[73484]:     <timer name="hpet" present="no"/>
Aug 14 14:20:37 user nova-compute[73484]:   </clock>
Aug 14 14:20:37 user nova-compute[73484]:   <cpu mode="custom" match="exact">
Aug 14 14:20:37 user nova-compute[73484]:     <model>Nehalem</model>
Aug 14 14:20:37 user nova-compute[73484]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 14:20:37 user nova-compute[73484]:   </cpu>
Aug 14 14:20:37 user nova-compute[73484]:   <devices>
Aug 14 14:20:37 user nova-compute[73484]:     <disk type="block" device="disk">
Aug 14 14:20:37 user nova-compute[73484]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:20:37 user nova-compute[73484]:       <source dev="/dev/sdc"/>
Aug 14 14:20:37 user nova-compute[73484]:       <target dev="vda" bus="virtio"/>
Aug 14 14:20:37 user nova-compute[73484]:       <serial>b1bcc318-fe67-4bcb-bf0f-73b537c473a4</serial>
Aug 14 14:20:37 user nova-compute[73484]:     </disk>
Aug 14 14:20:37 user nova-compute[73484]:     <interface type="ethernet">
Aug 14 14:20:37 user nova-compute[73484]:       <mac address="fa:16:3e:b8:d6:6f"/>
Aug 14 14:20:37 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 14:20:37 user nova-compute[73484]:       <mtu size="1442"/>
Aug 14 14:20:37 user nova-compute[73484]:       <target dev="tap4c20306a-eb"/>
Aug 14 14:20:37 user nova-compute[73484]:     </interface>
Aug 14 14:20:37 user nova-compute[73484]:     <serial type="pty">
Aug 14 14:20:37 user nova-compute[73484]:       <log file="/opt/stack/data/nova/instances/1fdf8225-f999-4be8-b119-33f9038d295c/console.log" append="off"/>
Aug 14 14:20:37 user nova-compute[73484]:     </serial>
Aug 14 14:20:37 user nova-compute[73484]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 14:20:37 user nova-compute[73484]:     <video>
Aug 14 14:20:37 user nova-compute[73484]:       <model type="virtio"/>
Aug 14 14:20:37 user nova-compute[73484]:     </video>
Aug 14 14:20:37 user nova-compute[73484]:     <rng model="virtio">
Aug 14 14:20:37 user nova-compute[73484]:       <backend model="random">/dev/urandom</backend>
Aug 14 14:20:37 user nova-compute[73484]:     </rng>
Aug 14 14:20:37 user nova-compute[73484]:     <controller type="usb" index="0" model="none"/>
Aug 14 14:20:37 user nova-compute[73484]:     <memballoon model="virtio">
Aug 14 14:20:37 user nova-compute[73484]:       <stats period="10"/>
Aug 14 14:20:37 user nova-compute[73484]:     </memballoon>
Aug 14 14:20:37 user nova-compute[73484]:   </devices>
Aug 14 14:20:37 user nova-compute[73484]: </domain>
Aug 14 14:20:37 user nova-compute[73484]:  {{(pid=73484) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 14:20:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:20:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1992131546',display_name='tempest-TestVolumeBootPattern-server-1992131546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1992131546',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0YtWHij329FNoIKSuvewNW0lchEW8QXW6SCNcWsE4ArVpjE7z7ynO0kMwxMk/WbCTDPiOAzr+p3ygxr0+DrAhogvNqNMYfgUtv1ikx8+Bfw67BfL3coNOLw+AOFNL5ew==',key_name='tempest-TestVolumeBootPattern-1333911820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d5f985c3a8447e4870782d5e8709609',ramdisk_id='',reservation_id='r-tic330ia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1241691583',owner_user_name='tempest-TestVolumeBootPattern-1241691583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:20:28Z,user_data=None,user_id='06a79841cf6743a7bd565a6084383f6c',uuid=1fdf8225-f999-4be8-b119-33f9038d295c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c20306a-ebd2-4025-9e99-7edba4bcf4e3", "address": "fa:16:3e:b8:d6:6f", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c20306a-eb", "ovs_interfaceid": "4c20306a-ebd2-4025-9e99-7edba4bcf4e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 14:20:37 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converting VIF {"id": "4c20306a-ebd2-4025-9e99-7edba4bcf4e3", "address": "fa:16:3e:b8:d6:6f", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c20306a-eb", "ovs_interfaceid": "4c20306a-ebd2-4025-9e99-7edba4bcf4e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:20:37 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:d6:6f,bridge_name='br-int',has_traffic_filtering=True,id=4c20306a-ebd2-4025-9e99-7edba4bcf4e3,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c20306a-eb') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:20:37 user nova-compute[73484]: DEBUG os_vif [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:d6:6f,bridge_name='br-int',has_traffic_filtering=True,id=4c20306a-ebd2-4025-9e99-7edba4bcf4e3,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c20306a-eb') {{(pid=73484) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 14:20:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:20:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:20:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 14:20:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:20:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c20306a-eb, may_exist=True, interface_attrs={}) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:20:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4c20306a-eb, col_values=(('external_ids', {'iface-id': '4c20306a-ebd2-4025-9e99-7edba4bcf4e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:d6:6f', 'vm-uuid': '1fdf8225-f999-4be8-b119-33f9038d295c'}),), if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:20:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:20:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:20:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:20:37 user nova-compute[73484]: INFO os_vif [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:d6:6f,bridge_name='br-int',has_traffic_filtering=True,id=4c20306a-ebd2-4025-9e99-7edba4bcf4e3,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c20306a-eb')
Aug 14 14:20:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] No BDM found with device name vda, not building metadata. {{(pid=73484) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:20:37 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] No VIF found with MAC fa:16:3e:b8:d6:6f, not building metadata {{(pid=73484) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:20:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:20:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:20:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:20:39 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:20:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-aff5554f-24d5-47e1-8b83-454b81f3288a req-e12a9511-d9cf-4dbb-ada8-4fd189dee929 service nova] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Received event network-vif-plugged-4c20306a-ebd2-4025-9e99-7edba4bcf4e3 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:20:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-aff5554f-24d5-47e1-8b83-454b81f3288a req-e12a9511-d9cf-4dbb-ada8-4fd189dee929 service nova] Acquiring lock "1fdf8225-f999-4be8-b119-33f9038d295c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:20:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-aff5554f-24d5-47e1-8b83-454b81f3288a req-e12a9511-d9cf-4dbb-ada8-4fd189dee929 service nova] Lock "1fdf8225-f999-4be8-b119-33f9038d295c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:20:39 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-aff5554f-24d5-47e1-8b83-454b81f3288a req-e12a9511-d9cf-4dbb-ada8-4fd189dee929 service nova] Lock "1fdf8225-f999-4be8-b119-33f9038d295c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:20:39 user nova-compute[73484]: DEBUG nova.compute.manager [req-aff5554f-24d5-47e1-8b83-454b81f3288a req-e12a9511-d9cf-4dbb-ada8-4fd189dee929 service nova] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] No waiting events found dispatching network-vif-plugged-4c20306a-ebd2-4025-9e99-7edba4bcf4e3 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:20:39 user nova-compute[73484]: WARNING nova.compute.manager [req-aff5554f-24d5-47e1-8b83-454b81f3288a req-e12a9511-d9cf-4dbb-ada8-4fd189dee929 service nova] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Received unexpected event network-vif-plugged-4c20306a-ebd2-4025-9e99-7edba4bcf4e3 for instance with vm_state building and task_state spawning.
Aug 14 14:20:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:20:40 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692022840.9871585, 1fdf8225-f999-4be8-b119-33f9038d295c => Resumed> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:20:40 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] VM Resumed (Lifecycle Event)
Aug 14 14:20:40 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Instance event wait completed in 0 seconds for  {{(pid=73484) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 14:20:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Guest created on hypervisor {{(pid=73484) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 14:20:40 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Instance spawned successfully.
Aug 14 14:20:40 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 14:20:41 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:20:41 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:20:41 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Found default for hw_cdrom_bus of ide {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:20:41 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Found default for hw_disk_bus of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:20:41 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Found default for hw_input_bus of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:20:41 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Found default for hw_pointer_model of None {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:20:41 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Found default for hw_video_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:20:41 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Found default for hw_vif_model of virtio {{(pid=73484) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:20:41 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:20:41 user nova-compute[73484]: DEBUG nova.virt.driver [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] Emitting event <LifecycleEvent: 1692022840.9875245, 1fdf8225-f999-4be8-b119-33f9038d295c => Started> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:20:41 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] VM Started (Lifecycle Event)
Aug 14 14:20:41 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:20:41 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73484) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:20:41 user nova-compute[73484]: INFO nova.compute.manager [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Took 4.92 seconds to spawn the instance on the hypervisor.
Aug 14 14:20:41 user nova-compute[73484]: DEBUG nova.compute.manager [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:20:41 user nova-compute[73484]: INFO nova.compute.manager [None req-a2331509-587a-4443-91cd-5cd77c81b575 None None] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:20:41 user nova-compute[73484]: INFO nova.compute.manager [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Took 13.89 seconds to build instance.
Aug 14 14:20:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-0a78a6e1-2cf4-4ca6-8235-da972c186810 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "1fdf8225-f999-4be8-b119-33f9038d295c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.988s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:20:41 user nova-compute[73484]: DEBUG nova.compute.manager [req-990f1388-c432-4d50-80d6-9af7d398f1d0 req-6a544531-d046-46f9-a806-627ee9233480 service nova] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Received event network-vif-plugged-4c20306a-ebd2-4025-9e99-7edba4bcf4e3 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:20:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-990f1388-c432-4d50-80d6-9af7d398f1d0 req-6a544531-d046-46f9-a806-627ee9233480 service nova] Acquiring lock "1fdf8225-f999-4be8-b119-33f9038d295c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:20:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-990f1388-c432-4d50-80d6-9af7d398f1d0 req-6a544531-d046-46f9-a806-627ee9233480 service nova] Lock "1fdf8225-f999-4be8-b119-33f9038d295c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:20:41 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-990f1388-c432-4d50-80d6-9af7d398f1d0 req-6a544531-d046-46f9-a806-627ee9233480 service nova] Lock "1fdf8225-f999-4be8-b119-33f9038d295c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:20:41 user nova-compute[73484]: DEBUG nova.compute.manager [req-990f1388-c432-4d50-80d6-9af7d398f1d0 req-6a544531-d046-46f9-a806-627ee9233480 service nova] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] No waiting events found dispatching network-vif-plugged-4c20306a-ebd2-4025-9e99-7edba4bcf4e3 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:20:41 user nova-compute[73484]: WARNING nova.compute.manager [req-990f1388-c432-4d50-80d6-9af7d398f1d0 req-6a544531-d046-46f9-a806-627ee9233480 service nova] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Received unexpected event network-vif-plugged-4c20306a-ebd2-4025-9e99-7edba4bcf4e3 for instance with vm_state active and task_state None.
Aug 14 14:20:42 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:20:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:20:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:20:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:20:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:20:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:20:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:20:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:20:52 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:20:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:20:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:21:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:21:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:21:04 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:21:04 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 14:21:04 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Rebuilding the list of instances to heal {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 14:21:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-145baef9-6d0e-4243-b1cc-67e426e7888c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:21:04 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-145baef9-6d0e-4243-b1cc-67e426e7888c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:21:04 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 14:21:04 user nova-compute[73484]: DEBUG nova.objects.instance [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lazy-loading 'info_cache' on Instance uuid 145baef9-6d0e-4243-b1cc-67e426e7888c {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:21:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:21:05 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Updating instance_info_cache with network_info: [{"id": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "address": "fa:16:3e:c9:9a:16", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf2c480e-46", "ovs_interfaceid": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:21:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-145baef9-6d0e-4243-b1cc-67e426e7888c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:21:05 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 14:21:07 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:21:07 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:21:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:21:11 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:21:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:21:14 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:21:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 14:21:15 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:21:15 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:21:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:21:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:21:15 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:21:15 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 14:21:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 14:21:15 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 14:21:16 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:21:16 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:21:16 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=8658MB free_disk=25.26178741455078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 14:21:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:21:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:21:16 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 145baef9-6d0e-4243-b1cc-67e426e7888c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:21:16 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 1fdf8225-f999-4be8-b119-33f9038d295c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:21:16 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 14:21:16 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 14:21:16 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:21:16 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:21:16 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 14:21:16 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:21:17 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:21:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:21:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:21:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:21:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:21:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:21:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:21:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:21:22 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:21:22 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:21:22 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:21:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:21:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:21:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:21:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:21:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:21:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:21:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:21:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:21:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:21:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:21:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:21:32 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:21:37 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:21:41 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:21:42 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:21:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:21:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:21:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:21:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:21:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:21:47 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:21:52 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:21:52 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:21:52 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:21:52 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:21:52 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:21:52 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:21:57 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:22:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:22:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:22:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:22:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:22:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:22:02 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:22:05 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:22:05 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 14:22:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-1fdf8225-f999-4be8-b119-33f9038d295c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:22:05 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-1fdf8225-f999-4be8-b119-33f9038d295c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:22:05 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 14:22:06 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Updating instance_info_cache with network_info: [{"id": "4c20306a-ebd2-4025-9e99-7edba4bcf4e3", "address": "fa:16:3e:b8:d6:6f", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c20306a-eb", "ovs_interfaceid": "4c20306a-ebd2-4025-9e99-7edba4bcf4e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:22:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-1fdf8225-f999-4be8-b119-33f9038d295c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:22:06 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 14:22:07 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:22:07 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:22:07 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:22:07 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:22:07 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:22:07 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:22:07 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:22:12 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:22:13 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:22:14 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:22:14 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 14:22:16 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:22:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:22:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:22:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73484) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 14:22:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:22:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73484) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:22:17 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:22:17 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:22:17 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:22:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:22:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:22:17 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:22:17 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 14:22:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 14:22:17 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 14:22:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:22:18 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:22:18 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:22:18 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=8728MB free_disk=25.261119842529297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 14:22:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:22:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:22:18 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 145baef9-6d0e-4243-b1cc-67e426e7888c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:22:18 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 1fdf8225-f999-4be8-b119-33f9038d295c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:22:18 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 14:22:18 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 14:22:18 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:22:18 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:22:18 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 14:22:18 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.492s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:22:19 user nova-compute[73484]: DEBUG nova.compute.manager [req-221002c5-0601-4f0d-a68a-39b32d54b79a req-7a5a5f36-a42a-4f6d-a100-b0379fd0dadb service nova] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Received event network-changed-4c20306a-ebd2-4025-9e99-7edba4bcf4e3 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:22:19 user nova-compute[73484]: DEBUG nova.compute.manager [req-221002c5-0601-4f0d-a68a-39b32d54b79a req-7a5a5f36-a42a-4f6d-a100-b0379fd0dadb service nova] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Refreshing instance network info cache due to event network-changed-4c20306a-ebd2-4025-9e99-7edba4bcf4e3. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:22:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-221002c5-0601-4f0d-a68a-39b32d54b79a req-7a5a5f36-a42a-4f6d-a100-b0379fd0dadb service nova] Acquiring lock "refresh_cache-1fdf8225-f999-4be8-b119-33f9038d295c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:22:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-221002c5-0601-4f0d-a68a-39b32d54b79a req-7a5a5f36-a42a-4f6d-a100-b0379fd0dadb service nova] Acquired lock "refresh_cache-1fdf8225-f999-4be8-b119-33f9038d295c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:22:19 user nova-compute[73484]: DEBUG nova.network.neutron [req-221002c5-0601-4f0d-a68a-39b32d54b79a req-7a5a5f36-a42a-4f6d-a100-b0379fd0dadb service nova] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Refreshing network info cache for port 4c20306a-ebd2-4025-9e99-7edba4bcf4e3 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG nova.compute.manager [req-fd1f8c59-1761-4083-bc55-668c61058712 req-9b011d6a-4973-4dea-9f7c-1925ab573b84 service nova] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Received event network-changed-4c20306a-ebd2-4025-9e99-7edba4bcf4e3 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG nova.compute.manager [req-fd1f8c59-1761-4083-bc55-668c61058712 req-9b011d6a-4973-4dea-9f7c-1925ab573b84 service nova] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Refreshing instance network info cache due to event network-changed-4c20306a-ebd2-4025-9e99-7edba4bcf4e3. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-fd1f8c59-1761-4083-bc55-668c61058712 req-9b011d6a-4973-4dea-9f7c-1925ab573b84 service nova] Acquiring lock "refresh_cache-1fdf8225-f999-4be8-b119-33f9038d295c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG nova.network.neutron [req-221002c5-0601-4f0d-a68a-39b32d54b79a req-7a5a5f36-a42a-4f6d-a100-b0379fd0dadb service nova] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Updated VIF entry in instance network info cache for port 4c20306a-ebd2-4025-9e99-7edba4bcf4e3. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG nova.network.neutron [req-221002c5-0601-4f0d-a68a-39b32d54b79a req-7a5a5f36-a42a-4f6d-a100-b0379fd0dadb service nova] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Updating instance_info_cache with network_info: [{"id": "4c20306a-ebd2-4025-9e99-7edba4bcf4e3", "address": "fa:16:3e:b8:d6:6f", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c20306a-eb", "ovs_interfaceid": "4c20306a-ebd2-4025-9e99-7edba4bcf4e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "1fdf8225-f999-4be8-b119-33f9038d295c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "1fdf8225-f999-4be8-b119-33f9038d295c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "1fdf8225-f999-4be8-b119-33f9038d295c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "1fdf8225-f999-4be8-b119-33f9038d295c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "1fdf8225-f999-4be8-b119-33f9038d295c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:22:20 user nova-compute[73484]: INFO nova.compute.manager [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Terminating instance
Aug 14 14:22:20 user nova-compute[73484]: DEBUG nova.compute.manager [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-221002c5-0601-4f0d-a68a-39b32d54b79a req-7a5a5f36-a42a-4f6d-a100-b0379fd0dadb service nova] Releasing lock "refresh_cache-1fdf8225-f999-4be8-b119-33f9038d295c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-fd1f8c59-1761-4083-bc55-668c61058712 req-9b011d6a-4973-4dea-9f7c-1925ab573b84 service nova] Acquired lock "refresh_cache-1fdf8225-f999-4be8-b119-33f9038d295c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG nova.network.neutron [req-fd1f8c59-1761-4083-bc55-668c61058712 req-9b011d6a-4973-4dea-9f7c-1925ab573b84 service nova] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Refreshing network info cache for port 4c20306a-ebd2-4025-9e99-7edba4bcf4e3 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG nova.network.neutron [req-fd1f8c59-1761-4083-bc55-668c61058712 req-9b011d6a-4973-4dea-9f7c-1925ab573b84 service nova] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Updated VIF entry in instance network info cache for port 4c20306a-ebd2-4025-9e99-7edba4bcf4e3. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG nova.network.neutron [req-fd1f8c59-1761-4083-bc55-668c61058712 req-9b011d6a-4973-4dea-9f7c-1925ab573b84 service nova] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Updating instance_info_cache with network_info: [{"id": "4c20306a-ebd2-4025-9e99-7edba4bcf4e3", "address": "fa:16:3e:b8:d6:6f", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c20306a-eb", "ovs_interfaceid": "4c20306a-ebd2-4025-9e99-7edba4bcf4e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-fd1f8c59-1761-4083-bc55-668c61058712 req-9b011d6a-4973-4dea-9f7c-1925ab573b84 service nova] Releasing lock "refresh_cache-1fdf8225-f999-4be8-b119-33f9038d295c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:22:20 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Instance destroyed successfully.
Aug 14 14:22:20 user nova-compute[73484]: DEBUG nova.objects.instance [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lazy-loading 'resources' on Instance uuid 1fdf8225-f999-4be8-b119-33f9038d295c {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:20:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1992131546',display_name='tempest-TestVolumeBootPattern-server-1992131546',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1992131546',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0YtWHij329FNoIKSuvewNW0lchEW8QXW6SCNcWsE4ArVpjE7z7ynO0kMwxMk/WbCTDPiOAzr+p3ygxr0+DrAhogvNqNMYfgUtv1ikx8+Bfw67BfL3coNOLw+AOFNL5ew==',key_name='tempest-TestVolumeBootPattern-1333911820',keypairs=<?>,launch_index=0,launched_at=2023-08-14T14:20:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d5f985c3a8447e4870782d5e8709609',ramdisk_id='',reservation_id='r-tic330ia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1241691583',owner_user_name='tempest-TestVolumeBootPattern-1241691583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T14:20:41Z,user_data=None,user_id='06a79841cf6743a7bd565a6084383f6c',uuid=1fdf8225-f999-4be8-b119-33f9038d295c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c20306a-ebd2-4025-9e99-7edba4bcf4e3", "address": "fa:16:3e:b8:d6:6f", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c20306a-eb", "ovs_interfaceid": "4c20306a-ebd2-4025-9e99-7edba4bcf4e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converting VIF {"id": "4c20306a-ebd2-4025-9e99-7edba4bcf4e3", "address": "fa:16:3e:b8:d6:6f", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c20306a-eb", "ovs_interfaceid": "4c20306a-ebd2-4025-9e99-7edba4bcf4e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:d6:6f,bridge_name='br-int',has_traffic_filtering=True,id=4c20306a-ebd2-4025-9e99-7edba4bcf4e3,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c20306a-eb') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG os_vif [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:d6:6f,bridge_name='br-int',has_traffic_filtering=True,id=4c20306a-ebd2-4025-9e99-7edba4bcf4e3,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c20306a-eb') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c20306a-eb, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:22:20 user nova-compute[73484]: INFO os_vif [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:d6:6f,bridge_name='br-int',has_traffic_filtering=True,id=4c20306a-ebd2-4025-9e99-7edba4bcf4e3,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c20306a-eb')
Aug 14 14:22:20 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHYXIabr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:22:20 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:22:20 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc8a284-a41e-4f4a-b330-4f2a4dc33dde]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1f2ecc-da6e-4013-ae8a-2df779246195]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 (non-flash)\ntcp: [64] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 (non-flash)
Aug 14 14:22:20 user nova-compute[73484]: tcp: [64] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4 (non-flash)
Aug 14 14:22:20 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 (non-flash)
Aug 14 14:22:20 user nova-compute[73484]: tcp: [64] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4 (non-flash)
Aug 14 14:22:20 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc4583ffb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4'): ({'sdc'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Removing single pathed devices sdc {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d60ac0-d9d8-4eeb-add6-834a1d22627b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:22:20 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41bdb0e-bedf-408d-b0b2-f468db6d37d3]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Flushing IO for device /dev/sdc {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a04ad4-f7fa-4e8a-b63b-78087bd5c393]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[483122d5-16fd-487f-a3e6-94714c6eca12]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] SCSI volumes sdc have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_6f37e7a2', '/dev/disk/by-id/scsi-1SCST_BIO6f37e7a2-6449556c61ff6717', '/dev/disk/by-id/scsi-23634343935353663') {{(pid=84315) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e3d9fc-8f0d-4286-a096-e6cb4dca34fc]: (4, None) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8eee8ab-bf2d-439c-84f5-2920ba68c828]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4 -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5bf460-2aba-4c84-8e88-c974f29ae923]: (4, ('Logging out of session [sid: 64, target: iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4, portal: 172.16.0.220,3260]\nLogout of [sid: 64, target: iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 64, target: iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4, portal: 172.16.0.220,3260]
Aug 14 14:22:21 user nova-compute[73484]: Logout of [sid: 64, target: iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4, portal: 172.16.0.220,3260] successful.
Aug 14 14:22:21 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4 -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1bcc318-fe67-4bcb-bf0f-73b537c473a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[52513f3f-4407-4e61-b4cf-52e05c289181]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] <== disconnect_volume: return (312ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 14:22:21 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Deleting instance files /opt/stack/data/nova/instances/1fdf8225-f999-4be8-b119-33f9038d295c_del
Aug 14 14:22:21 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Deletion of /opt/stack/data/nova/instances/1fdf8225-f999-4be8-b119-33f9038d295c_del complete
Aug 14 14:22:21 user nova-compute[73484]: INFO nova.compute.manager [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 14 14:22:21 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 14:22:21 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:22:21 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Took 0.46 seconds to deallocate network for instance.
Aug 14 14:22:21 user nova-compute[73484]: DEBUG nova.compute.manager [req-e157fc90-7b5f-4c49-af28-2611452f271f req-622327e5-d3d5-47b6-bd6f-39d40fb57f4d service nova] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Received event network-vif-deleted-4c20306a-ebd2-4025-9e99-7edba4bcf4e3 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:22:22 user nova-compute[73484]: DEBUG nova.compute.manager [req-8fda9829-eeaf-4ab1-aa5f-7a0017f86279 req-0526da03-f072-4ac9-8f8b-f1c1e0cf44f0 service nova] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Received event network-vif-unplugged-4c20306a-ebd2-4025-9e99-7edba4bcf4e3 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:22:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8fda9829-eeaf-4ab1-aa5f-7a0017f86279 req-0526da03-f072-4ac9-8f8b-f1c1e0cf44f0 service nova] Acquiring lock "1fdf8225-f999-4be8-b119-33f9038d295c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:22:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8fda9829-eeaf-4ab1-aa5f-7a0017f86279 req-0526da03-f072-4ac9-8f8b-f1c1e0cf44f0 service nova] Lock "1fdf8225-f999-4be8-b119-33f9038d295c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:22:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8fda9829-eeaf-4ab1-aa5f-7a0017f86279 req-0526da03-f072-4ac9-8f8b-f1c1e0cf44f0 service nova] Lock "1fdf8225-f999-4be8-b119-33f9038d295c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:22:22 user nova-compute[73484]: DEBUG nova.compute.manager [req-8fda9829-eeaf-4ab1-aa5f-7a0017f86279 req-0526da03-f072-4ac9-8f8b-f1c1e0cf44f0 service nova] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] No waiting events found dispatching network-vif-unplugged-4c20306a-ebd2-4025-9e99-7edba4bcf4e3 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:22:22 user nova-compute[73484]: DEBUG nova.compute.manager [req-8fda9829-eeaf-4ab1-aa5f-7a0017f86279 req-0526da03-f072-4ac9-8f8b-f1c1e0cf44f0 service nova] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Received event network-vif-unplugged-4c20306a-ebd2-4025-9e99-7edba4bcf4e3 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 14:22:22 user nova-compute[73484]: DEBUG nova.compute.manager [req-8fda9829-eeaf-4ab1-aa5f-7a0017f86279 req-0526da03-f072-4ac9-8f8b-f1c1e0cf44f0 service nova] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Received event network-vif-plugged-4c20306a-ebd2-4025-9e99-7edba4bcf4e3 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:22:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8fda9829-eeaf-4ab1-aa5f-7a0017f86279 req-0526da03-f072-4ac9-8f8b-f1c1e0cf44f0 service nova] Acquiring lock "1fdf8225-f999-4be8-b119-33f9038d295c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:22:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8fda9829-eeaf-4ab1-aa5f-7a0017f86279 req-0526da03-f072-4ac9-8f8b-f1c1e0cf44f0 service nova] Lock "1fdf8225-f999-4be8-b119-33f9038d295c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:22:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-8fda9829-eeaf-4ab1-aa5f-7a0017f86279 req-0526da03-f072-4ac9-8f8b-f1c1e0cf44f0 service nova] Lock "1fdf8225-f999-4be8-b119-33f9038d295c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:22:22 user nova-compute[73484]: DEBUG nova.compute.manager [req-8fda9829-eeaf-4ab1-aa5f-7a0017f86279 req-0526da03-f072-4ac9-8f8b-f1c1e0cf44f0 service nova] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] No waiting events found dispatching network-vif-plugged-4c20306a-ebd2-4025-9e99-7edba4bcf4e3 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:22:22 user nova-compute[73484]: WARNING nova.compute.manager [req-8fda9829-eeaf-4ab1-aa5f-7a0017f86279 req-0526da03-f072-4ac9-8f8b-f1c1e0cf44f0 service nova] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Received unexpected event network-vif-plugged-4c20306a-ebd2-4025-9e99-7edba4bcf4e3 for instance with vm_state active and task_state deleting.
Aug 14 14:22:22 user nova-compute[73484]: INFO nova.compute.manager [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Took 0.77 seconds to detach 1 volumes for instance.
Aug 14 14:22:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:22:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:22:22 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:22:22 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:22:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:22:22 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Deleted allocations for instance 1fdf8225-f999-4be8-b119-33f9038d295c
Aug 14 14:22:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-c75843d2-8416-49a8-876e-a106e76b4440 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "1fdf8225-f999-4be8-b119-33f9038d295c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.725s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:22:24 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:22:24 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:22:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:22:30 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:22:35 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692022940.8638577, 1fdf8225-f999-4be8-b119-33f9038d295c => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:22:35 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] VM Stopped (Lifecycle Event)
Aug 14 14:22:35 user nova-compute[73484]: DEBUG nova.compute.manager [None req-a88578ec-5317-41d7-a3e8-705d7eb9fa75 None None] [instance: 1fdf8225-f999-4be8-b119-33f9038d295c] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:22:35 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:22:40 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:22:45 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:22:50 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:22:55 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:23:00 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:23:05 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:23:06 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:23:06 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 14:23:06 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Rebuilding the list of instances to heal {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 14:23:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "refresh_cache-145baef9-6d0e-4243-b1cc-67e426e7888c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:23:06 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquired lock "refresh_cache-145baef9-6d0e-4243-b1cc-67e426e7888c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:23:06 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Forcefully refreshing network info cache for instance {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 14:23:06 user nova-compute[73484]: DEBUG nova.objects.instance [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lazy-loading 'info_cache' on Instance uuid 145baef9-6d0e-4243-b1cc-67e426e7888c {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:23:07 user nova-compute[73484]: DEBUG nova.network.neutron [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Updating instance_info_cache with network_info: [{"id": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "address": "fa:16:3e:c9:9a:16", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf2c480e-46", "ovs_interfaceid": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:23:07 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Releasing lock "refresh_cache-145baef9-6d0e-4243-b1cc-67e426e7888c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:23:07 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Updated the network info_cache for instance {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 14:23:09 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:23:10 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:23:13 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:23:15 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:23:15 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 14:23:15 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:23:16 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:23:17 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:23:19 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:23:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:23:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:23:19 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:23:19 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 14:23:19 user nova-compute[73484]: DEBUG nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73484) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 14:23:20 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:23:20 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:23:20 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=8816MB free_disk=25.26020050048828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 14:23:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:23:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:23:20 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Instance 145baef9-6d0e-4243-b1cc-67e426e7888c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73484) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:23:20 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 14:23:20 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 14:23:20 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Refreshing inventories for resource provider 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 14:23:20 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Updating ProviderTree inventory for provider 165d4635-93b4-49a6-879a-21c1324822ab from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 14:23:20 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Updating inventory in ProviderTree for provider 165d4635-93b4-49a6-879a-21c1324822ab with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 14:23:20 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Refreshing aggregate associations for resource provider 165d4635-93b4-49a6-879a-21c1324822ab, aggregates: None {{(pid=73484) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 14:23:20 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Refreshing trait associations for resource provider 165d4635-93b4-49a6-879a-21c1324822ab, traits: COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_TRUSTED_CERTS {{(pid=73484) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 14:23:20 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:23:20 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:23:20 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 14:23:20 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.370s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:23:20 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:23:20 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73484) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 14:23:20 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:23:21 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:23:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Cleaning up deleted instances {{(pid=73484) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 14:23:21 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] There are 0 instances to clean {{(pid=73484) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 14:23:21 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:23:24 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:23:24 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:23:25 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:23:27 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG nova.compute.manager [req-40873aa1-f4ac-4af3-aea5-813f7560f50f req-ddc91b53-bd08-4e67-927f-f055969acac0 service nova] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Received event network-changed-df2c480e-463a-4a4e-a6a6-295ff11493e4 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG nova.compute.manager [req-40873aa1-f4ac-4af3-aea5-813f7560f50f req-ddc91b53-bd08-4e67-927f-f055969acac0 service nova] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Refreshing instance network info cache due to event network-changed-df2c480e-463a-4a4e-a6a6-295ff11493e4. {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-40873aa1-f4ac-4af3-aea5-813f7560f50f req-ddc91b53-bd08-4e67-927f-f055969acac0 service nova] Acquiring lock "refresh_cache-145baef9-6d0e-4243-b1cc-67e426e7888c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-40873aa1-f4ac-4af3-aea5-813f7560f50f req-ddc91b53-bd08-4e67-927f-f055969acac0 service nova] Acquired lock "refresh_cache-145baef9-6d0e-4243-b1cc-67e426e7888c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG nova.network.neutron [req-40873aa1-f4ac-4af3-aea5-813f7560f50f req-ddc91b53-bd08-4e67-927f-f055969acac0 service nova] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Refreshing network info cache for port df2c480e-463a-4a4e-a6a6-295ff11493e4 {{(pid=73484) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "145baef9-6d0e-4243-b1cc-67e426e7888c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "145baef9-6d0e-4243-b1cc-67e426e7888c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "145baef9-6d0e-4243-b1cc-67e426e7888c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "145baef9-6d0e-4243-b1cc-67e426e7888c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "145baef9-6d0e-4243-b1cc-67e426e7888c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:23:28 user nova-compute[73484]: INFO nova.compute.manager [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Terminating instance
Aug 14 14:23:28 user nova-compute[73484]: DEBUG nova.compute.manager [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Start destroying the instance on the hypervisor. {{(pid=73484) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG nova.compute.manager [req-007f273e-09d5-442f-aaeb-afe6f02416f9 req-e75449de-990e-4f23-bbdc-4744b9de50fa service nova] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Received event network-vif-unplugged-df2c480e-463a-4a4e-a6a6-295ff11493e4 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-007f273e-09d5-442f-aaeb-afe6f02416f9 req-e75449de-990e-4f23-bbdc-4744b9de50fa service nova] Acquiring lock "145baef9-6d0e-4243-b1cc-67e426e7888c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-007f273e-09d5-442f-aaeb-afe6f02416f9 req-e75449de-990e-4f23-bbdc-4744b9de50fa service nova] Lock "145baef9-6d0e-4243-b1cc-67e426e7888c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-007f273e-09d5-442f-aaeb-afe6f02416f9 req-e75449de-990e-4f23-bbdc-4744b9de50fa service nova] Lock "145baef9-6d0e-4243-b1cc-67e426e7888c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG nova.compute.manager [req-007f273e-09d5-442f-aaeb-afe6f02416f9 req-e75449de-990e-4f23-bbdc-4744b9de50fa service nova] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] No waiting events found dispatching network-vif-unplugged-df2c480e-463a-4a4e-a6a6-295ff11493e4 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG nova.compute.manager [req-007f273e-09d5-442f-aaeb-afe6f02416f9 req-e75449de-990e-4f23-bbdc-4744b9de50fa service nova] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Received event network-vif-unplugged-df2c480e-463a-4a4e-a6a6-295ff11493e4 for instance with task_state deleting. {{(pid=73484) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG nova.network.neutron [req-40873aa1-f4ac-4af3-aea5-813f7560f50f req-ddc91b53-bd08-4e67-927f-f055969acac0 service nova] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Updated VIF entry in instance network info cache for port df2c480e-463a-4a4e-a6a6-295ff11493e4. {{(pid=73484) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG nova.network.neutron [req-40873aa1-f4ac-4af3-aea5-813f7560f50f req-ddc91b53-bd08-4e67-927f-f055969acac0 service nova] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Updating instance_info_cache with network_info: [{"id": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "address": "fa:16:3e:c9:9a:16", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf2c480e-46", "ovs_interfaceid": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:23:28 user nova-compute[73484]: INFO nova.virt.libvirt.driver [-] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Instance destroyed successfully.
Aug 14 14:23:28 user nova-compute[73484]: DEBUG nova.objects.instance [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lazy-loading 'resources' on Instance uuid 145baef9-6d0e-4243-b1cc-67e426e7888c {{(pid=73484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-40873aa1-f4ac-4af3-aea5-813f7560f50f req-ddc91b53-bd08-4e67-927f-f055969acac0 service nova] Releasing lock "refresh_cache-145baef9-6d0e-4243-b1cc-67e426e7888c" {{(pid=73484) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.vif [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:18:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-743847908',display_name='tempest-TestVolumeBootPattern-server-743847908',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-743847908',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0YtWHij329FNoIKSuvewNW0lchEW8QXW6SCNcWsE4ArVpjE7z7ynO0kMwxMk/WbCTDPiOAzr+p3ygxr0+DrAhogvNqNMYfgUtv1ikx8+Bfw67BfL3coNOLw+AOFNL5ew==',key_name='tempest-TestVolumeBootPattern-1333911820',keypairs=<?>,launch_index=0,launched_at=2023-08-14T14:18:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d5f985c3a8447e4870782d5e8709609',ramdisk_id='',reservation_id='r-nf2bcbul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1241691583',owner_user_name='tempest-TestVolumeBootPattern-1241691583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T14:18:36Z,user_data=None,user_id='06a79841cf6743a7bd565a6084383f6c',uuid=145baef9-6d0e-4243-b1cc-67e426e7888c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "address": "fa:16:3e:c9:9a:16", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf2c480e-46", "ovs_interfaceid": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converting VIF {"id": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "address": "fa:16:3e:c9:9a:16", "network": {"id": "37aa986f-1211-45d7-8ca4-9ef51cfbb0d2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-568405118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5f985c3a8447e4870782d5e8709609", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf2c480e-46", "ovs_interfaceid": "df2c480e-463a-4a4e-a6a6-295ff11493e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG nova.network.os_vif_util [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:9a:16,bridge_name='br-int',has_traffic_filtering=True,id=df2c480e-463a-4a4e-a6a6-295ff11493e4,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf2c480e-46') {{(pid=73484) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG os_vif [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:9a:16,bridge_name='br-int',has_traffic_filtering=True,id=df2c480e-463a-4a4e-a6a6-295ff11493e4,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf2c480e-46') {{(pid=73484) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf2c480e-46, bridge=br-int, if_exists=True) {{(pid=73484) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:23:28 user nova-compute[73484]: INFO os_vif [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:9a:16,bridge_name='br-int',has_traffic_filtering=True,id=df2c480e-463a-4a4e-a6a6-295ff11493e4,network=Network(37aa986f-1211-45d7-8ca4-9ef51cfbb0d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf2c480e-46')
Aug 14 14:23:28 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] calling os-brick to detach iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc478329120>, {'target_iqns': ['iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IposQtFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:23:28 user nova-compute[73484]: WARNING os_brick.initiator.connectors.base [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:23:28 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121', 0)] {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[67aaa37e-071a-4581-b69c-41eefbc0883e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:23:28 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[8706315b-bb4f-4e6f-b358-85b1dcc69fd2]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 (non-flash)\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 (non-flash)
Aug 14 14:23:29 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 (non-flash)
Aug 14 14:23:29 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc478676560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121'): ({'sdb'}, set())}) {{(pid=73484) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Removing single pathed devices sdb {{(pid=73484) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[184bfd0b-b954-494c-8bc2-7f7d867ccf2d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62c212a-ad09-4d35-b00d-3f189e6577cd]: (4, ('ok\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Flushing IO for device /dev/sdb {{(pid=73484) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d2b698-7071-4392-9b00-f8c20f63b5f3]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73484) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4b4c44-75a3-4523-b6f4-e6967cea7786]: (4, ('1', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG os_brick.initiator.linuxscsi [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] SCSI volumes sdb have been removed. {{(pid=73484) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_2094b48e', '/dev/disk/by-id/scsi-1SCST_BIO2094b48e-708f1d477fe6d734', '/dev/disk/by-id/scsi-23730386631643437') {{(pid=84315) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fd6d75-15ff-4931-8594-75dda1011206]: (4, None) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121')] {{(pid=73484) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[41534a0d-d47d-4489-8bbc-8cc7ab1b0d61]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --logout {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f745e7-0153-4789-af1f-5659b6b0c1b6]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121, portal: 172.16.0.220,3260]
Aug 14 14:23:29 user nova-compute[73484]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121, portal: 172.16.0.220,3260] successful.
Aug 14 14:23:29 user nova-compute[73484]:  stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --op delete {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162c163-fcf9-4d3f-b793-ebd8d3be9121 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84315) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a832d6-14a8-485f-8b04-4b289b1b9d14]: (4, ('', '')) {{(pid=84315) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73484) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.base [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] <== disconnect_volume: return (276ms) None {{(pid=73484) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Disconnected iSCSI Volume {{(pid=73484) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 14:23:29 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Deleting instance files /opt/stack/data/nova/instances/145baef9-6d0e-4243-b1cc-67e426e7888c_del
Aug 14 14:23:29 user nova-compute[73484]: INFO nova.virt.libvirt.driver [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Deletion of /opt/stack/data/nova/instances/145baef9-6d0e-4243-b1cc-67e426e7888c_del complete
Aug 14 14:23:29 user nova-compute[73484]: INFO nova.compute.manager [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 14 14:23:29 user nova-compute[73484]: DEBUG oslo.service.loopingcall [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73484) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG nova.compute.manager [-] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Deallocating network for instance {{(pid=73484) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] deallocate_for_instance() {{(pid=73484) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 14:23:29 user nova-compute[73484]: DEBUG nova.network.neutron [-] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Updating instance_info_cache with network_info: [] {{(pid=73484) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:23:29 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Took 0.50 seconds to deallocate network for instance.
Aug 14 14:23:30 user nova-compute[73484]: INFO nova.compute.manager [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Took 0.72 seconds to detach 1 volumes for instance.
Aug 14 14:23:30 user nova-compute[73484]: DEBUG nova.compute.manager [req-ef4fd00d-c5fd-4968-83f1-de9c09105795 req-d8a10617-8420-435e-953e-2bc62ff6d40b service nova] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Received event network-vif-plugged-df2c480e-463a-4a4e-a6a6-295ff11493e4 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:23:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ef4fd00d-c5fd-4968-83f1-de9c09105795 req-d8a10617-8420-435e-953e-2bc62ff6d40b service nova] Acquiring lock "145baef9-6d0e-4243-b1cc-67e426e7888c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:23:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ef4fd00d-c5fd-4968-83f1-de9c09105795 req-d8a10617-8420-435e-953e-2bc62ff6d40b service nova] Lock "145baef9-6d0e-4243-b1cc-67e426e7888c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:23:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [req-ef4fd00d-c5fd-4968-83f1-de9c09105795 req-d8a10617-8420-435e-953e-2bc62ff6d40b service nova] Lock "145baef9-6d0e-4243-b1cc-67e426e7888c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:23:30 user nova-compute[73484]: DEBUG nova.compute.manager [req-ef4fd00d-c5fd-4968-83f1-de9c09105795 req-d8a10617-8420-435e-953e-2bc62ff6d40b service nova] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] No waiting events found dispatching network-vif-plugged-df2c480e-463a-4a4e-a6a6-295ff11493e4 {{(pid=73484) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:23:30 user nova-compute[73484]: WARNING nova.compute.manager [req-ef4fd00d-c5fd-4968-83f1-de9c09105795 req-d8a10617-8420-435e-953e-2bc62ff6d40b service nova] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Received unexpected event network-vif-plugged-df2c480e-463a-4a4e-a6a6-295ff11493e4 for instance with vm_state active and task_state deleting.
Aug 14 14:23:30 user nova-compute[73484]: DEBUG nova.compute.manager [req-ef4fd00d-c5fd-4968-83f1-de9c09105795 req-d8a10617-8420-435e-953e-2bc62ff6d40b service nova] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Received event network-vif-deleted-df2c480e-463a-4a4e-a6a6-295ff11493e4 {{(pid=73484) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:23:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:23:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:23:30 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:23:30 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:23:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.108s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:23:30 user nova-compute[73484]: INFO nova.scheduler.client.report [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Deleted allocations for instance 145baef9-6d0e-4243-b1cc-67e426e7888c
Aug 14 14:23:30 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-37a3b133-a317-4511-8a82-0d2d3364fa88 tempest-TestVolumeBootPattern-1241691583 tempest-TestVolumeBootPattern-1241691583-project-member] Lock "145baef9-6d0e-4243-b1cc-67e426e7888c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.627s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:23:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:23:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:23:42 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:23:43 user nova-compute[73484]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692023008.9206707, 145baef9-6d0e-4243-b1cc-67e426e7888c => Stopped> {{(pid=73484) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:23:43 user nova-compute[73484]: INFO nova.compute.manager [-] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] VM Stopped (Lifecycle Event)
Aug 14 14:23:43 user nova-compute[73484]: DEBUG nova.compute.manager [None req-63229015-03d4-4567-bd27-de5de9df8e15 None None] [instance: 145baef9-6d0e-4243-b1cc-67e426e7888c] Checking state {{(pid=73484) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:23:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:23:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:23:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:23:58 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:24:03 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:24:06 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:24:06 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Starting heal instance info cache {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 14:24:06 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Rebuilding the list of instances to heal {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 14:24:06 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Didn't find any instances for network info cache update. {{(pid=73484) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 14:24:08 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:24:11 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:24:13 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:24:14 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:24:17 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:24:17 user nova-compute[73484]: DEBUG nova.compute.manager [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73484) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 14:24:18 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:24:18 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:24:18 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:24:19 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:24:21 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:24:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:24:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:24:21 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:24:21 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Auditing locally available compute resources for user (node: user) {{(pid=73484) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 14:24:22 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:24:22 user nova-compute[73484]: WARNING nova.virt.libvirt.driver [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:24:22 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Hypervisor/Node resource view: name=user free_ram=8956MB free_disk=25.25926971435547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=73484) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 14:24:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:24:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:24:22 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 14:24:22 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73484) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 14:24:22 user nova-compute[73484]: DEBUG nova.compute.provider_tree [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed in ProviderTree for provider: 165d4635-93b4-49a6-879a-21c1324822ab {{(pid=73484) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:24:22 user nova-compute[73484]: DEBUG nova.scheduler.client.report [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Inventory has not changed for provider 165d4635-93b4-49a6-879a-21c1324822ab based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73484) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:24:22 user nova-compute[73484]: DEBUG nova.compute.resource_tracker [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Compute_service record updated for user:user {{(pid=73484) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 14:24:22 user nova-compute[73484]: DEBUG oslo_concurrency.lockutils [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=73484) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:24:23 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:24:25 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:24:25 user nova-compute[73484]: DEBUG oslo_service.periodic_task [None req-6e0b8592-70e8-49c9-a725-03c0619e3d52 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73484) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:24:26 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:24:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:24:28 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:24:31 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:24:33 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:24:38 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:24:43 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:24:48 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:24:53 user nova-compute[73484]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73484) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}